A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.

A computer-implemented method for correction of a voxel representation of metal affected x-ray data. The method comprises a first 3D deep neural network receiving an initial voxel representation of x-ray data at its input and generating a voxel map at its output, the map identifying voxels of the initial voxel representation that belong to a region of voxels that are affected by metal. A second 3D deep neural network receives the initial voxel representation and the map generated by the first 3D deep neural network at its input and generating a corrected voxel representation, the corrected voxel representation including voxel estimations for voxels that are identified by the voxel map as being part of a metal affected region, the first 3D deep neural being trained on the basis of training data and reference data that include voxel representations of clinical x-ray data of a predetermined body part of a patient.

The disclosure relates to a method and also to a correspondingly configured imaging device for planning support for an interventional procedure. In the method, a model of a hollow organ is created from a 3D image dataset. A deformation of the hollow organ is then simulated based on a course of a guide facility in the hollow organ through a deformation of the model. In accordance with the deformed model, a spatially resolved compression and/or stretching of the hollow organ, which is brought about by an introduction of the guide facility, is determined and specified.

An augmented reality device comprising a camera, an augmented reality display, and a controller. The augmented reality display is configured to display the real-world environment and one or more virtual augmentations. The controller is configured to measure, via determination of hue, a color profile for a displayed portion of the real-world environment visible via the augmented reality display and imaged via the camera. A complementary palette of user interface colors is selected, each of such user interface colors having at least a predefined difference in hue relative to one or more colors in the color profile. An augmented reality feature is visually presented via the augmented reality display at a render location and with a render color from the complementary palette of user interface colors, the render color having at least the predefined difference in hue relative to a real-world environment color corresponding to the render location.

This disclosure relates to methods, non-transitory computer readable media, and systems that can render a virtual object in a digital image by using a source-specific-lighting-estimation-neural network to generate three-dimensional (“3D”) lighting parameters specific to a light source illuminating the digital image. To generate such source-specific-lighting parameters, for instance, the disclosed systems utilize a compact source-specific-lighting-estimation-neural network comprising both common network layers and network layers specific to different lighting parameters. In some embodiments, the disclosed systems further train such a source-specific-lighting-estimation-neural network to accurately estimate spatially varying lighting in a digital image based on comparisons of predicted environment maps from a differentiable-projection layer with ground-truth-environment maps.

A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.

A method and apparatus for simulating a garment according to an example embodiment receive a user input for selecting, in a simulated three-dimensional (3D) garment worn on an avatar, any one of a plurality of objects corresponding to a next depth level to a depth level which is being currently displayed among depth levels for hierarchically displaying one or more pieces included in the 3D garment and two-dimensional (2D) patterns forming each of the pieces, display the next depth level by controlling visualization of the plurality of objects such that the selected object is not covered by at least one of the remaining objects other than the selected object of the plurality of objects, deform the selected object based on an input for editing the selected object corresponding to the next depth level, deform the 3D garment by reflecting deformation of the selected object, and output the deformed 3D garment.

In some embodiments, an electronic device generates virtual lighting effects while presenting a content item. In some embodiments, an electronic device enhances navigation to a respective playback position of a content item. In some embodiments, an electronic device displays media content in a three-dimensional environment. In some embodiments, an electronic device presents media content in different modes of presentation.

A vehicle remote control system having a program running thereon, the vehicle remote control system including a storage device to store data regarding at least one vehicle, a remote control assembly connected to the storage device and the at least one vehicle to control the at least one vehicle corresponding to at least one component of the remote control assembly, and a display assembly to be worn by a user and connected to the remote control assembly to display a virtual reality image based on an exterior environment and an interior environment of the at least one vehicle thereon.

The present technology relates to devices and systems for multidimensional data visualization and interaction in an augmented reality, virtual reality, or mixed reality environment. The disclosed embodiment provides a tool for a physician or other medical specialist to load and review medical scans in an AR/VR/MR environment, assisting medical diagnostics, surgical planning, medical education, or patient engagement.