The image processing apparatus that generates a virtual viewpoint image includes a generation unit. The generation unit generates a virtual viewpoint image in which in accordance with a virtual viewpoint specified by the virtual viewpoint information. The degree of transparency of a specific object at a position a specific distance apart from a position of a first virtual viewpoint in a virtual viewpoint image in accordance with the first virtual viewpoint corresponding to a first angle of view, which is generated by the generation unit, is higher than a degree of transparency of an object at a position the specific distance apart from a position of a second virtual viewpoint in a virtual viewpoint image in accordance with the second virtual viewpoint corresponding to a second angle of view larger than the first angle of view.

The image processing apparatus that generates a virtual viewpoint image includes a generation unit. The generation unit generates a virtual viewpoint image in which in accordance with a virtual viewpoint specified by the virtual viewpoint information. The degree of transparency of a specific object at a position a specific distance apart from a position of a first virtual viewpoint in a virtual viewpoint image in accordance with the first virtual viewpoint corresponding to a first angle of view, which is generated by the generation unit, is higher than a degree of transparency of an object at a position the specific distance apart from a position of a second virtual viewpoint in a virtual viewpoint image in accordance with the second virtual viewpoint corresponding to a second angle of view larger than the first angle of view.

A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for display. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device.

A 360-degree image data processing method performed by a 360-degree video reception apparatus according to the present invention includes: receiving 360-degree image data; obtaining information on an encoded picture and metadata from the 360-degree image data; decoding a picture based on the information on the encoded picture; and rendering the decoded picture and an overlay based on the metadata, wherein the metadata includes group information, the group information includes group type information indicating a group including a main media and the overlay that can be rendered together, the decoded picture includes the main media, and the group information includes information indicating whether a track belonging to the group includes the main media or the overlay.

A 360-degree image data processing method performed by a 360-degree video reception apparatus according to the present invention includes: receiving 360-degree image data; obtaining information on an encoded picture and metadata from the 360-degree image data; decoding a picture based on the information on the encoded picture; and rendering the decoded picture and an overlay based on the metadata, wherein the metadata includes group information, the group information includes group type information indicating a group including a main media and the overlay that can be rendered together, the decoded picture includes the main media, and the group information includes information indicating whether a track belonging to the group includes the main media or the overlay.

In an example, an augmented reality display system includes a reflective surface, a depth scanner and processing apparatus comprising an image processor and an image generation engine. The depth scanner may be to scan the reflective surface and a subject via the reflective surface to acquire depth data. The image processor may be to determine, based on the depth data, a viewpoint for an augmentation of a reflected image. The image generation engine may be to generate the augmentation for display on the reflective surface.

An electronic device is disclosed. The present electronic device comprises a display, a processor electrically connected with the display so as to control the display, and a memory electrically connected with the processor, wherein the memory includes at least one command, and the processor, by executing at least one command, acquires a plurality of object images corresponding to a plurality of objects in a two-dimensional image, acquires a plurality of three-dimensional modeling images corresponding to the plurality of object images and information related to the plurality of objects by applying the plurality of object images to a plurality of network models, and displays, on the display, the three-dimensional images including the plurality of three-dimensional modeling images on the basis of the information related to the plurality of objects and the location information about the plurality of objects in the two-dimensional image.

An electronic device is disclosed. The present electronic device comprises a display, a processor electrically connected with the display so as to control the display, and a memory electrically connected with the processor, wherein the memory includes at least one command, and the processor, by executing at least one command, acquires a plurality of object images corresponding to a plurality of objects in a two-dimensional image, acquires a plurality of three-dimensional modeling images corresponding to the plurality of object images and information related to the plurality of objects by applying the plurality of object images to a plurality of network models, and displays, on the display, the three-dimensional images including the plurality of three-dimensional modeling images on the basis of the information related to the plurality of objects and the location information about the plurality of objects in the two-dimensional image.

The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.