The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

A stereoscopic video display device includes: an image display unit configured to display an image; an observer position detection unit configured to detect a position of a nearby observer; a rendering unit configured to form an image of a virtual object corresponding to the position of the observer detected by the observer position detection unit; a rotation unit configured to rotate the image display unit to a position facing the observer detected by the observer position detection unit; a background image obtainment unit configured to obtain an image of a background behind the image display unit; and an image composition processing unit configured to generate a composite image in which the image of the virtual object formed by the rendering unit is superimposed on the image of the background obtained by the background image obtainment unit, and display the composite image on the image display unit.

A stereoscopic video display device includes: an image display unit configured to display an image; an observer position detection unit configured to detect a position of a nearby observer; a rendering unit configured to form an image of a virtual object corresponding to the position of the observer detected by the observer position detection unit; a rotation unit configured to rotate the image display unit to a position facing the observer detected by the observer position detection unit; a background image obtainment unit configured to obtain an image of a background behind the image display unit; and an image composition processing unit configured to generate a composite image in which the image of the virtual object formed by the rendering unit is superimposed on the image of the background obtained by the background image obtainment unit, and display the composite image on the image display unit.

In an example, an augmented reality display system includes a reflective surface, a depth scanner and processing apparatus comprising an image processor and an image generation engine. The depth scanner may be to scan the reflective surface and a subject via the reflective surface to acquire depth data. The image processor may be to determine, based on the depth data, a viewpoint for an augmentation of a reflected image. The image generation engine may be to generate the augmentation for display on the reflective surface.

Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.

Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.

An exemplary extended reality presentation system determines that a depiction of an augmentable object within a field of view takes up a first portion of the field of view, and, in response to this determination, presents a first form of an overlay object within the field of view. The first form of the overlay object is graphically associated with the augmentable object. During the presenting of the first form of the overlay object within the field of view, the system determines that the depiction of the augmentable object has come to take up a second portion of the field of view, and, in response to this determination, replaces the first form of the overlay object with a second form of the overlay object within the field of view. The second form of the overlay object is distinct from the first form. Corresponding methods and systems are also disclosed.

An exemplary extended reality presentation system determines that a depiction of an augmentable object within a field of view takes up a first portion of the field of view, and, in response to this determination, presents a first form of an overlay object within the field of view. The first form of the overlay object is graphically associated with the augmentable object. During the presenting of the first form of the overlay object within the field of view, the system determines that the depiction of the augmentable object has come to take up a second portion of the field of view, and, in response to this determination, replaces the first form of the overlay object with a second form of the overlay object within the field of view. The second form of the overlay object is distinct from the first form. Corresponding methods and systems are also disclosed.