A parallax correction method for a transparent display system is provided. The transparent display system includes a transparent display device located between a background object and a user. The parallax correction method includes the following steps. A gaze point is displayed on the transparent display device. An image including the transparent display device, the background object and the user is captured. At least two display anchor points and at least two corresponding background object anchor points are detected according to the image. The display anchor points are located on the transparent display device, and the background object anchor points are located on the background object. A plurality of visual extension lines extending from the display anchor points and the corresponding background object anchor points are obtained. An equivalent eye position of the ocular dominance of the user is obtained according an intersection of the visual extension lines.

A system for single photon avalanche diode image capture is configurable to, over a frame capture time period, selectively activate an illuminator to alternately emit light from the illuminator and refrain from emitting light from the illuminator. The system is configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each SPAD pixel of the SPAD array to enable photon detection. The plurality of sequential shutter operations generates, for each SPAD pixel of the SPAD array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations. The system is configurable to, based on a first set of binary counts of the plurality of binary counts, generate an ambient light image. The system is configurable to, based on a second set of binary counts of the plurality of binary counts, generate an illuminated image.

A stereo camera apparatus includes a stereo camera, a speed sensor, and a control device. The control device includes one or more processors and one or more storage media. The one or more processors are configured to: detect corresponding points from a first image pair and a second image pair to be captured at different times by the stereo camera; divide each of images of the first image pair and the second image pair into regions; calculate, for each of the regions, a movement speed based on an external parameter by using one or more of the corresponding points included in the each of the regions; and calculate, for the each of the regions, a parallax correction value to cause a difference between the movement speed based on the external parameter and a movement speed detectable by the speed sensor to fall below a predetermined threshold.

A stereo camera apparatus includes a stereo camera, a speed sensor, and a control device. The control device includes one or more processors and one or more storage media. The one or more processors are configured to: detect corresponding points from a first image pair and a second image pair to be captured at different times by the stereo camera; divide each of images of the first image pair and the second image pair into regions; calculate, for each of the regions, a movement speed based on an external parameter by using one or more of the corresponding points included in the each of the regions; and calculate, for the each of the regions, a parallax correction value to cause a difference between the movement speed based on the external parameter and a movement speed detectable by the speed sensor to fall below a predetermined threshold.

While a viewer is viewing a first stereoscopic image comprising a first left image and a first right image, a left vergence angle of a left eye of a viewer and a right vergence angle of a right eye of the viewer are determined. A virtual object depth is determined based at least in part on (i) the left vergence angle of the left eye of the viewer and (ii) the right vergence angle of the right eye of the viewer. A second stereoscopic image comprising a second left image and a second right image for the viewer is rendered on one or more image displays. The second stereoscopic image is subsequent to the first stereoscopic image. The second stereoscopic image is projected from the one or more image displays to a virtual object plane at the virtual object depth.

While a viewer is viewing a first stereoscopic image comprising a first left image and a first right image, a left vergence angle of a left eye of a viewer and a right vergence angle of a right eye of the viewer are determined. A virtual object depth is determined based at least in part on (i) the left vergence angle of the left eye of the viewer and (ii) the right vergence angle of the right eye of the viewer. A second stereoscopic image comprising a second left image and a second right image for the viewer is rendered on one or more image displays. The second stereoscopic image is subsequent to the first stereoscopic image. The second stereoscopic image is projected from the one or more image displays to a virtual object plane at the virtual object depth.

A CNN operates on the disparity or motion outputs of a block matching hardware module, such as a DMPAC module, to produce refined disparity or motion streams which improve operations in images having ambiguous regions. As the block matching hardware module provides most of the processing, the CNN can be small and thus able to operate in real time, in contrast to CNNs which are performing all of the processing. In one example, the CNN operation is performed only if the block hardware module output confidence level is below a predetermined amount. The CNN can have a number of different configurations and still be sufficiently small to operate in real time on conventional platforms.

ADAS includes a processing circuit and a memory which stores instructions executable by the processing circuit. The processing circuit executes the instructions to cause the ADAS to receive, from a vehicle that is in motion, a video sequence, generate a position image including at least one object included in the stereo image, generate a second position information associated with the at least one object based on reflected signals received from the vehicle, determine regions each including at least a portion of the at least one object as candidate bounding boxes based on the stereo image and the position image, and selectively adjusting class scores of respective ones of the candidate bounding boxes associated with the at least one object based on whether a respective first position information of the respective ones of the candidate bounding boxes matches the second position information.

An optical imaging system for imaging a target during a medical procedure, the optical imaging system involving a first camera for capturing a first image of the target, a second wide-field camera for capturing a second image of the target, at least one optional path folding mirror disposed in an optical path between the target and a lens of the second camera, and a processor for receiving the first image and the second image, the processor configured to apply an image transform to one of the first image and the second wide-field image and combine the transformed image with the other one of the images to produce a stereoscopic image of the target.

An optical imaging system for imaging a target during a medical procedure, the optical imaging system involving a first camera for capturing a first image of the target, a second wide-field camera for capturing a second image of the target, at least one optional path folding mirror disposed in an optical path between the target and a lens of the second camera, and a processor for receiving the first image and the second image, the processor configured to apply an image transform to one of the first image and the second wide-field image and combine the transformed image with the other one of the images to produce a stereoscopic image of the target.