Described herein are motion smoothing techniques for a display, or display system, such as a head-mounted display (HMD), to account for motion of moving or animating objects in a way that mitigates judder. The display system may be separate from, yet communicatively coupled to, a host computer where a graphics-based application, such as a video game, is outputting frames for rendering on the display system. The host computer may generate motion vectors representing compressed pixel data for transmission to the display system. The motion vectors can be used by the display system to modify pixel data of a frame. The modified pixel data for the frame is “motion-smoothed” for rendering on the display system in a manner that mitigates judder of moving or animating objects.

A processor system processes image data for rendering a virtual environment for a user present in a real environment. The system receives head tracking data indicative of the orientation of the head of the user. An image processor generates image data for rendering a viewport of the virtual environment on a display system based on the head tracking data. A real-view area is defined in the virtual environment, having at least one boundary. The boundary corresponds to predetermined coordinates in the virtual environment. Thereby a corresponding part of the real environment is made visible in the real-view area, the part showing the real environment as perceived from the user head pose. Effectively the virtual environment is augmented by integrating part of the real environment via the real-view area.

An advanced driver assist system (ADAS) may obtain a video sequence including a plurality of frames captured at the vehicle, each frame corresponding to a separate stereo image including a first viewpoint image and a second viewpoint image; generate disparity information associated with a stereo image; obtain depth information associated with an object included in the stereo image based on reflected electromagnetic waves captured at the vehicle; calculate correlation information between the depth information and the disparity information based on the stereo image, the depth information and the disparity information; and correct depth values associated with the stereo image based on the disparity information and the correlation information to generate a depth image with respect to the stereo image. The ADAS may detecting the at least one object in the stereo image, based on the depth image, and may generate an output signal based on the detection.

Due to the factors such as lens distortion and camera misalignment, stereoscopic image pairs often contain vertical disparities. Introduced herein is a method and apparatus that determine and correct vertical disparities in stereoscopic image pairs using an optical flow map. Instead of discarding vertical motion vectors of the optical flow map, the introduced concept extracts and analyzes the vertical motion vectors from the optical flow map and vertically aligns the images using the vertical disparity determined from the vertical motion vectors. The introduced concept recognizes that although not apparent, vertical motion does exist in stereoscopic images and can be used to correct the vertical disparity in stereoscopic images.

A CNN operates on the disparity or motion outputs of a block matching hardware module, such as a DMPAC module, to produce refined disparity or motion streams which improve operations in images having ambiguous regions. As the block matching hardware module provides most of the processing, the CNN can be small and thus able to operate in real time, in contrast to CNNs which are performing all of the processing. In one example, the CNN operation is performed only if the block hardware module output confidence level is below a predetermined amount. The CNN can have a number of different configurations and still be sufficiently small to operate in real time on conventional platforms.

A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. The method further includes delivering, through a second waveguide of the stack of waveguides, light rays having a second wavefront curvature, the second wavefront curvature associated with a predetermined margin of the focal distance of the determined accommodation.

A method and apparatus for encoding three-dimensional (“3D”) video includes receiving a left-eye interlaced frame and a corresponding right-eye interlaced frame of a 3D video. An amount of interlacing exhibited by at least one of the left-eye interlaced frame and the corresponding right-eye interlaced frame is determined. A frame packing format to be used for packing the left-eye interlaced frame and the corresponding right-eye interlaced frame into a 3D frame is selected based on the amount of interlacing that is determined. The left-eye interlaced frame and the corresponding right-eye interlaced frame are formatted into a 3D frame using the selected frame packing format. Illustrative frame packing formats that may be employed include a side-by-side format and a top-and-bottom format.

An image pickup apparatus has a first/second optical system transmitting light through a first/second optical path, the second optical system having parallax with the first optical path; a switcher switching between the first and second optical paths in time series; an image sensor forming a first image and a second image by capturing subject images according to the light transmitted through the first optical path and the second optical path respectively; and a processor processing a signal output from the image sensor, wherein the processor calculates a motion vector in each divided region of a first base image from the first base image and a first reference image captured, interpolates an interpolation motion vector for each pixel of the first base image from the motion vector, and corrects the first base image or the first reference image to form a prediction image of the first image.

A system and method are provided for determining the position and orientation of an implement on a work machine in a non-contact manner using machine vision. A 3D camera, which is mounted on the vehicle with a field of view that includes components on the implement (e.g., markers in some examples), determines a three-dimensional position in a local coordinate system of each of the components. A global positioning system in cooperation with an inertial measurement unit determines a three-dimensional position and orientation of the 3D camera in a global coordinate system. A computing system calculates a three-dimensional position in the global coordinate system for the components using the local three-dimensional positions of the components and the global three-dimensional position and orientation of the 3D camera. The position and orientation of the implement can then be calculated based on the calculated global three-dimensional positions of the components.

Sensor signals from a sensor of a coordinate measuring machine or microscope describe a workpiece arranged within a space. The sensor and the space are movable relative to one another. A method of visualizing the sensor signals includes obtaining data relating to a three-dimensional scene that is stationary relative to the space. The method includes generating a two-dimensional view image of the scene. The view image has opposing edges predefined with respect to at least one of the two directions. A central region of the view image is located between the edges. The method includes, repeatedly, obtaining a two-dimensional sensor representation of the workpiece and combining the sensor representation with the view image to form a two-dimensional output image. The method includes, in response to movement between the sensor and the space, generating a new view image if the central region would extend beyond either of the edges.