Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.

Described examples include an integrated circuit having depth fusion engine circuitry configured to receive stereoscopic image data and, in response to the received stereoscopic image data, generate at least: first and second focal perspective images for viewing by a first eye at multiple focal distances; and third and fourth focal perspective images for viewing by a second eye at multiple focal distances. The integrated circuit further includes display driver circuitry coupled to the depth fusion engine circuitry and configured to drive a display device for displaying at least the first, second, third and fourth focal perspective images.

This disclosure contains methods and systems that allow filmmakers to port filmmaking and editing skills to produce content to be used in other environments, such as video game environments, and augmented reality, virtual reality, mixed reality, and non-linear storytelling environments.

A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.

There is provided an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data. A color shift correction data generation unit generates color shift correction data for correcting a color shift between two-dimensional image data of a base viewpoint and two-dimensional image data of a reference viewpoint. A metadata addition unit transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, encoded data of the two-dimensional image data of the base viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object and encoded data of the two-dimensional image data of the reference viewpoint and depth image data. The present disclosure can be applied, for example, to a synthesis apparatus.

The invention relates to layered depth data. In multi-view images, there is a large amount of redundancy between images. Layered Depth Video format is a well-known formatting solution for formatting multi-view images which reduces the amount of redundant information between images. In LDV, a reference central image is selected and information brought by other images of the multi-view images that are mainly regions occluded in the central image are provided. However, LDV format contains a single horizontal occlusion layer, and thus fails rendering viewpoints that uncover multiple layers dis-occlusions. The invention uses light filed content which offers disparities in every directions and enables a change in viewpoint in a plurality of directions distinct from the viewing direction of the considered image enabling to render viewpoints that may uncover multiple layer dis-occlusions which may occurs with complex scenes viewed with wide inter-axial distance.

An apparatus for processing a depth map comprises a receiver (203) receiving an input depth map. A first processor (205) generates a first processed depth map by processing pixels of the input depth map in a bottom to top direction. The processing of a first pixel comprises determining a depth value for the first pixel for the first processed depth map as the furthest backwards depth value of: a depth value for the first pixel in the input depth map, and a depth value determined in response to depth values in the first processed depth map for a first set of pixels being below the first pixel. The approach may improve the consistency of depth maps, and in particular for depth maps generated by combining different depth cues.

A system and method for measuring a depth or length of area of interest a telemedicine patient, comprising: a first image capturing device that captures a two-dimensional (2D) image or video of a region of interest of a patient; a second image capturing device that generates a three-dimensional (3D) point cloud of the region of interest of the patient; a rendering system that processes a unified view for both the first and second image capturing devices where the 2D image and 3D point cloud are generated and registered; and a remote measurement processing system that determines a depth or length between two points selected from the 2D image of the region of interest by identifying associated points in the 3D point cloud and performing a measurement using the identified associated points in the 3D point cloud.

In one embodiment, a three-dimensional LIDAR system includes a light source (e.g., laser) to emit a light beam (e.g., a laser beam) to sense a physical range associated with a target. The system includes a camera and a light detector (e.g., a flash LIDAR unit) to receive at least a portion of the light beam reflected from the target. They system includes a dichroic mirror situated between the target and the light detector, the dichroic mirror configured to direct the light beam reflected from the target to the light detector to generate a first image, wherein the dichroic mirror further directs optical lights reflected from the target to the camera to generate a second image. The system includes an image processing logic coupled to the light detector and the camera to combine the first image and the second image to generate a 3D image.