A distance image acquisition apparatus includes a projection unit which projects a first pattern of structured light in a plurality of wavelength bandwidths, an imaging unit which is provided in parallel with and apart from the projection unit by a baseline length, performs imaging with sensitivities to a plurality of wavelength bandwidths, and generates a plurality of captured images corresponding to a plurality of wavelength bandwidths, a determination unit which determines whether or not a second pattern of structured light projected from another distance image acquisition apparatus is included in the captured images, and a pattern extraction unit which extracts the first pattern from a captured image determined as the second pattern being not included by the determination unit, and a distance image acquisition unit which acquires a distance image indicating a distance of a subject within a distance measurement region based on the first pattern.

The distance image acquisition apparatus (10) includes a projection unit (12) which projects a first pattern of structured light distributed in a two-dimensional manner with respect to a subject within a distance measurement region, a light modulation unit (22) which spatially modulates the first pattern projected from the projection unit (12), an imaging unit (14) which is provided in parallel with and apart from the projection unit (12) by a baseline length, and captures an image including the first pattern reflected from the subject within the distance measurement region, a pattern extraction unit (20A) which extracts the first pattern spatially modulated by the light modulation unit (22) from the image captured by the imaging unit (14), and a distance image acquisition unit (20B) which acquires a distance image indicating a distance of the subject within the distance measurement region based on the first pattern.

A method and apparatus for performing a single view depth and texture calibration are described. In one embodiment, the apparatus comprises a calibration unit operable to perform a single view calibration process using a captured single view a target having a plurality of plane geometries having detectable features and being at a single orientation and to generate calibration parameters to calibrate one or more of the projector and multiple cameras using the single view of the target.

An information processing apparatus includes an imaging apparatus that irradiates reference light in a predetermined wavelength band to a subject and captures reflection of the reference light from the subject to acquire data of captured images including a polarized image in multiple bearings (S30). Based on the polarized image, the imaging apparatus acquires a polarization degree image representing a distribution of polarization degrees (S32). The imaging apparatus extracts a region whose polarization degree falls within a predetermined range of polarization degrees as an image of the subject having a predetermined material (S34). The imaging apparatus performs relevant processing on the subject image to generate output data and outputs the generated data (S36).

An information processing apparatus includes an imaging apparatus that irradiates reference light in a predetermined wavelength band to a subject and captures reflection of the reference light from the subject to acquire data of captured images including a polarized image in multiple bearings (S30). Based on the polarized image, the imaging apparatus acquires a polarization degree image representing a distribution of polarization degrees (S32). The imaging apparatus extracts a region whose polarization degree falls within a predetermined range of polarization degrees as an image of the subject having a predetermined material (S34). The imaging apparatus performs relevant processing on the subject image to generate output data and outputs the generated data (S36).

A system for executing a three-dimensional (3D) intraoperative scan of a patient is disclosed. A 3D scanner controller projects the object points included onto a first image plane and the object points onto a second image plane. The 3D scanner controller determines first epipolar lines associated with the first image plane and second epipolar lines associated with the second image plane based on an epipolar plane that triangulates the object points included in the first 2D intraoperative image to the object points included in the second 2D intraoperative image. Each epipolar lines provides a depth of each object as projected onto the first image plane and the second image plane. The 3D scanner controller converts the first 2D intraoperative image and the second 2D intraoperative image to the 3D intraoperative scan of the patient based on the depth of each object point provided by each corresponding epipolar line.

Two-dimensional (2D) color information and 3D-depth information are concurrently obtained from a 2D pixel array. The 2D pixel array is arranged in a first group of a plurality of rows. A second group of rows of the array are operable to generate 2D-color information and pixels of a third group of the array are operable to generate 3D-depth information. The first group of rows comprises a first number of rows, the second group of rows comprises a second number of rows that is equal to or less than the first number of rows, and the third group of rows comprises a third number of rows that is equal to or less than the second number of rows. In an alternating manner, 2D-color information is received from a row selected from the second group of rows and 3D-depth information is received from a row selected from the third group of rows.

Two-dimensional (2D) color information and 3D-depth information are concurrently obtained from a 2D pixel array. The 2D pixel array is arranged in a first group of a plurality of rows. A second group of rows of the array are operable to generate 2D-color information and pixels of a third group of the array are operable to generate 3D-depth information. The first group of rows comprises a first number of rows, the second group of rows comprises a second number of rows that is equal to or less than the first number of rows, and the third group of rows comprises a third number of rows that is equal to or less than the second number of rows. In an alternating manner, 2D-color information is received from a row selected from the second group of rows and 3D-depth information is received from a row selected from the third group of rows.

A device for detecting the surroundings of a vehicle and a method for detecting the surroundings, and a vehicle designed to carry out said method comprise a camera module, a camera control apparatus, an analysis unit and an illumination device. The illumination device is formed by a matrix headlight of the vehicle and is designed such that it can project a light pattern into the surroundings. The projected light pattern is imaged in the detection region of the camera module and the 3D position of measurement points formed by the light pattern in the surroundings is determined by the analysis unit. However, the illumination device projects the light pattern only into regions of the surroundings in which the analysis unit has ascertained, based on image data, a value that is critical for 3D position determination.

A device for detecting the surroundings of a vehicle and a method for detecting the surroundings, and a vehicle designed to carry out said method comprise a camera module, a camera control apparatus, an analysis unit and an illumination device. The illumination device is formed by a matrix headlight of the vehicle and is designed such that it can project a light pattern into the surroundings. The projected light pattern is imaged in the detection region of the camera module and the 3D position of measurement points formed by the light pattern in the surroundings is determined by the analysis unit. However, the illumination device projects the light pattern only into regions of the surroundings in which the analysis unit has ascertained, based on image data, a value that is critical for 3D position determination.