A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, stereoscopic image data of the live action scene is received, and display wall metadata of the precursor image is determined. Further, a first portion of the stereoscopic image data comprising the stage element in the live action scene is determined based on the stereoscopic image data and the display wall metadata. A second portion of the stereoscopic image data comprising the display wall in the live action scene with the display wall displaying the precursor image is also determined. Thereafter, an image matte for the stereoscopic image data is generated based on the first portion and the second portion.

A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, stereoscopic image data of the live action scene is received, and display wall metadata of the precursor image is determined. Further, a first portion of the stereoscopic image data comprising the stage element in the live action scene is determined based on the stereoscopic image data and the display wall metadata. A second portion of the stereoscopic image data comprising the display wall in the live action scene with the display wall displaying the precursor image is also determined. Thereafter, an image matte for the stereoscopic image data is generated based on the first portion and the second portion.

Provided is a real-time omnidirectional stereo matching method in a camera system including a first pair of fisheye cameras including first and second fisheye cameras provided to perform shooting in opposite directions and a second pair of fisheye cameras including third and fourth fisheye cameras provided to perform shooting in opposite directions and in which the first pair of fisheye cameras and the second pair of fisheye cameras are vertically provided, including receiving fisheye images of a subject captured through the first to the fourth fisheye cameras; selecting one fisheye camera from among fisheye cameras for each pixel of a preset reference fisheye image among the fisheye images using a sweep volume for preset distance candidates; generating a distance map for all pixels using the reference fisheye image and a fisheye image of the one fisheye camera; and performing real-time stereo matching on the fisheye images using the distance map.

Provided is a real-time omnidirectional stereo matching method in a camera system including a first pair of fisheye cameras including first and second fisheye cameras provided to perform shooting in opposite directions and a second pair of fisheye cameras including third and fourth fisheye cameras provided to perform shooting in opposite directions and in which the first pair of fisheye cameras and the second pair of fisheye cameras are vertically provided, including receiving fisheye images of a subject captured through the first to the fourth fisheye cameras; selecting one fisheye camera from among fisheye cameras for each pixel of a preset reference fisheye image among the fisheye images using a sweep volume for preset distance candidates; generating a distance map for all pixels using the reference fisheye image and a fisheye image of the one fisheye camera; and performing real-time stereo matching on the fisheye images using the distance map.

A stereoscopic imaging device includes at least a first and a second image recording unit configured to record a first and a second original image of an object from different perspectives, wherein the original images differ at least with regard to one item of image information, an image display unit for imaging displayed images, an image processing unit for further processing the original images, and the image processing unit is configured to supplement at least one of the two original images with at least one item of image information from the other original image to generate a displayed image. In addition, a method for generating at least one displayed image that can be imaged on an image display unit is provided.

A stereoscopic imaging device includes at least a first and a second image recording unit configured to record a first and a second original image of an object from different perspectives, wherein the original images differ at least with regard to one item of image information, an image display unit for imaging displayed images, an image processing unit for further processing the original images, and the image processing unit is configured to supplement at least one of the two original images with at least one item of image information from the other original image to generate a displayed image. In addition, a method for generating at least one displayed image that can be imaged on an image display unit is provided.

A method for high-precision true color three dimensional reconstruction of mechanical component. Firstly performs image acquisition: the left and right high-resolution grayscale cameras are fixed at same height and spaced at certain distance, an optical transmitter fixed between the two grayscale cameras, and low-resolution color camera fixed above optical transmitter, thus images of measured high-precision mechanical component are shot. Then performs image processing: all images are transmitted to a computer, which uses image processing to record surface information of measured high-precision mechanical component in the point cloud by high-precision true color three-dimensional reconstruction, which reflects color texture information of the surface, so as to realize the non-contact high-precision true color three dimensional reconstruction of high-precision mechanical component. The method uses binocular high-precision grayscale cameras instead of binocular color cameras, which broadens the range of capture wavelengths, retains richer texture details of high-precision mechanical component and improves accuracy of measurement.

A method for high-precision true color three dimensional reconstruction of mechanical component. Firstly performs image acquisition: the left and right high-resolution grayscale cameras are fixed at same height and spaced at certain distance, an optical transmitter fixed between the two grayscale cameras, and low-resolution color camera fixed above optical transmitter, thus images of measured high-precision mechanical component are shot. Then performs image processing: all images are transmitted to a computer, which uses image processing to record surface information of measured high-precision mechanical component in the point cloud by high-precision true color three-dimensional reconstruction, which reflects color texture information of the surface, so as to realize the non-contact high-precision true color three dimensional reconstruction of high-precision mechanical component. The method uses binocular high-precision grayscale cameras instead of binocular color cameras, which broadens the range of capture wavelengths, retains richer texture details of high-precision mechanical component and improves accuracy of measurement.

A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.