In a depth image compressing section of an image processing device, a depth image operation section generates a depth image by operation using photographed stereo images. A difference image obtaining section generates a difference image between an actually measured depth image and the computed depth image. In a depth image decompressing section of a content processing device, a depth image operation section generates a depth image by operation using the transmitted stereo images. A difference image adding section restores a depth image by adding the computed depth image to the transmitted difference image.

Exterior lighting on vehicles and buildings is typically used to illuminate scenes for better vision. The same exterior lighting can be used as part of an active sensor at discrete times during the sensor's active imaging cycles. In embodiments, an intelligent control module enables emitter output in accordance with the imaging system during active imaging cycles and enables emitter output in accordance with the non-imaging lighting control unit during non-imaging cycles. Embodiments of intelligent control modules can be used in security applications, in Automatic Driving Alert Systems and Autonomous Control Systems for commercial and passenger vehicles, and in low-altitude aircraft applications.

A hand-held electronic apparatus, an image capturing apparatus and a method for obtaining depth information are provided. The image capturing apparatus includes a time of fly (TOF) image capturer, a TOF controller, a main and sub image capturers, and a controller. The TOF image capturer calculates a TOF depth map according to a TOF image, defines an effective region and an un-effective region according to the TOF depth map, and obtains a first depth information set of the effective region. The main and sub image capturers captures a first and second images, respectively. The controller obtains a second depth information set of the un-effectively region by comparing the first and second images, and generates an overall depth map by combining the first depth information set and the second depth information set.

An image processing method includes obtaining multiple video frames, where the multiple video frames are collected from a same scene at different angles and determining a depth map of each video frame according to corresponding pixels among the multiple video frames; supplementing background missing regions of the multiple video frames according to depth maps of the multiple video frames, to obtain supplemented video frames of the multiple video frames and depth maps of the multiple supplemented video frames. The method also includes generating an alpha image of each video frame according to an occlusion relationship between each of the multiple video frames and a supplemented video frame of each video frame in a background missing region and generating a browsing frame at a specified browsing angle according to the multiple video frames, the supplemented video frames of the multiple video frames, and alpha images of the multiple video frames.

A transmission apparatus includes a first data stream generation unit, a second data stream generation unit, and a data transmission unit. The first data stream generation unit generates an image compression data stream. The second data stream generation unit generates a audio compression data stream to which specific information which is not directly related to audio data is added. The data transmission unit multiplexes the image compression data stream generated by the first data stream generation unit and the audio compression data stream generated by the second data stream generation unit, and transmits the resulting data stream.

A three-dimensional (3D) image sensor module including: an oscillator configured to output a distortion-compensated oscillation frequency as a driving voltage of a sine wave biased with a bias voltage; an optical shutter configured to vary transmittance of reflective light reflected from a subject, according to the driving voltage, and to modulate the reflective light into at least two optical modulation signals having different phases; and an image generator configured to generate image data about the subject, the image data including depth information that is calculated based on a difference between the phases of the at least two optical modulation signals.

A privacy camera, such as a light field camera that includes an array of cameras or an RGBZ camera(s)) is used to capture images and display images according to a selected privacy mode. The privacy mode may include a blur background mode and a background replacement mode and can be automatically selected based on the meeting type, participants, location, and device type. A region of interest and/or an object(s) of interest (e.g. one or more persons in a foreground) is determined and the privacy camera is configured to clearly show the region/object of interest and obscure or replace the background according to the selected privacy mode. The displayed image includes the region/object(s) of interest clearly shown (e.g. in focus) and any objects in a background of the combined image shown having a limited depth of field (e.g. blurry/not in focus) and/or the background replaced with another image and/or fill.

A method for generating a stereoscopic video stream (101) having composite images (C) that include information about a right image (R) and a left image (L), as well as at least one depth map includes pixels from the right image (R) and from the left image (L), and then entering the selected pixels into a composite image (C) of the stereoscopic video stream. The method also provides for entering all the pixels of the right image (R) and all the pixels of the left image (L) into the composite image (C) by leaving one of said two images unchanged and breaking up the other one into regions (R1, R2, R3) having a plurality of pixels. The pixels of the depth map(s) are then entered into that region of the composite image which is not occupied by pixels of the right and left images.

According to one embodiment, a basic format for a 3D signal having a first area to arrange main video data, a second area to arrange graphic data, a third area to arrange depth information of pixels of the main video data, and a fourth area to arrange depth information of pixels of the graphic data are defined. When depth information of pixels of the main video data is generated, a 3D processing module can select whether to use a first pattern obtained by inserting the graphic data into the main video data and a second pattern obtained by not inserting the graphic data into the main video data. A 3D related controller decides on the first or second pattern to be used by the 3D processing module.

An encoding device and method, and a decoding device and method, capable of encoding and decoding a multi-viewpoint image in accordance with a mode having compatibility with an existing mode. A compatible encoder generates a compatible stream by encoding an image that is a compatible image. An image converting unit converts the resolution of images that are auxiliary images. An auxiliary encoder generates an encoded stream of the auxiliary image by encoding the auxiliary image of which the resolution is converted. A compatibility information generating unit generates, as compatibility information, information that designates the image as a compatible image. A multiplexing unit transmits the compatible stream, the encoded stream of the auxiliary image, and the compatibility information. The encoding device can encode a 3D image of the multi-viewpoint mode.