An image pickup device includes a first camera, a second camera, a first image signal processor (ISP) and a second ISP. The first camera obtains a first image of an object. The second camera obtains a second image of the object. The first ISP performs a first auto focusing (AF), a first auto white balancing (AWB) and a first auto exposing (AE) for the first camera based on a first region-of-interest (ROI) in the first image, and obtains a first distance between the object and the first camera based on a result of the first AF. The second ISP calculates first disparity information associated with the first and second images based on the first distance, moves a second ROI in the second image based on the first disparity information, and performs a second AF, a second AWB and a second AE for the second camera based on the moved second ROI.

Imaging unit for obtaining a three-dimensional image of an object area, comprising an image sensor constituted by a matrix of sensor elements and a focusing unit for providing an image of said object area on the image sensor, the matrix being covered by a color filter array, and a projection unit for projecting a predetermined pattern toward the object area, the focusing unit and the projection unit having optical axes differing with a known angle, wherein the projection unit is adapted to project a time sequence of patterns toward the object area, the pattern sequence being chosen so as to uniquely define a position along at least one axis perpendicular to the projection axis, over the period defined by the illumination, wherein each sensor element in said matrix is connected to a processing branch adapted to detect the variations in the illumination sequence measured at each sensor element, and calculating from the known angle between the projection and imaging axes, the position in the sensor matrix, and the illumination sequence detected at each sensor element, a three-dimensional coordinate of the imaged point on the surface of the object, and wherein the processing branch is adapted to sample at least one image of said image area and calculate a color image based on said color filter pattern for said at least one image.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

A device includes a feature amount calculating unit for receiving an infrared light image and a visible light image and extracting a feature amount from at least one of the images and an image correcting unit for executing pixel value correction processing on the infrared light image on the basis of a reference area and a correction parameter determined depending on the feature amount. The device further includes a tap selection unit for determining the reference area used for the pixel value correction on the basis of the feature amount and a correction parameter calculating unit for determining the correction parameter used for the pixel value correction on the basis of the feature amount. The image correcting unit executes the pixel value correction processing in which a tap determined by the tap selection unit and the correction parameter determined by the correction parameter calculating unit are applied.

The present disclosure discloses a method for image or video shooting. The method is applied to a terminal that includes a first camera, a second camera, and a third camera. The second camera is a black-and-white camera, and the first camera, the second camera, and the third camera are cameras using prime lenses. The third camera is a color camera using a tele-photo lens. The method includes determining at least one camera from the first camera, the second camera, and the third camera based on a target zoom ratio as a target camera. The method further includes capturing, by using the target camera, at least one image that includes a target scene. The method further includes obtaining an output image of the target scene based on the at least one image that includes the target scene. According to the present disclosure, an approximately 5x lossless zoom effect is achieved.

An image processing apparatus is provided to alleviate degradation of the gradation of a color image in the case where images having a sensitivity different from each other are obtained by imaging one same object in black-and-white and color. The image processing apparatus includes a gradation control part obtaining a brightness signal representing a black-and-white image and a chroma signal representing a color image obtained by imaging a same object as that for the black-and-white image and that controls gradation of the chroma signal on the basis of the brightness signal. This configuration can suppress degradation of the gradation of a color image to be minimal in the case where images having a sensitivity different from each other are obtained by imaging one same object in black-and-white and color.

Provided is a color camera that captures using environmental light, a monochrome camera that captures using infrared light, a signal processing unit that processes a signal of a color image output from the color camera and a signal of a monochrome image output from the monochrome camera, a storage unit that stores alignment information generated from a color image and a monochrome image captured in a state of sufficient environmental light, an alignment unit that performs an alignment based on alignment information to match positions of a subject shown in a color image and a monochrome image captured in a state of insufficient environmental light, and an image synthesis unit that acquires color information from the aligned color image and performs color conversion to colorize the monochrome image using the color information.

The invention is relates to systems and methods for high dynamic range (HDR) image capture and video processing in mobile devices. Aspects of the invention include a mobile device, such as a smartphone or digital mobile camera, including at least two image sensors fixed in a co-planar arrangement to a substrate and an optical splitting system configured to reflect at least about 90% of incident light received through an aperture of the mobile device onto the co-planar image sensors, to thereby capture a HDR image. In some embodiments, greater than about 95% of the incident light received through the aperture of the device is reflected onto the image sensors.

The invention provides methods for broadcasting video in a dual HDR/LDR format such that the video can be displayed in real time by both LDR and HDR display devices. Methods and devices of the invention process streams of pixels from multiple sensors in a frame-independent manner to produce an HDR video signal in real time. That HDR video signal is then tone-mapped to produce an LDR video signal, the LDR signal is subtracted from the HDR signal to calculate a residual signal, and the LDR signal and the residual signal are merged into a combined signal that is broadcast via a communications network.

According to one embodiment, an imaging apparatus includes an image sensor, image generation circuitry, calculation circuitry and superimposition circuitry. The image generation circuitry successively generates a first image and a second image. The calculation circuitry calculates a first parameter to allow brightness of the first image to be equal to or close to a predetermined value, and calculates a second parameter relating to brightness of the second image based on the first parameter and a predetermined ratio. The superimposition circuitry generates a composite image by superimposing the second image in which the brightness is adjusted using the second parameter onto the first image in which the brightness is adjusted using the first parameter.