An image correction device is configured to acquire band images obtained by imaging a subject; by using at least one of the band images as a reference band image and at least one of the rest of the band images as an object band image, acquire a position difference between the object band image and the reference band image; by using a pixel of the object band image as an object pixel and each of pixels of the reference band image that overlap the object pixel when the object pixel is shifted by the position difference as a corresponding pixel, create a corrected band image that holds a pixel value of light on the object band image at the pixel position of the reference band image, on the basis of a relationship between pixel values of the corresponding pixels; and output the corrected band image.

A camera module aligning method includes the following steps. Firstly, a reference chart having plural chart characteristic points is provided. Then, a camera module is used to shoot the reference chart, and an installation position and an installation posture of the camera module are acquired according to an internal parameter matrix and an external parameter matrix. When the camera module shoots the reference chart and an image is formed on an imaging plane of the camera module, a relationship between at least one image characteristic point of the image and the corresponding chart characteristic point complies with a standard relationship. The standard relationship is defined by the internal parameter matrix and the external parameter matrix.

A mechanism is described for facilitating sensors arrangement and shifting for multisensory super-resolution cameras in imaging environments, according to one embodiment. A method of embodiments, as described herein, includes arranging sensors of a camera such that pixel centers of pixels of an image are spread evenly across a pixel area having pixel planes corresponding to the sensors, where the image is captured by the camera. The method may further include re-arranging the sensors by dividing the sensors in pairs of sensors, where each pair of sensors corresponds to a pair of pixel planes, and shifting the sensors diagonally such that the corresponding pixel planes are adjusted accordingly for improving quality of the image.

The present invention provides an image processing device, an imaging apparatus, and an image processing method capable of acquiring images that are registered with high accuracy and include only a component of a desired wavelength range. In an image processing device according to an aspect of the invention, at least one image is captured with light having a plurality of wavelength ranges not overlapping one another (that is, including an intentional interference component in addition to a principal wavelength range), and at least one wavelength range of the plurality of wavelength ranges is common among the images. Accordingly, it is possible to detect correspondence points among a plurality of images based on information of such a common wavelength range, and to register the plurality of images with high accuracy. In addition, since an influence of light having a wavelength range other than a specific wavelength range is eliminated after registration, it is possible to acquire a plurality of images including only a component of a desired wavelength range.

On the basis of a first imaging signal corresponding to a first viewpoint and including white pixels and color component pixels and a second imaging signal corresponding to a second viewpoint different from the first viewpoint and including fewer white pixels than the first imaging signal to increase a rate of the color component pixels in the second imaging signal, a parallax detecting section detects a parallax of the second viewpoint with respect to the first viewpoint. A parallax compensating section performs parallax compensation for the imaging signal for the second viewpoint on the basis of the detected parallax to generate a parallax-compensated color difference signal for the first viewpoint. A fallback determining section and a signal selecting section selects a parallax-compensated second color difference signal or a color difference signal for the first viewpoint to obtain a high-sensitivity captured image while suppressing degradation of the image quality performance.

In order to perform image processing in which relative positional deviation of image outputs between two image pickup units is suppressed, an image pickup apparatus comprises: an imaging device that has a first image pickup unit configured to perform imaging in a first cycle and generate a first image signal, and a second image pickup unit configured to perform imaging in a second cycle shorter than the first image pickup unit and generate a plurality of second image signals; a relation degree information generation unit configured to generate relation degree information between the first image signal and the second image signal based on overlap between an exposure time period in the first image pickup unit and an imaging timing in the cycle of the second image pickup unit; a region selection unit configured to select a specific region from among the second image signals based on the relation degree information generated by the relation degree information generation unit; and an image processing unit configured to perform predetermined image processing on the first image signal based on the specific region selected by the region selection unit.

An imaging device includes a light separator configured to separate light into a plurality of light bands. The imaging device further includes a plurality of imaging elements. Each of the plurality of imaging elements is configured to receive one of the plurality of light bands and to generate a corresponding signal. Each of the plurality of imaging elements has a pixel size for generating a 4K resolution image signal including at least 3840 horizontal pixels and at least 2160 vertical pixels on a display. A registration error among the plurality of imaging elements is equal to or less than a threshold of 20% of a pixel size in the plurality of image elements.

In one embodiment, a method includes accessing first image data generated by a first image sensor having a first filter array that has a first filter pattern. The first filter pattern includes a number of first filter types. The method also includes accessing second image data generated by a second image sensor having a second filter array that has a second filter pattern different from the first filter pattern. The second filter pattern includes a number of second filter types, the number of second filter types and the number of first filter types have at least one filter type in common. The method also includes determining a correspondence between one or more first pixels of the first image data and one or more second pixels of the second image data based on a portion of the first image data associated with the filter type in common.

A photographing apparatus is disclosed. A photographing apparatus according to one embodiment comprises: a first image sensor; a second image sensor; and at least one processor functionally coupled to the first image sensor and the second image sensor, wherein the at least one processor may be configured to: obtain, by using the first image sensor, a first image which includes a first pixel, a second pixel adjacent to the first pixel, and a third pixel adjacent to the second pixel in an area other than the area in which the second pixel and the first pixel are adjacent; obtain, by using the second image sensor, a second image which includes a fourth pixel associated with the first pixel on the basis of the position thereof, and a fifth pixel adjacent to the fourth pixel and associated with the second pixel on the basis of the position thereof; determine whether a difference in luminance between the first pixel and the second pixel falls within a designated range; and, when the difference in the luminance between the first pixel and the second pixel falls within the designated range, generate color information corresponding to at least one of the first pixel and the second pixel at least on the basis of the color information of the fourth pixel and the color information of the fifth pixel.

In one embodiment, a method includes accessing first image data generated by a first image sensor having a first filter array that has a first filter pattern. The first filter pattern includes a number of first filter types. The method also includes accessing second image data generated by a second image sensor having a second filter array that has a second filter pattern different from the first filter pattern. The second filter pattern includes a number of second filter types, the number of second filter types and the number of first filter types have at least one filter type in common. The method also includes determining a correspondence between one or more first pixels of the first image data and one or more second pixels of the second image data based on a portion of the first image data associated with the filter type in common.