An imaging device includes a light separator that separates light into light bands, and imaging elements that each receives one of the light bands and generates a corresponding signal. Each of the imaging elements has a pixel size of at most 2.5 m by 2.5 m. A registration error among the imaging elements is equal to or less than a threshold determined according to the pixel size.

The present invention provides an image processing device, an imaging apparatus, and an image processing method capable of acquiring images that are registered with high accuracy and include only a component of a desired wavelength range. In an image processing device according to an aspect of the invention, at least one image is captured with light having a plurality of wavelength ranges not overlapping one another (that is, including an intentional interference component in addition to a principal wavelength range), and at least one wavelength range of the plurality of wavelength ranges is common among the images. Accordingly, it is possible to detect correspondence points among a plurality of images based on information of such a common wavelength range, and to register the plurality of images with high accuracy. In addition, since an influence of light having a wavelength range other than a specific wavelength range is eliminated after registration, it is possible to acquire a plurality of images including only a component of a desired wavelength range.

Generally described, one or more aspects of the present application correspond to systems and techniques for spectral imaging using a multi-aperture system with curved multi-bandpass filters positioned over each aperture. The present disclosure further relates to techniques for implementing spectral unmixing and image registration to generate a spectral datacube using image information received from such imaging systems. Aspects of the present disclosure relate to using such a datacube to analyze the imaged object, for example to analyze tissue in a clinical setting, perform biometric recognition, or perform materials analysis.

The present disclosure is directed to composite focal plane array (CFPA) imaging systems and techniques for calibrating such imaging systems. An unmanned aerial vehicle has a CFPA imaging system including a plurality of lens assemblies, a plurality focal plane array (FPA) sensors disposed on a planar substrate, and an image processing module. A first processing node of the module receives overlapping image data from the sensors and generates an update for a sensor calibration model based on key points in the overlapping image data. A plurality of other processing nodes receives image data from the sensors. The sensor calibration model is applied to correct the image data, thereby compiling a composite image.

The present disclosure is directed to composite focal plane array (CFPA) imaging systems and techniques for calibrating such imaging systems. An unmanned aerial vehicle has a CFPA imaging system including a plurality of lens assemblies, a plurality focal plane array (FPA) sensors disposed on a planar substrate, and an image processing module. A first processing node of the module receives overlapping image data from the sensors and generates an update for a sensor calibration model based on key points in the overlapping image data. A plurality of other processing nodes receives image data from the sensors. The sensor calibration model is applied to correct the image data, thereby compiling a composite image.

In general, techniques are described that facilitate processing of color image data using both a mono image data and a color image data. A device comprising a monochrome camera, a color camera and a processor may be configured to perform the techniques. The monochrome camera may be configured to capture monochrome image data of a scene. The color camera may be configured to capture color image data of the scene. The processor may be configured to perform intensity equalization with respect to a luma component of either the color image data or the monochrome image data to correct for differences in intensity between the color camera and the monochrome camera.

A mechanism is described for facilitating sensors arrangement and shifting for multisensory super-resolution cameras in imaging environments, according to one embodiment. A method of embodiments, as described herein, includes arranging sensors of a camera such that pixel centers of pixels of an image are spread evenly across a pixel area having pixel planes corresponding to the sensors, where the image is captured by the camera. The method may further include re-arranging the sensors by dividing the sensors in pairs of sensors, where each pair of sensors corresponds to a pair of pixel planes, and shifting the sensors diagonally such that the corresponding pixel planes are adjusted accordingly for improving quality of the image.

Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.

In general, techniques are described that facilitate processing of color image data using both a mono image data and a color image data. A device comprising a monochrome camera, a color camera, and a processor may be configured to perform the techniques. The monochrome camera may capture monochrome image data of a scene. The color camera may capture color image data of the scene. A processor may determine a parallax value indicative of a level of parallax between the monochrome image data and the color image data and determine that the parallax is greater than the parallax threshold. The processor may further combine, in response to the determination that the parallax is greater than the parallax threshold, a luma component of the color image data with a luma component of the monochrome image data to generate a luma component of enhanced color image data.

A photographing apparatus is disclosed. A photographing apparatus according to one embodiment comprises: a first image sensor; a second image sensor; and at least one processor functionally coupled to the first image sensor and the second image sensor, wherein the at least one processor may be configured to: obtain, by using the first image sensor, a first image which includes a first pixel, a second pixel adjacent to the first pixel, and a third pixel adjacent to the second pixel in an area other than the area in which the second pixel and the first pixel are adjacent; obtain, by using the second image sensor, a second image which includes a fourth pixel associated with the first pixel on the basis of the position thereof, and a fifth pixel adjacent to the fourth pixel and associated with the second pixel on the basis of the position thereof; determine whether a difference in luminance between the first pixel and the second pixel falls within a designated range; and, when the difference in the luminance between the first pixel and the second pixel falls within the designated range, generate color information corresponding to at least one of the first pixel and the second pixel at least on the basis of the color information of the fourth pixel and the color information of the fifth pixel.