Systems and methods for extended color processing on Pelican array cameras in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating a high resolution image includes obtaining input images, where a first set of images includes information in a first band of visible wavelengths and a second set of images includes information in a second band of visible wavelengths and non-visible wavelengths, determining an initial estimate by combining the first set of images into a first fused image, combining the second set of images into a second fused image, spatially registering the fused images, denoising the fused images using bilateral filters, normalizing the second fused image in the photometric reference space of the first fused image, combining the fused images, determining a high resolution image that when mapped through a forward imaging transformation matches the input images within at least one predetermined criterion.

On the basis of a first imaging signal corresponding to a first viewpoint and including white pixels and color component pixels and a second imaging signal corresponding to a second viewpoint different from the first viewpoint and including fewer white pixels than the first imaging signal to increase a rate of the color component pixels in the second imaging signal, a parallax detecting section detects a parallax of the second viewpoint with respect to the first viewpoint. A parallax compensating section performs parallax compensation for the imaging signal for the second viewpoint on the basis of the detected parallax to generate a parallax-compensated color difference signal for the first viewpoint. A fallback determining section and a signal selecting section selects a parallax-compensated second color difference signal or a color difference signal for the first viewpoint to obtain a high-sensitivity captured image while suppressing degradation of the image quality performance.

An imaging device includes a light separator that separates light into light bands, and imaging elements that each receives one of the light bands and generates a corresponding signal. Each of the imaging elements has a pixel size of at most 2.5 m by 2.5 m. A registration error among the imaging elements is equal to or less than a threshold determined according to the pixel size.

An image processor includes a memory, a signal processing circuit to process a visible light component including an invisible light component and an invisible light component from an image sensor, a signal setting circuit to set a first enable signal valid in a first period based on execution of signal processing, and set a second enable signal valid after the first period elapses, an offset component removal circuit to remove an offset component from the visible light component and the invisible light component in a period in which the first enable signal is valid while storing data in process in the memory, and an invisible component removal circuit to remove the invisible light component from the visible light component, to output image data of a visible light component in a period in which the second enable signal is valid while storing data in process in the memory.

An image processor includes a memory, a signal processing circuit to process a visible light component including an invisible light component and an invisible light component from an image sensor, a signal setting circuit to set a first enable signal valid in a first period based on execution of signal processing, and set a second enable signal valid after the first period elapses, an offset component removal circuit to remove an offset component from the visible light component and the invisible light component in a period in which the first enable signal is valid while storing data in process in the memory, and an invisible component removal circuit to remove the invisible light component from the visible light component, to output image data of a visible light component in a period in which the second enable signal is valid while storing data in process in the memory.

An image acquisition apparatus includes a first image sensor configured to obtain a first image based on detection of a light of a first wavelength band; a second image sensor configured to obtain a second image based on detection of a light of a second wavelength band that is wider than the first wavelength band; and a processor configured to obtain a third image having a spatial resolution corresponding to the first image and a color gamut corresponding to the second image based on the first image and the second image. The image acquisition apparatus may provide an image with a high spatial resolution and a wide color gamut.

An image acquisition apparatus includes a first image sensor configured to obtain a first image based on detection of a light of a first wavelength band; a second image sensor configured to obtain a second image based on detection of a light of a second wavelength band that is wider than the first wavelength band; and a processor configured to obtain a third image having a spatial resolution corresponding to the first image and a color gamut corresponding to the second image based on the first image and the second image. The image acquisition apparatus may provide an image with a high spatial resolution and a wide color gamut.

Systems and methods to improve safety and more efficient Advanced Driver Assistance Systems (ADAS) and autonomous vehicle (AV) systems for vehicular operation through the application of multiple thermal sensors arranged in systems where the resolution, Field Of View (FOV), and aiming angle of individual sensors are varied. In particular two configurations are discussed in detail, a three-sensor arrangement for forward and forward off angle data acquisition, and a two or three sensor arrangement for blind spot and pinch point awareness for towing applications. In some forward-looking three-sensor embodiments, the center sensor may provide a high-quality narrow field of view of radiometric data for use with tracking algorithms to identify pedestrian and large animal targets for long range driver identification. The side sensors may provide radiometric data for peripheral vision on short/medium range approaching targets for situational awareness at crosswalks and turning corners.

Systems and methods to improve safety and more efficient Advanced Driver Assistance Systems (ADAS) and autonomous vehicle (AV) systems for vehicular operation through the application of multiple thermal sensors arranged in systems where the resolution, Field Of View (FOV), and aiming angle of individual sensors are varied. In particular two configurations are discussed in detail, a three-sensor arrangement for forward and forward off angle data acquisition, and a two or three sensor arrangement for blind spot and pinch point awareness for towing applications. In some forward-looking three-sensor embodiments, the center sensor may provide a high-quality narrow field of view of radiometric data for use with tracking algorithms to identify pedestrian and large animal targets for long range driver identification. The side sensors may provide radiometric data for peripheral vision on short/medium range approaching targets for situational awareness at crosswalks and turning corners.

An image correction method includes: acquiring band images obtained by imaging a subject, and a high-resolution image having a resolution higher than that of the band images; acquiring a position difference between the object band image and the reference band image among the band images; by using a pixel of the object band image as an object pixel, for each object pixel, determining a pixel value of each sub-region obtained by dividing the imaging region of the object pixel into a plurality of regions, based on the pixel value of the object pixel and a relationship between pixel values of the pixels of the high-resolution image corresponding to the object pixel; and creating a corrected band image that holds a pixel value of light on the object band image at the pixel position of the reference band image, from the determined pixel value of each sub-region and the position difference.