An image fusing method includes converting a first image into a first intermediate image, converting a second image into a second intermediate image including a plurality of components, fusing one of the plurality of components of the second intermediate image with the first intermediate image to obtain a fused component, and combining the fused component and other ones of the plurality of components of the second intermediate image to obtain a target image.

The technology described in this document can be embodied in a method that includes receiving during a first time period, information from a first sensor representing a target illuminated by a first illumination source radiating in a first wavelength range, and information from a second sensor representing the target illuminated by a second illumination source radiating in a second wavelength range. The method also includes receiving during a second time period, information from the first sensor representing the target illuminated by the second illumination source radiating in the first wavelength range, and information from the second sensor representing reflected light received from the target illuminated by the first illumination source radiating in the second wavelength range. The method also includes generating a representation of the image in which effects due to the first and second illumination sources are enhanced over effects due to ambient light sources.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

The technology described in this document can be embodied in a method that includes receiving during a first time period, information from a first sensor representing a target illuminated by a first illumination source radiating in a first wavelength range, and information from a second sensor representing the target illuminated by a second illumination source radiating in a second wavelength range. The method also includes receiving during a second time period, information from the first sensor representing the target illuminated by the second illumination source radiating in the first wavelength range, and information from the second sensor representing reflected light received from the target illuminated by the first illumination source radiating in the second wavelength range. The method also includes generating a representation of the image in which effects due to the first and second illumination sources are enhanced over effects due to ambient light sources.

Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Embodiments described herein can address these and other issues by providing a CV image sensor that has a repeating pattern of two pairs of color-opponent color sensors and a luminance sensor to provide a high amount of functionality while maintaining relatively low power requirements. By using color opponency, embodiments can sidestep the need for processor-intensive color conversions required of other color sensors. Embodiments may optionally provide for surface area optimization, hyperspectral sensitivity, low-light optimization, neuromorphic light sensing, and more.

A processing circuitry is configured to generate a first analysis result based on a size of a partial area of a target area when the partial area is captured by only one of a first sensor or a second sensor, based on first image data for the target area captured by the first sensor and second image data for the target area captured by the second sensor, and generate first final image data or second final image data by using the first image data and the second image data, based on the first analysis result. A difference between the first final image data and the second final image data is based on a difference between a first characteristic of the first sensor and a second characteristic of the second sensor.

An imaging system comprising of a set of cameras, the cameras having a configured relative camera arrangement; and each camera of the set of cameras comprising at least one corrective optical system. The system and method may comprise of multi-camera variations for coordinated alignment in multi-camera variations and/or split-field optical systems.

The electronic apparatus includes: a plurality of image sensors including a first image sensor and a second image sensor; and a processor electrically connected to the plurality of image sensors and configured to output a read control signal and a synchronization signal to the plurality of image sensors, wherein the processor is further configured to: output a first read control signal to the first image sensor and receive first data read from the first image sensor; output a second read control signal to the second image sensor and store second data read from the second image sensor in a temporary memory; and output the second data stored in the temporary memory based on an output control signal generated between the first read control signal and a next first read control signal and generate merged data in which the first data and the second data are merged.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.