A method of creating a multispectral decorrelation model for use in determining a visible image from a multispectral image captured using a multispectral image sensor, the method comprising the steps of: generating, using a plurality of quantum efficiency curves for the multispectral image sensor and a plurality of synthetic light spectrum vectors, a grid of synthetic multispectral pixel values and a corresponding grid of synthetic visible pixel values, wherein each synthetic visible pixel value is substantially decorrelated from a non-visible component of a corresponding synthetic multispectral pixel value; and determining a multispectral decorrelation model using the grid of synthetic multispectral pixel values and the corresponding grid of synthetic visible pixel values, wherein the multispectral decorrelation model in use maps a multispectral pixel value of the multispectral image to a visible pixel value of the visible image.

An image processing method and an image processing device is provided. The processing device comprises memory and a processor configured to receive a frame of color filtered image data comprising pixels which are spatially multiplexed according to a plurality of different light exposures, resample the color values as different frames of pixels for the plurality of different light exposures, fuse the resampled frames of pixels for the plurality of different light exposures into a frame of pixels according to a HDR format and color interpolate the fused frame of pixels. The processor is configured to interpolate, for each resampled frame, missing pixel color values based on the color values of adjacent resampled pixels in a same resampled frame. The color interpolated fused frame of pixels is processed in an image processing pipeline and converted to a YUV color space.

A processor-implemented method with image reconstruction includes: acquiring information indicating an amount of ambient light in accordance with a shutter exposure time of a camera; generating an ambient light pattern based on the information about the amount of ambient light; generating a compensation pattern which compensates for a invertibility of an external illumination pattern based on the ambient light pattern; controlling an operation of an external illumination based on the compensation pattern to acquire a photographed image by a camera; and reconstructing a latent image of the photographed image in the acquired photographed image based on the compensation pattern.

Disclosed are a solid-state imaging apparatus, a signal processing method of a solid-state imaging apparatus, and an electronic device, which are capable of correcting uneven sensitivities generated by multiple factors in a broad area and realizing the higher-precision image quality. A correction circuit 710 weight a sensitivity Pi corresponding to a pixel signal of each pixel related to correction in a pixel unit PU that is the correction target and a sensitivity Pi corresponding to a pixel signal of each pixel related to correction in at least one same color pixel unit PU and adjacent to the pixel unit PU that is the correction target by a weighting coefficient Wi. Consequently, the correction coefficient μ is calculated by dividing a sum of the weighted sensitivities by a total number n of pixels related to correction.

Image data obtained by imaging of an imaging element capable of imaging a subject with sensitivity to a wavelength band of visible light and a wavelength band of near-infrared light via an optical system is acquired. A point image restoration process using a common restoration filter is performed on the image data of the subject captured with sensitivity to the wavelength band of the visible light by the imaging element and the image data of the subject captured with sensitivity to the wavelength band of the near-infrared light by the imaging element. The common restoration filter is calculated on the basis of average optical characteristics of the optical system obtained by performing weighted averaging of first optical characteristics with respect to the visible light of the optical system and second optical characteristics with respect to the near-infrared light of the optical system.

Pulsed fluorescence imaging in a light deficient environment is disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a controller configured to synchronize timing of the emitter and the image sensor. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.

The present disclosure relates to an imaging apparatus, an imaging method, and a program that enable exposure control on a captured image in a non-Bayer pattern by an exposure control method designed for captured images in Bayer patterns.

When a Bayering process is performed on a captured image in an RGBW pixel array, a level correction unit corrects the signal level of the captured image so that an earlier level that is the signal level of each white pixel with the highest sensitivity in the captured image prior to the Bayering process becomes equal to a later level that is the signal level of each green pixel to be used in exposure control on an image in a Bayer pattern that is the RGB image after the Bayering process. The present disclosure can be applied to imaging apparatuses, for example.

A dual sensor imaging system and a privacy protection imaging method thereof are provided. The system is configured to control at least one color sensor and at least one IR sensor to respectively capture multiple color images and multiple IR images by adopting multiple exposure conditions adapted for an imaging scene, adaptively select a combination of the color image and the IR image that can reveal details of the imaging scene, detect a feature area with features of a target of interest in the color image, and fuse the color image and the IR image to generate a fusion image with the details of the imaging scene, and crop an image of the feature area of the fusion image to be replaced with an image not belonging to the IR image, so as to generate a scene image.

The invention discloses a visualization system with a real-time imaging function, comprising: a receiving end, a light source, an imaging system, and a display device. The light source comprises a red light source and a fluorescence excitation light source; the imaging system comprises a red light image sensor and a fluorescence image sensor to process a signal to output a real-time visualization signal to the display device. Through the technical scheme, the visualization system can provide sufficient background information and obtain a clear and complete real-time image for a surgeon only by using a specific band of red light to illuminate a surgical scene, the visualization system is simple in whole structure, is convenient in a control method, is simple and highly effective in the imaging process procedure, has a good use experience while the manufacturing and maintenance costs are low, and has a very high applicability and popularization.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.