Object detection is performed for an image acquired by imaging using an array sensor in which a plurality of imaging elements are arranged one-dimensionally or two-dimensionally, some of the imaging elements are configured as color-filter-disposed pixels in which a color filter is disposed in an incident optical path, and color information acquisition points are formed by the color-filter-disposed pixels. Then, coloring processing in a pixel range of a detected object is performed by referring to color information acquired at the color information acquisition points corresponding to the inside of the pixel range of the detected object.

A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

A solid-state imaging device includes a color filter unit disposed on a pixel array unit including pixels two-dimensionally arranged in a matrix and a conversion processing unit disposed on a substrate having the pixel array unit thereon. The color filter unit has a color arrangement in which a color serving as a primary component of a luminance signal is arranged in a checkerboard pattern and a plurality of colors serving as color information components are arranged in the other area of the checkerboard pattern. The conversion processing unit converts signals that are output from the pixels of the pixel array unit and that correspond to the color arrangement of the color filter unit into signals that correspond to a Bayer arrangement and outputs the converted signals.

A solid state imaging device includes: a pixel array unit that has a plurality of pixels 2-dimensionally arranged in a matrix and a plurality of signal lines arranged along a column direction; A/D conversion units that are provided corresponding to the respective signal lines and convert an analog signal output from a pixel through the signal line into a digital signal; and a switching unit that switches or converts the analog signal output through each signal line into a digital signal using any of an A/D conversion unit provided corresponding to the signal line through which the analog signal is transmitted, and an A/D conversion unit provided corresponding to a signal line other than the signal line through which the analog signal is transmitted.

The present disclosure discloses an image sensor, an imaging device, a mobile terminal and an imaging method. The image sensor comprises a photosensitive pixel array and a filer arranged on the photosensitive pixel array. The filter comprises a filer unit array comprised a plurality of filter units, wherein each filter unit covers N photosensitive pixels, and some of the filter units comprise white filter areas. The white filter areas cover at least one of the N photosensitive pixels of the N photosensitive pixels, wherein a merged pixel is formed by the N photosensitive pixels covered by the same filter unit, wherein N is a positive integer.

Provided are an image composition apparatus for composing color images with black-and-white images including infrared components, and an image composition method thereof The image composition method includes generating a first image signal with color information and a second image signal including infrared components without color information, dividing the first image signal into a brightness signal and a color signal, composing the brightness signal of the first image signal with a brightness signal of the second image signal to generate a composed brightness signal, and composing the composed brightness signal with the color signal of the first image signal to generate a color image.

An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.

Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

A light detecting device is provided with: a filter array including filters arranged two-dimensionally, each of the filters having a light-incident surface and a light-emitting surface, the filters including multiple types of filters having mutually different transmission spectra; and an image sensor having a light-detecting surface facing the light-emitting surface, the image sensor being provided with light-detecting elements arranged two-dimensionally on the light-detecting surface, wherein the distance between the light-emitting surface and the light-detecting surface is different for each of the filters.

This application provides an image sensor (702) and image light sensing method. The image sensor (702) includes a red pixel (R), a green pixel (G), a blue pixel (B), and an invisible light pixel, where the red pixel (R), the green pixel (G), and the blue pixel (B) are large pixels, the invisible light pixel is a small pixel, and a light sensing area of the large pixel is greater than that of the small pixel. The red pixel (R), the green pixel (G), and the blue pixel (B) are arranged in a Bayer format. In this application, when color information is sufficient, light crosstalk caused by the small pixel to the large pixel can be reduced, and therefore a signal-to-noise ratio of the large pixel can be improved.