Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

This disclosure discloses image sensors, signal processing methods, and related devices for image processing. An example image sensor comprises an optical filter array. The optical filter array is a hyper spectral or multispectral optical filter array and comprises m optical filters and an optical-to-electrical conversion module. The optical-to-electrical conversion module comprises an optical-to-electrical conversion unit and a combining unit. The m optical filters are configured to obtain optical signals of a target object in at least two different spectral bands. The optical-to-electrical conversion unit is configured to convert the optical signals obtained by the m optical filters into electrical signals. The combining unit is configured to combine the electrical signals corresponding to the m optical filters to obtain a combined electrical signal. The optical-to-electrical conversion module is configured to output the combined electrical signal, which is used to generate an image of the target object.

Visibility of a license plate and color reproducibility of a vehicle body are improved in a monitoring camera.

A vehicle body area detection unit detects a vehicle body area of a vehicle from an image signal. A license plate area detection unit detects a license plate area of the vehicle from the image signal. A vehicle body area image processing unit performs processing of the image signal corresponding to the detected vehicle body area. A license plate area image processing unit performs processing different from the processing of the image signal corresponding to the vehicle body area on the image signal corresponding to the detected license plate area. A synthesis unit synthesizes the processed image signal corresponding to the vehicle body area and the processed image signal corresponding to the license plate area.

An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.

Described herein are embodiments of a deep residual network dedicated to color filter array mosaic patterns. A mosaic stride convolution layer is introduced to match the mosaic pattern of a multispectral filter arrays (MSFA) or a color filter array raw image. Embodiments of a data augmentation using MSFA shifting and dynamic noise are applied to make the model robust to different noise levels. Embodiments of network optimization criteria may be created by using the noise standard deviation to normalize the L.sup.1 loss function. Comprehensive experiments demonstrate that embodiments of the disclosed deep residual network outperform the state-of-the-art denoising algorithms in MSFA field.

A sensor module including at least one brightness sensor element for detecting a brightness of a wideband electromagnetic radiation and at least one color sensor field, which includes at least one color sensor element for detecting a color of the electromagnetic radiation. The brightness sensor element has a larger sensor surface than the color sensor field.

A stereoscopic image capture device includes a first image sensor, a second image sensor, a first frame timer, and a second frame timer. The first and second frame timers are different frame timers. The first image sensor includes a first plurality of rows of pixels. The second image sensor includes a second plurality of rows of pixels. The first and second image sensors can be separate devices or different areas of a sensor region in an integrated circuit. The first frame timer is coupled to the first image sensor to provide image capture timing signals to the first image sensor. The second frame timer coupled to the second image sensor to provide image capture timing signals to the second image sensor.

A monolithic sensor for detecting infrared and visible light according to an example includes a semiconductor substrate and a semiconductor layer coupled to the semiconductor substrate. The semiconductor layer includes a device surface opposite the semiconductor substrate. A visible light photodiode is formed at the device surface. An infrared photodiode is also formed at the device surface and in proximity to the visible light photodiode. A textured region is coupled to the infrared photodiode and positioned to interact with electromagnetic radiation.

A monolithic sensor for detecting infrared and visible light according to an example includes a semiconductor substrate and a semiconductor layer coupled to the semiconductor substrate. The semiconductor layer includes a device surface opposite the semiconductor substrate. A visible light photodiode is formed at the device surface. An infrared photodiode is also formed at the device surface and in proximity to the visible light photodiode. A textured region is coupled to the infrared photodiode and positioned to interact with electromagnetic radiation.

[Object] To make it possible to improve reading efficiency of pixel signals in a signal processing device in which rows of pixels having different pixel arrays are arranged at intervals of one line.

[Solution] Provided is a signal processing device, including: a pixel array unit configured to include first pixels, second pixels, third pixels, and fourth pixels which have different spectral sensitivity characteristics and are arranged in a matrix form; and a pixel signal reading unit configured to read pixel signals obtained from the plurality of pixels arranged in the pixel array unit. The first pixels are adjacent to the second pixels in a row direction and a column direction, the second pixels are arranged at a two-pixel pitch in the row direction and the column direction, the third pixels are adjacent to the second pixels in one diagonal direction, the fourth pixels are adjacent to the second pixels in the other diagonal direction, and the pixel signal reading unit adds and reads the pixel signals obtained from the plurality of first pixels.