An in-vehicle camera is provide which has a case and a lens, and which is attached in a vehicle interior so that the lens is exposed at a top face of the case and the top face is opposed to a windshield or another window. The top face has an angular shape bent at a ridge line passing through the top face. The lens is positioned in the vicinity of the ridge line. The in-vehicle camera includes a hood attached to a front portion of the case, the front portion being positioned at a front side of the case with respect to the lens.

A lens unit (120) shows longitudinal chromatic aberration and focuses an imaged scene into a first image for the infrared range in a first focal plane and into a second image for the visible range in a second focal plane. An optical element (150) manipulates the modulation transfer function assigned to the first and second images to extend the depth of field. An image processing unit (200) may amplify a modulation transfer function contrast in the first and second images. A focal shift between the focal planes may be compensated for. While in conventional approaches for RGBIR sensors contemporaneously providing both a conventional and an infrared image of the same scene the infrared image is severely out of focus, the present approach provides extended depth of field imaging to rectify the problem of out-of-focus blur for infrared radiation. An imaging system can be realized without any apochromatic lens.

The invention provides an image encoding apparatus operable to encode data obtained by an image capturing sensor in which a filter for detecting a fourth color is periodically arranged in addition to filters of three primary colors, where the apparatus comprises a generating unit configured to generate data that approximates the fourth color using data of at least two colors among three colors, which represent three primary colors, obtained by the image capturing sensor and generate difference data that represents a difference between the generated data and data of the fourth color; and an encoding unit configured to encode data of the three colors which represent three primary colors and the difference data.

A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.

The disclosure relates to a filter array and to a method for processing image data in a camera. The camera is configured to receive light and generate image data using an image sensor having an associated filter array. The image sensor includes an array of pixels, each of which corresponds to a filter element in the filter array, so that each pixel has a spectral response at least partly defined by a corresponding filter element. The filter array includes a pattern of wideband filter elements and at least two types of narrowband filter elements. The method includes the step of generating a luminance image comprising a wideband filter element value that is calculated for each pixel of the image sensor.

An image processing device receives a multi-spectral image and a panchromatic image of a scene. The device extracts a luminosity subcomponent image from the multi-spectral image and upsamples it to generate a luminosity image of a scale intended for a super-resolved image. For each pixel of the luminosity image, the device performs a series of pixel processing and replacement steps, including extracting a first image patch surrounding the pixel and matching it with a plurality of extracted panchromatic image patches, which are smaller than the first image patch by a ratio of a size of the panchromatic image to a size of the luminosity image. The image processing and replacement of the pixels may be iteratively performed to produce a super-resolved image.

Various embodiments include methods and apparatuses for forming and using pixels for image sensors. In one embodiment, an image sensor having at least two pixel electrodes per color region, and having at least two modes is disclosed. The example image sensor includes a first, unbinned, mode; and a second, binned, mode. In the first, unbinned mode, the at least two pixel electrodes per color region are to be reset to substantially similar levels. In the second, binned mode, a first pixel electrode of the at the least two pixel electrodes is to be reset to a high voltage that results in efficient collection of photocharge, and a second pixel electrode of the at the least two pixel electrodes is to be reset to a low voltage that results in less efficient collection of photocharge. Other methods and apparatuses are disclosed.

A color filter array for an image sensing device is disclosed. The color filter array includes a plurality of pixels and a control unit. The plurality of pixels is utilized for generating a plurality of pixel data of an image. The control unit is utilized for controlling the plurality of pixels. In addition, each of the plurality of pixels is divided into a plurality of sub-pixels corresponding to the same color. When outputting the plurality of pixel data, each of the plurality of pixels accumulates pixel value of at least one of the plurality of sub-pixels in each of the plurality of pixels as the pixel data outputted by each of the plurality of pixels.

To facilitate design and development of an apparatus that processes images.

An image processing apparatus includes a separation unit, a Bayer image signal supply unit, and a signal processing unit. The separation unit separates and removes, in input image signals in which pixel signals each including an invisible light component are arranged in an array different from a Bayer array, the invisible light components from the pixel signals. The Bayer image signal supply unit arranges the pixel signals from which the invisible light components have been removed in the Bayer array and supplies the pixel signals as Bayer image signals. The signal processing unit subjects the Bayer image signals to predetermined signal processing.

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.