The image processing apparatus includes a white balance adjustment circuit configured to adjust a color temperature to RAW data of an image obtained by capturing, a generator circuit configured to generate data of planes for each component of the image from data of which color temperature was adjusted, and a RAW encoding circuit configured to conduct compression encoding of the data of the planes.

In a minimally invasive surgical system, an image capture unit includes a prism assembly and sensor assembly. The prism assembly includes a beam splitter, while the sensor assembly includes coplanar image capture sensors. Each of the coplanar image capture sensors has a common front end optical structure, e.g., the optical structure distal to the image capture unit is the same for each of the sensors. A controller enhances images acquired by the coplanar image capture sensors. The enhanced images may include (a) visible images with enhanced feature definition, in which a particular feature in the scene is emphasized to the operator of minimally invasive surgical system; (b) images having increased image apparent resolution; (c) images having increased dynamic range; (d) images displayed in a way based on a pixel color component vector having three or more color components; and (e) images having extended depth of field.

There is provided an imaging apparatus including a first polarizing unit that polarizes light from an object, a lens system that condenses light from the first polarizing unit, and an imaging element array that has imaging elements arranged in a matrix of a first direction and a second direction orthogonal to the first direction, has a second polarizing unit arranged on a light incident side, and converts the light condensed by the lens system into an electric signal.

Provided are a pixel interpolation apparatus, imaging apparatus, program, and integrated circuit that appropriately perform pixel interpolation on an image signal obtained by a single-chip image sensor with a four-color array filter whatever array pattern the four-color array filter has. An imaging apparatus includes an imaging circuitry, a signal processing circuitry, and a pixel interpolation processing circuitry. The apparatus calculates a degree of correlation for pairs in two orthogonal directions for an image signal obtained by the imaging circuitry including a single-chip image sensor having a four-color array filter using pixel data in an area around a target pixel, and performs pixel interpolation using the correlation degree as a determination criterion. When a color component pixel with a color identical to a color of a color component pixel subjected to pixel interpolation is not located in the direction having the high correlation, the pixel interpolation apparatus obtains a change ratio in a direction orthogonal to the direction having the high correlation by using a pixel value resulting from color space conversion in the direction orthogonal to the direction having the high correlation, and performs pixel interpolation processing based on the change ratio.

To facilitate design and development of an apparatus that processes images.

An image processing apparatus includes a separation unit, a Bayer image signal supply unit, and a signal processing unit. The separation unit separates and removes, in input image signals in which pixel signals each including an invisible light component are arranged in an array different from a Bayer array, the invisible light components from the pixel signals. The Bayer image signal supply unit arranges the pixel signals from which the invisible light components have been removed in the Bayer array and supplies the pixel signals as Bayer image signals. The signal processing unit subjects the Bayer image signals to predetermined signal processing.

Visibility of a license plate and color reproducibility of a vehicle body are improved in a monitoring camera. A vehicle body area detection unit detects a vehicle body area of a vehicle from an image signal. A license plate area detection unit detects a license plate area of the vehicle from the image signal. A vehicle body area image processing unit performs processing of the image signal corresponding to the detected vehicle body area. A license plate area image processing unit performs processing different from the processing of the image signal corresponding to the vehicle body area on the image signal corresponding to the detected license plate area. A synthesis unit synthesizes the processed image signal corresponding to the vehicle body area and the processed image signal corresponding to the license plate area.

An image sensor may have a pixel array that includes an array of pixels arranged in rows and columns. Each pixel may include a number of adjacent sub-pixels covered by a single microlens. The adjacent sub-pixels of each pixel may include color filter elements of the same color. Image signals from the sub-pixels may be used to calculate phase information in each pixel in the array. This information may be used to generate a depth map of the entire captured image. The pixels may each be able to detect vertical, horizontal, or diagonal edges. Additionally, the image signals from each photodiode in a pixel may be binned or average to obtain image data for each pixel. The image sensor also may generate high-dynamic-range images using the pixel array.

An image sensor includes first and second pixels to generate a first electric signal from white illumination light and second electric signals from narrow band illumination light, respectively. Density of the first pixels is higher than density of each color components of the second pixels. An image processing apparatus is configured to: interpolate the first electric signal based on the first pixels surrounding the second pixels to generate an interpolated electric signal; calculate a difference between the interpolated electric signal and the second electric signals to generate a color difference signal; discriminate an interpolation direction based on the color difference signal to interpolate a missing color difference signal at each pixel position, thereby generating an interpolated color difference signal; and generate the second electric signals to be generated by the second pixels, based on the interpolated color difference signal and the interpolated electric signal.

The invention relates to an image acquisition device comprising a sensor composed of an array of photosensitive pixels, and an array of elementary filters covering the sensor. Pixels may be of three different types: panchromatic pixels, primary colour pixels and infrared pixels. Under low illumination conditions, the device displays a monochrome image using panchromatic pixels, and under high illumination conditions, a colour image with a high signal to noise ratio, by combining primary colour images and subtracting the infrared image.

An image processing method by an image processing apparatus, including: acquiring a first image which is a first area of a subject displayed with first resolving power; acquiring a second image which is a second area smaller than the first area of the subject, displayed with second resolving power higher than the first resolving power; and generating a third image by compositing the first image and the second image with the first resolving power and the second resolving power remaining.