An image processing device includes a memory, and a processor configured to execute obtaining image data from an imaging device in which pixel groups of multiple colors are repeatedly arranged, each of the pixel groups including multiple pixels; and determining a direction in which change in a pixel value is small at a position of a target pixel group, based on a changed amount of the pixel values of at least one of pairs of pixels that are arranged around the target pixel group, and included in multiple other pixel groups having colors that are different from a color of the target pixel group.

An image sensor may include a pixel array a pixel array including an active pixel and an optical black pixel, the active pixel configured to generate a first pixel signal, and the optical black pixel configured to generate a second pixel signal, a first biasing circuit configured to bias the first pixel signal based on a first bias voltage, a first analog-to-digital converter configured to convert the biased first pixel signal into a first digital signal, a second biasing circuit configured to bias the second pixel signal based on a second bias voltage, and a second analog-to-digital converter configured to convert the biased second pixel signal into a second digital signal, the second digital signal configured to generate smaller random noise than the first analog-to-digital converter.

One embodiment provides a method comprising receiving an input content, and receiving ambient contextual data indicative of one or more ambient lighting conditions of an environment including a display device. The input content has corresponding metadata that at least partially represents a creative intent indicative of how the input content is intended to be viewed. The method further comprises adaptively correcting the input content based on the ambient contextual data to preserve the creative intent, and providing the corrected input content to the display device for presentation. The adaptively correcting comprises applying automatic white balancing to the input content to correct color tone of the input content.

A method includes capturing, by a camera disposed behind a display panel of an electronic device, an original image through a semi-transparent pixel region of the display panel. The original image includes one or more color components. The method further includes determining, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components. The method further includes performing, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs. The method thus includes generating a reconstructed image corresponding to the original image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image.

A solid-state imaging device includes a color filter unit disposed on a pixel array unit including pixels two-dimensionally arranged in a matrix and a conversion processing unit disposed on a substrate having the pixel array unit thereon. The color filter unit has a color arrangement in which a color serving as a primary component of a luminance signal is arranged in a checkerboard pattern and a plurality of colors serving as color information components are arranged in the other area of the checkerboard pattern. The conversion processing unit converts signals that are output from the pixels of the pixel array unit and that correspond to the color arrangement of the color filter unit into signals that correspond to a Bayer arrangement and outputs the converted signals.

A biological observation system includes: a light source apparatus configured to supply a first illuminating light, and a second illuminating light, while switching between the first illuminating light and the second illuminating light; an image pickup device configured to receive light from an object at each of a plurality of pixels having different sensitivities, and picks up an image; a color separation processing portion configured to separate, from respective color components, a color component obtained when an image of light of a predetermined wavelength band is picked up by a pixel having the greatest sensitivity to the light in the predetermined wavelength band; and a control portion configured to cause different processing to be performed between a case where an inputted image pickup signal corresponds to the first illuminating light and a case where an inputted image pickup signal corresponds to the second illuminating light.

A biological observation system includes: a light source apparatus configured to supply a first illuminating light, and a second illuminating light, while switching between the first illuminating light and the second illuminating light; an image pickup device configured to receive light from an object at each of a plurality of pixels having different sensitivities, and picks up an image; a color separation processing portion configured to separate, from respective color components, a color component obtained when an image of light of a predetermined wavelength band is picked up by a pixel having the greatest sensitivity to the light in the predetermined wavelength band; and a control portion configured to cause different processing to be performed between a case where an inputted image pickup signal corresponds to the first illuminating light and a case where an inputted image pickup signal corresponds to the second illuminating light.

Embodiments relate to an architecture of a vision pipe included in an image signal processor. The architecture includes a front-end portion that includes a pair of image signal pipelines that generate an updated luminance image data. A back-end portion of the vision pipe architecture receives the updated luminance images from the front-end portion and performs, in parallel, scaling and various computer vision operations on the updated luminance image data. The back-end portion may repeatedly perform this parallel operation of computer vision operations on successively scaled luminance images to generate a pyramid image.

A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.

The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments with luminance and chrominance emitted from a controlled light source.