A transitory storage unit transitorily stores pixel data output from an imaging unit. A development processing unit outputs video data obtained by performing development processing including demosaicing processing on the pixel data stored in the transitory storage unit. An output control unit switches between a first recording mode in which only the video data out of the video data and the pixel data is used as recording data and a second recording mode in which the video data and the pixel data are used as the recording data. In addition, the output control unit controls the imaging unit to perform imaging with different exposure values between the first recording mode and the second recording mode.

An image sensor includes a pixel array including a plurality of unit pixels arranged along a plurality of rows and a plurality of columns. Each of the unit pixels includes a photoelectric conversion element generating and accumulating photocharges, a charge detection node receiving the photocharges accumulated in the photoelectric conversion element, a readout circuit converting the photocharges accumulated in and output from the charge detection node into an electrical pixel signal, the readout circuit outputting the electrical pixel signal, a capacitive element, and a switching element controlling connection between the charge detection node and the capacitive element. Each of the rows of the pixel array includes first pixels connected to a first conversion gain control line and second pixels connected to a second conversion gain control line.

A system and method for displaying image data comprise receiving 2D video data, generating, from the video data, a first plurality of intensity values of virtual primaries of a first virtual color gamut and a second plurality intensity values of a second virtual color gamut, the first plurality of intensity values being below a luminance threshold and approximating a predefined color gamut and the second plurality of intensity values being above the luminance threshold, converting the first plurality of intensity values into a third plurality of intensity values of predefined primaries of a first projection head of a display system and the second plurality of intensity values into a fourth plurality of intensity values of predefined primaries of a second projection head of the display system, and dynamically adjusting pixel levels of spatial modulators of the display system based on the third plurality and the fourth plurality of intensity values.

The present invention provides a technique of reducing colored afterimages. To solve this problem, an image capturing system includes the following structure: A color separation optical system disperses subject light into a plurality of wavelength ranges, and forms images of a plurality of color components. A plurality of image capturing elements capture the respective images of the plurality of color components, and generate the respective color components of a video signal. A color-specific exposure setting unit sets respective exposure periods for the plurality of color components. An exposure control unit performs exposure control α of approximately simultaneously exposure-controlling each of the plurality of image capturing elements to obtain a video signal (hereafter referred to as a reference video signal) in a common period shorter than or equal to a shortest period of the respective exposure periods set for the color components. The exposure control unit also performs exposure control β of exposure-controlling each of the plurality of image capturing elements to obtain a video signal (hereafter referred to as an extended video signal) in a period obtained by subtracting the common period from an exposure period of a corresponding color component.

The present invention provides a technique of reducing colored afterimages. To solve this problem, an image capturing system includes the following structure: A color separation optical system disperses subject light into a plurality of wavelength ranges, and forms images of a plurality of color components. A plurality of image capturing elements capture the respective images of the plurality of color components, and generate the respective color components of a video signal. A color-specific exposure setting unit sets respective exposure periods for the plurality of color components. An exposure control unit performs exposure control α of approximately simultaneously exposure-controlling each of the plurality of image capturing elements to obtain a video signal (hereafter referred to as a reference video signal) in a common period shorter than or equal to a shortest period of the respective exposure periods set for the color components. The exposure control unit also performs exposure control β of exposure-controlling each of the plurality of image capturing elements to obtain a video signal (hereafter referred to as an extended video signal) in a period obtained by subtracting the common period from an exposure period of a corresponding color component.

The method comprises a step of processing pixel values provided at the output of an image sensor comprising a two-dimensional array of pixels including a mix of IR pixels and color pixels. The step of processing includes, for each color pixel, determining a local color-related ratio indicative of a part of infrared light reception in the color pixel, and estimating an infrared portion value from a color pixel value based on the local color-related ratio. The method further includes generating an infrared image from pixel values from the IR pixels and the estimated infrared portion values from the color pixels.

An image capturing device includes an image capturing unit capturing an image at a timing based on a first frame rate and outputs data corresponding to the image after a first period, an image data generation unit generating image data based on the output data and outputting the image data after a second period, a display unit displaying a display image based on the image data after the second period and at a timing based on a second frame rate, and a mode selecting unit selecting a first or second mode. The first mode prioritizes reduction in a display delay time. The second mode prioritizes image quality of the display image over reduction in the display delay time. A total period of the first and second periods is less than or equal to a first vertical synchronization period based on the first frame rate when the first mode is selected.

An image pickup system includes an image pickup device including an image pickup section, a first amplifier circuit capable of amplifying a video signal for each field, and a communication circuit configured to acquire a set gain of the first amplifier circuit, a second amplifier circuit configured to amplify the video signal outputted from the image pickup device, and a processor. According to a result of a detection indicating that the video signal is not amplified by the set gain in the first amplifier circuit, a correction gain to be set in the second amplifier circuit is calculated.

The present application provides cameras and snapped image fusing methods. The camera includes: a lens, a light splitter, a first image sensor, a second image sensor, and a master processing chip. The light splitter is configured to split incident light, which enters the camera through the lens, into visible light and infrared light. The first image sensor is configured to receive the visible light, and obtain a visible light video image by performing video image capture according to a first shutter and a first gain. The second image sensor is configured to receive the infrared light, and obtain an infrared light video image by performing video image capture according to the first shutter and the first gain. The master processing chip is configured to output a fused video image by fusing the visible light video image and the infrared light video image.

Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.