Techniques are described for efficient staggered high-dynamic-range (HDR) output of an image captured using a high-pixel-count image sensor based on pixel binning followed by luminance-guided upsampling. For example, an image sensor array is configured according to a red-green-blue-luminance (RGBL) CFA pattern, such that at least 50-percent of the imaging pixels of the array are luminance (L) pixels. In each image capture time window, multiple (e.g., three) luminance-enhanced (LE) component images are generated. Each LE component image is generated by exposing the image sensor to incident illumination for a respective amount of time, using pixel binning during readout to generate appreciably downsampled color and luminance capture frames, generating an upsampled luminance guide frame from the luminance capture frame, and using the upsampled luminance guide frame to guide upsampling (e.g., and remosaicking) of the color capture frame. The resulting LE components images can be digitally combined to generate an HDR output image.

The present technology relates to a solid-state imaging device and an electronic apparatus that enable simultaneous acquisition of a signal for generating a high dynamic range image and a signal for detecting a phase difference.

The solid-state imaging device includes a plurality of pixel sets each including color filters of the same color, for a plurality of colors, each pixel set including a plurality of pixels. Each pixel includes a plurality of photodiodes PD. The present technology can be applied, for example, to a solid-state imaging device that generates a high dynamic range image and detects a phase difference, and the like.

A time-of-flight (ToF) image sensor system includes a pixel array, where each pixel of the pixel array is configured to receive a reflected modulated light signal and to demodulate the reflected modulated light signal to generate an electrical signal; a plurality of analog-to-digital converters (ADCs), where each ADC is coupled to at least one assigned pixel of the pixel array and is configured to convert a corresponding electrical signal generated by the at least one assigned pixel into an actual pixel value; and a binning circuit coupled to the plurality of ADCs and configured to generate at least one interpolated pixel, where the binning circuit is configured to generate each of the at least one interpolated pixel based on actual pixel values corresponding to a different pair of adjacent pixels of the pixel array, each of the at least one interpolated pixel having a virtual pixel value.

A time-of-flight (ToF) image sensor system includes a pixel array, where each pixel of the pixel array is configured to receive a reflected modulated light signal and to demodulate the reflected modulated light signal to generate an electrical signal; a plurality of analog-to-digital converters (ADCs), where each ADC is coupled to at least one assigned pixel of the pixel array and is configured to convert a corresponding electrical signal generated by the at least one assigned pixel into an actual pixel value; and a binning circuit coupled to the plurality of ADCs and configured to generate at least one interpolated pixel, where the binning circuit is configured to generate each of the at least one interpolated pixel based on actual pixel values corresponding to a different pair of adjacent pixels of the pixel array, each of the at least one interpolated pixel having a virtual pixel value.

A pixel array, an image sensor, and a self-checking method of the image sensor are provided. The pixel array includes a photosensitive pixel region, a first reference pixel region and/or a second reference pixel region; the photosensitive pixel region includes M rows and N columns of pixels arranged in an array; the first reference pixel region includes n columns of first reference pixels disposed corresponding to N columns of pixels of the photosensitive pixel region; the second reference pixel region includes m rows of the second reference pixels disposed corresponding to the M rows of pixels of the photosensitive pixel region. The first reference pixel region and/or the second reference pixel region can be used to implement a real-time self-checking function of the readout circuit and/or the control circuit in the image sensor, check in real time whether the image signal output by the image sensor is correct.

A pixel array, an image sensor, and a self-checking method of the image sensor are provided. The pixel array includes a photosensitive pixel region, a first reference pixel region and/or a second reference pixel region; the photosensitive pixel region includes M rows and N columns of pixels arranged in an array; the first reference pixel region includes n columns of first reference pixels disposed corresponding to N columns of pixels of the photosensitive pixel region; the second reference pixel region includes m rows of the second reference pixels disposed corresponding to the M rows of pixels of the photosensitive pixel region. The first reference pixel region and/or the second reference pixel region can be used to implement a real-time self-checking function of the readout circuit and/or the control circuit in the image sensor, check in real time whether the image signal output by the image sensor is correct.

An imaging device capable of executing image processing is provided. An imaging device with low power consumption is provided. A highly reliable imaging device is provided. An imaging device with higher integration degree of pixels is provided. An imaging device manufactured at low cost is provided. The imaging device includes a photoelectric conversion device, a first transistor that is formed in a first layer and includes silicon in a channel formation layer, and a capacitor that is formed in a second layer bonded to the first layer. One of a source and a drain of the first transistor is electrically connected to one of electrodes of the photoelectric conversion device, and the other of the source and the drain of the first transistor is electrically connected to one of electrodes of the capacitor. A pixel having a function of generating first data and a function of multiplying the first data to have a given magnification to generate second data is included. The first data and the second data each have an analog value.

A plurality of pixels are arranged two-dimensionally in a matrix and individually include a first photosensitive portion and a second photosensitive portion. A plurality of first wirings connect a plurality of first photosensitive portions to each other for every row. A plurality of second wirings connect a plurality of second photosensitive portions to each other for every column. A first reading unit 21 is arranged to read signal data through at least some of the plurality of first wirings. A second reading unit 31 is arranged to read signal data through at least some of the plurality of second wirings. The first reading unit 21 has a reading pixel setting unit 26 arranged to set, based on signal data read in the first frame, a pixel group for reading signal data in a second frame subsequent to a first frame from the plurality of pixels.

An imaging apparatus according to the present technology includes a mode control unit. The mode control unit shifts, when a motion is detected on a motion detection mode to detect the motion on the basis of image information, the mode to a feature detection mode to detect features on the basis of image information having a higher resolution than a resolution of the image information that is used for the motion detection, and shifts, when a specific feature is detected on the feature detection mode, the mode to an imaging mode to acquire image information having a higher resolution than the resolution of the image information that is used for the feature detection.

An image sensor includes a Bayer pattern-type pixel array including a plurality of Bayer pattern-type extended blocks each having first to fourth pixel blocks, each of the first to fourth pixel blocks including first to fourth pixels, the first and fourth pixels of the first and fourth pixel blocks being configured to sense green light, the first and fourth pixels of the second and third pixel blocks being configured to sense red light and blue light, respectively, and the second and third pixels of the first to fourth pixel blocks being configured to sense white light, and a signal processing unit merging Bayer pattern color information generated from the first and fourth pixels of the first to fourth pixel blocks, and the Bayer pattern illuminance information generated from the second and third pixels of the first to fourth pixel blocks.