A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.

An imaging device includes pixels each including a photoelectric converter that generates charges by photoelectric conversion, a first transfer transistor that transfers charges of the photoelectric converter to a first holding portion, a second transfer transistor that transfers charges of the first holding portion to a second holding portion, and an amplifier unit that outputs a signal based on charges held by the second holding portion. The first transfer transistor is configured to form a potential well for the charges between the photoelectric converter and the first holding portion when the first transistor is in an on-state. The maximum charge amount Q.sub.PD generated by the photoelectric converter during one exposure period, a saturation charge amount Q.sub.MEM_SAT of the first holding portion, and the maximum charge amount Q.sub.GS that can be held in the potential well are in a relationship of: Q.sub.PD<Q.sub.GSQ.sub.MEM_SAT.

Provided is an information processing apparatus capable of further enhancing an effect of reducing blurring or noise in an image at the time of MFNR.

An information processing apparatus including a control unit that selects a reference image from a plurality of images continuously captured by an image capturing apparatus, on the basis of information of the image capturing apparatus acquired by an inertial sensor when each of the images is captured, and superimposes remaining images on the reference image while performing alignment with the reference image, to combine the images into one image.

A camera assembly for generating high dynamic range images. The camera assembly includes a sensor that images a portion of a local area, and a controller. The sensor includes a plurality of augmented pixels, each augmented pixel having a plurality of gates and at least some of the gates have a respective local storage location. An exposure interval of each augmented pixel is divided into intervals associated with the gates, and each local storage location stores image data during a respective interval. The controller reads out, after the exposure interval of each augmented pixel, the image data stored in the respective local storage locations of each augmented pixel to form intermediate images that each have a dynamic range. The controller then generates an image for the portion of the local area using the intermediate images, the image having a higher dynamic range than each of the intermediate images.

A camera assembly for determining depth information for a local area includes a light source assembly, a camera assembly, and a controller. The light source assembly projects pulses of light into the local area. The camera assembly images a portion of the local area illuminated with the pulses. The camera assembly includes augmented pixels, each augmented pixel having a plurality of gates and at least some of the gates have a respective local storage location. An exposure interval of each augmented pixel is divided into intervals associated with the gates, and each local storage location stores image data during a respective interval. The controller reads out, after the exposure interval of each augmented pixel, the image data stored in the respective local storage locations of each augmented pixel to generate image data frames. The controller determines depth information for the local area based in part on the image data frames.

Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.

A method for multi-frame blending includes obtaining at least two image frames of a scene. One of the image frames is associated with a shorter exposure time and a higher sensitivity and representing a reference image frame. At least one other of the image frames is associated with a longer exposure time and a lower sensitivity and representing at least one non-reference image frame. The method also includes blending the reference and non-reference image frames into a blended image such that (i) one or more motion regions of the blended image are based more on the reference image frame and (ii) one or more stationary regions of the blended image are based more on the at least one non-reference image frame.

When imaging bright objects, a conventional detector array can saturate, making it difficult to produce an image with a dynamic range that equals the scene's dynamic range. Conversely, a digital focal plane array (DFPA) with one or more m-bit counters can produce an image whose dynamic range is greater than the native dynamic range. In one example, the DFPA acquires a first image over a relatively brief integration period at a relatively low gain setting. The DFPA then acquires a second image over longer integration period and/or a higher gain setting. During this second integration period, counters may roll over, possibly several times, to capture a residue modulus 2.sup.m of the number of counts (as opposed to the actual number of counts). A processor in or coupled to the DFPA generates a high-dynamic range image based on the first image and the residues modulus 2.sup.m.

An object of the present invention is to obtain an image having a better S/N ratio in accordance with gain settings in an image pickup apparatus that enables amplifying a signal based on output of a photoelectric conversion unit, with a plurality of gains. An image pickup element provided in an image pickup apparatus has a photoelectric conversion unit in which unit pixels are arranged in a matrix and a signal voltage is generating by photoelectric conversion. A column amplifier of the image pickup element can amplify the signal voltage photoelectrically converted with a plurality of gains. An image pickup element control unit performs drive control of the image pickup element to perform gain settings. An image composition unit performs image composition by using a plurality of image signals having different gains. When the image pickup element changes an amplification factor of the column amplifier to output image signals with a plurality of gains, the image pickup element control unit changes a value of a second gain that is smaller than that of a first gain among the gains and performs control so as not to change the value of the first gain.

The present technology relates to a signal processing apparatus, an imaging apparatus, and a signal processing method capable of reliably imaging a blinking imaging target in a scene having a very large difference in brightness. By detecting a difference between a plurality of images captured with different exposure times, calculating a combination coefficient indicating a combination ratio between the plurality of images on the basis of the difference, and combining the plurality of images on the basis of the combination coefficient, it is possible to reliably image a blinking imaging target in a scene having a very large difference in brightness. The present technology can be applied to, for example, a camera unit that captures an image.