Hyperspectral, fluorescence, and laser mapping imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, from about 900 nm to about 1000 nm, an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce, or a laser mapping pattern.

An image shift amount calculation apparatus comprises: an obtaining unit that obtains a pair of images having parallax; a generation unit that generates, from the pair of images, an image pair for each of a plurality of hierarchal levels having different resolutions; and a calculation unit calculates an image shift amount for an image pair in a predetermined first hierarchal level among the plurality of hierarchal levels, determines, on the basis of the image shift amount in the first hierarchal level, a second hierarchal level, among the plurality of hierarchal levels, where the calculation of the image shift amount is to end, and calculates an image shift amount of the image pair in the second hierarchal level using the image shift amount in the first hierarchal level.

An apparatus includes an acquisition unit configured to acquire distance information that indicates a distance to a subject on each predetermined region in a captured image, a control unit configured to adjust a focus position, and a storage unit configured to store first distance information acquired by the acquisition unit in response to the adjusted focus position. The control unit readjusts the focus position based on the first distance information and second distance information acquired by the acquisition unit.

An imaging control device includes: a controller that causes an imager to perform first imaging and further perform second imaging a plurality of times; and a dark image signal acquirer, the controller causes the imager to perform the second imaging in each of a plurality of exposure states where a quantity of light incident on the imager is greater than 0 and is different for each of the exposure states, by controlling the optical element, and the controller obtains, by controlling the movable lens at a time of the second imaging, a state where a first imaging condition value determined by a control state of the movable lens at the time of the second imaging is different from a second imaging condition value determined by a control state of the movable lens at a time of the first imaging.

Various techniques are provided to reduce noise in captured images using frame-to-frame shifts of scene information. In one example, a system includes an imager and a processor. The imager is configured to capture a plurality of image frames comprising scene information. The image frames exhibit frame-to-frame shifts of the scene information caused by a motion pattern associated with the imager. The processor is configured to distinguish noise in the image frames from the frame-to-frame shifts of the scene information. The processor is also configured to update non-uniformity correction terms to reduce the noise. Additional systems and methods are also provided.

An imaging control device includes: a controller that causes an imager to perform first imaging and further perform second imaging a plurality of times; and a dark image signal acquirer, the controller causes the imager to perform the second imaging in each of a plurality of exposure states where a quantity of light incident on the imager is greater than 0 and is different for each of the exposure states, by controlling the optical element, and the controller obtains, by controlling the movable lens at a time of the second imaging, a state where a first imaging condition value determined by a control state of the movable lens at the time of the second imaging is different from a second imaging condition value determined by a control state of the movable lens at a time of the first imaging.

A method for updating a fixed pattern noise matrix comprises: calculating a first difference between a target and first different images in a video stream to obtain a first differential matrix; calculating a second difference between the target and second different images in the video stream to obtain a second differential matrix; identifying a set of candidate positions for fixed pattern noise by: locating first and second sets of positions in the first differential matrix at which a difference deviates from predetermined values, finding a set of overlapping positions between the first and second sets of positions, and adjusting the set of overlapping positions. The adjusted set of overlapping positions is used for fixed pattern noise. Furthermore, each position in the set of candidate positions is updated, wherein the updated fixed pattern noise value at each position is based on a value at a corresponding non-adjusted position in the differential matrix.

Fluorescence imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.

Hyperspectral, fluorescence, and laser mapping imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, from about 900 nm to about 1000 nm, an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce, or a laser mapping pattern.

A control apparatus (100) includes a focus detection unit (101) that detects a defocus amount, a control unit (102) that automatically changes a parameter relating to a tracking operation during the tracking operation depending on an image capturing state, and a focusing unit (103) that preforms focusing based on the defocus amount and the parameter.