Fluorescence imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm or from about 795 nm to about 815 nm.

Fluorescence imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm or from about 795 nm to about 815 nm.

Minimizing image sensor input/output pads in a pulsed fluorescence imaging system is disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a plurality of bidirectional pads comprising an output state for issuing data and an input state for receiving data. The system includes a controller configured to synchronize timing of the emitter and the image sensor. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 770 nm to about 790 nm and/or from about 795 nm to about 815 nm.

A camera module including a lighting unit configured to output an incident light signal to be emitted to an object, a lens unit configured to concentrate a reflected light signal reflected from the object, an image sensor unit configured to generate electric signals from the reflected light signal concentrated by the lens unit, a tilting unit configured to shift an optical path of at least one of the incident light signal and the reflected light signal for each image frame in units of subpixels of the image sensor unit, and an image control unit configured to extract depth information of the object using a phase difference between the incident light signal and the reflected light signal. The image control unit includes an image controller configured to extract the depth information having a higher resolution than a plurality of subframes generated using the electric signals on the basis of the subframes.

A camera module including a lighting unit configured to output an incident light signal to be emitted to an object, a lens unit configured to concentrate a reflected light signal reflected from the object, an image sensor unit configured to generate electric signals from the reflected light signal concentrated by the lens unit, a tilting unit configured to shift an optical path of at least one of the incident light signal and the reflected light signal for each image frame in units of subpixels of the image sensor unit, and an image control unit configured to extract depth information of the object using a phase difference between the incident light signal and the reflected light signal. The image control unit includes an image controller configured to extract the depth information having a higher resolution than a plurality of subframes generated using the electric signals on the basis of the subframes.

An electronic device tracks its motion in an environment while building a three-dimensional visual representation of the environment that is used to correct drift in the tracked motion. A motion tracking module estimates poses of the electronic device based on feature descriptors corresponding to the visual appearance of spatial features of objects in the environment. A mapping module builds a three-dimensional visual representation of the environment based on a stored plurality of maps, and feature descriptors and estimated device poses received from the motion tracking module. The mapping module provides the three-dimensional visual representation of the environment to a localization module, which identifies correspondences between stored and observed feature descriptors. The localization module performs a loop closure by minimizing the discrepancies between matching feature descriptors to compute a localized pose. The localized pose corrects drift in the estimated pose generated by the motion tracking module.

Hyperspectral, fluorescence, and laser mapping imaging with reduced fixed pattern noise are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes applying edge enhancement to edges within an exposure frame of the plurality of exposure frames. The method is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, from about 900 nm to about 1000 nm, an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce, or a laser mapping pattern.

An exemplary method includes generating a 3D mesh of a subject based on frames of time-synchronized video streams of a subject, the frames associated with a first time and generating a transformed facial-mesh model based on a facial portion of the 3D mesh and a facial-mesh model. The method further includes generating a hybrid mesh by combining the transformed facial-mesh model and at least a portion of the 3D mesh. The method further includes generating a current 3D mesh based on frames of the time-synchronized video streams associated with a second time that temporally follows the first time. The method further includes generating a deformed historical 3D mesh by applying a non-rigid deformation process to the hybrid mesh based on the current 3D mesh. The method further includes compressing the deformed historical 3D mesh to form at least one triangle-based 3D submesh including a plurality of submesh triangles.

An exemplary method includes generating a 3D mesh of a subject based on frames of time-synchronized video streams of a subject, the frames associated with a first time and generating a transformed facial-mesh model based on a facial portion of the 3D mesh and a facial-mesh model. The method further includes generating a hybrid mesh by combining the transformed facial-mesh model and at least a portion of the 3D mesh. The method further includes generating a current 3D mesh based on frames of the time-synchronized video streams associated with a second time that temporally follows the first time. The method further includes generating a deformed historical 3D mesh by applying a non-rigid deformation process to the hybrid mesh based on the current 3D mesh. The method further includes compressing the deformed historical 3D mesh to form at least one triangle-based 3D submesh including a plurality of submesh triangles.

An illustrative method includes obtaining a three-dimensional (3D) mesh of a subject, obtaining a mesh model, and generating a hybrid mesh of the subject. The generating includes replacing a portion of the 3D mesh with the mesh model such that the hybrid mesh includes a non-replaced portion of the 3D mesh represented at a first resolution and the mesh model representing the replaced portion of the 3D mesh at a second resolution.