A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.

A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.

A method for reconstructing a surface of a three-dimensional object (41) involves a projection of a laser spot pattern (12, 14) onto the surface of the three-dimensional object (41) by a laser (11), and a generation of a series of endoscopic images (24) as an endoscope (21) is translated and/or rotated relative to the three-dimensional object (41). Each endoscopic image (24) illustrates a different view (23) of a laser spot array (13, 15) within the laser spot pattern (12, 14) as projected onto the surface of the three-dimensional object (41) by the laser (11). The laser spot array (13, 15) may be identical to or a subset of the laser spot pattern (12, 14). The method further involves a reconstruction of the surface of the three-dimensional object (41) from a correspondence of the different views (23) of the laser spot array (13, 15) as illustrated in the endoscopic images (24).

The present invention provides a structured-light based system for providing a 3D image of at least one object within a field of view within a body cavity, comprising: a. An endoscope; b. at least one camera located in the endoscope's proximal end, configured to real-time provide at least one 2D image of at least a portion of said field of view by means of said at least one lens; c. a light source, configured to real-time illuminate at least a portion of said at least one object within at least a portion of said field of view with at least one time and space varying predetermined light pattern; and, d. a sensor configured to detect light reflected from said field of view; e. a computer program which, when executed by data processing apparatus, is configured to generate a 3D image of said field of view.

A method for intraoral scanning, including introducing an intraoral scanner (IOS) head into an oral cavity, acquiring an image of a field of view (FOV), processing the acquired FOV image and adjusting at least one image acquisition parameter based on said processing, and an intraoral scanner (IOS) including an IOS head including at least one imager imaging a field of view (FOV), at least on light emitter that illuminates said FOV and circuitry that controls said imager and/or said light emitter.

An intraoral imaging device comprises an elongated structural element; one or more light sources mounted on the structural element and configured to illuminate a target intraoral structure; one or more sensors mounted on the structural element and configured to detect the light returned from the illuminated target intraoral structure in order to generate an image; and a light absorbing divider dividing each of the light sources from an adjacent sensor and configured to obstruct direct emission of the light from the one or more light sources to the adjacent sensor.

The disclosure extends to methods, systems, and computer program products for widening dynamic range within an image in a light deficient environment.

An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and anon-structured light source are enclosed and sealed in the capsule housing.

An endoscope system of the present invention includes: a first illumination unit that emits first illumination light for imaging two sets of image information about a subject at different depths; a second illumination unit that emits second illumination light having a wide band covering a visible band from a position different from the position of the first illumination light; an imaging unit that images a first illumination image and a second illumination image of the subject that is illuminated with the first illumination light and the second illumination light; a separation processing unit that separates the two sets of image information from the first illumination image; and a separated-image generating unit that generates two separated images by processing the second illumination image using the two sets of image information.

A medical control apparatus includes a circuitry configured to: generate an irradiation image represented by illuminating-light irradiation, based on a brightness distribution of a captured image captured by an imaging device; and control generation of a projection image and projection of the projection image onto a subject by an image projector provided in an optical member based on the irradiation image and a rotation angle for rotation of the optical member rotatably coupled to the imaging device about a longitudinal axis of the optical member relative to the imaging device.