A surgical controlling system for controlling the 3D spatial position of at least one articulating surgical tool includes a controller configured to provide instructions to control movement of the surgical tool. The controller comprises a processor to determine a location of the surgical tool using at least one location estimating feature and to determine movement of the surgical tool using a database in communication with at least one movement detection feature. The location estimating feature is configured to real-time locate the 3D spatial position of the surgical tool at any given time t, and the movement detection feature is configured to detect movement of the surgical tool.

In a method of using a structured-light based system, real-time 2D images of a portion of a field of view are captured using an endoscope. A portion of an object in the field of view is illuminated with a structured light pattern, and light reflected from the field of view is detected. From the reflected light, a 3D image of the field of view is constructed, and 3D locations of points on a surface of the object are determined. The real time 3D spatial position of the endoscope and/or a surgical tool is determined. If a distance between the surface the endoscope and/or surgical tool, as determined using the 3D spatial position, falls below a predetermined distance, an alert is generated to notify a user.

Offset illumination using multiple emitters in a fluorescence imaging system is described. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The emitter comprises a first emitter and a second emitter for emitting different wavelengths of electromagnetic radiation. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises a laser mapping pattern.

The present invention addresses the problem of providing a small-sized, low-cost medical optical imaging device capable of irradiating even a deep portion of a dental root canal. Provided is a medical optical imaging device (4) that is provided with an illumination unit (6) for emitting illumination light to a subject, an imaging section (7) for imaging the subject, and a controller (8) for controlling at least the imaging section (7). The imaging section (7) is provided with an imaging lens system (71) and an imaging element (72) for receiving an optical image created by the imaging lens system (71). When viewed from the subject side, the illumination unit (6) is disposed in front of the imaging lens system (71) and overlapping the imaging lens system (71).

A system and method for displaying an endoscope image in a preferred orientation. An endoscope scans a sample with spectrally encoded light by rotating imaging optics inside an endoscope guide. A processor generates an image based on light returned from the sample, and rotates the image by a first angle offset value and a second angle offset value to display the rotated image in the preferred orientation. The first offset value is an angle difference between a specific direction in which the image is to be displayed on a display and a direction in which the tip of the endoscope is oriented with respect to the imaging plane. The second offset value is an angle difference between a direction of the line of scanning light projected onto a plane perpendicular to the tip and the specific direction in which the image is to be displayed.

An input control device is disclosed. The input control device can be configured to operate in different modes depending on proximity data provided by a proximity detection system. The input control device can include a feedback generator configured to generate feedback in response to the input control device switching between operational modes, the proximity data provided by the proximity detection system, and/or other conditions of the surgical procedure, robotic surgical tool, surgical site, and/or patient. The input control device can include a variable resistance assembly for resisting input control motions applied to an actuator thereof. Additionally or alternatively, the input control device can include an end effector actuator assembly for repositioning the end effector actuator based on feedback from a paired robotic surgical tool.

A surgical visualization feedback system is disclosed. The surgical visualization feedback system comprises an emitter assembly configured to emit electromagnetic radiation toward an anatomical structure. The emitter assembly comprises a structured light emitter configured to emit a structured light pattern on a surface of the anatomical structure and a spectral light emitter configured to emit spectral light capable of penetrating the anatomical structure. The surgical visualization feedback system further comprises a waveform sensor assembly configured to detect reflected electromagnetic radiation corresponding to the emitted electromagnetic radiation and a control circuit in signal communication with the waveform sensor assembly. The control circuit is configured to receive an input corresponding to a selected surgical procedure, determine an identity of a targeted structure within the anatomical structure based on the selected surgical procedure and the reflected electromagnetic radiation, and confirm the determined identity of the targeted structure through a user input.

Surgical systems are provided. In one exemplary embodiment, a surgical system includes a first scope device having a first portion within an extraluminal space and a second portion positioned within an intraluminal space. The first scope device transmits image data of a first scene. A second scope device is disposed within the extraluminal space and transmits image data of a second scene. The first portion of the first instrument is present within the field of view of the second scope device to track the first scope device relative to the second scope device. A controller receives the transmitted image data of the first and second scenes, to determine a relative distance from the first scope device to the second scope device within the extraluminal space, and to provide a merged image. At least one of the first and second scope device in the merged image is a representative depiction thereof.

In general, devices, systems, and methods for fiducial identification and tracking are provided.

In general, devices, systems, and methods for multi-source imaging are provided.