A method and system for processing medical images including acquiring a first medical image using a medical imaging device, analyzing a state of the first medical image using image information of the first medical image which includes depth information, and automatically determining and displaying, without user intervention, a second medical image, which corresponds to the first medical image and has a smaller angle of view than the first medical image, based on the analyzing including analyzing of the depth information. Further, there is a method of training a neural network. The training includes collecting a set of training information which includes image quality information, camera position information, and surgical tool information, training the neural network based on the set of training information, the neural network used for changing a view based on current camera position information and current surgical tool information.

Orientation calibration system for image capture is disclosed that may include a camera to capture a target image, a display screen to display the image, an orientation sensor to determine at least two axes of orientation of the system, and a processor. The processor configured to determine the present orientation of the system using the orientation sensor, display a portion of present and a desired orientation of the system, receive a request to capture the target image, and capture the target image using the camera in response to receiving the request to capture the target image, and when a difference between the present orientation of the system and desired orientation of system is within a threshold. The system may be used to adjust/orient a display monitor to ensure desired alignment to accurately capture image. Methods for aligning/orienting a display monitor (imaging source), and the orientation calibration system are provided.

A mammography system includes a biopsy guidance system that employs a simplified robot arm support, to enable previously unusable locations for the mounting of the biopsy device directly to the mammography system, such as on a compression paddle, combined with a vision guidance and control system. The vision system operates to determine the position of the biopsy device and the biopsy needle tip, as well as to control the movement/operation of the biopsy guidance system, such as movement to the final end-pose or pre-firing position of the biopsy device to perform the biopsy procedure. The vision system utilizes one or more cameras to visually determine the position the biopsy device relative to a region of interest being biopsied within the required tolerances for the biopsy procedure without the need for precise positional information to be provided by the biopsy guidance system to the mammography system.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

The present invention relates to a computer-vision based autonomous steerable catheter device and methods of using the same for targeted delivery of a liquid microvolume into the interior of a lung.

Various embodiments disclosed herein relate to improved systems and methods for performing computer-aided surgical navigation using augmented reality. A tracking device having one or more optically detectable points is mounted to a patient via surgical hardware. The detectable points are identified by a sensor. One or more augmented reality marker assemblies that each have an augmented reality fiducial marker or symbol are also attached to the tracking device,. A computer system generates augmented reality information and transmits it to a display screen, such as a near-eye augmented reality device, for display thereon. The near-eye augmented reality device also has an image capture device capable of capturing the augmented reality symbols, and thereby determining a three-dimensional orientation associated with the tracking device, augmented reality markers, and a user wearing the near-eye reality device.

A surgical system includes a plurality of voice sensors located in a surgical environment and configured to detect sound and generate a first plurality of signals. The surgical system also includes a position indicator, in proximity to a designated user, configured to indicate a first position of the designated user and generate a second signal representative of the first position. The surgical system further includes a processor configured to receive the first plurality of signals and the second signal and determine, based on the first plurality of signals, a second position. The processor is also configured to compare the detected sound with registered voice command of the designated user stored in a memory to verify the designated user's credentials, and send a command signal to a surgical instrument to carry out an operation related to the voice command based on at least one of the verification of the designated user's credentials, the first position and the second position.

A surgical instrument is disclosed. The surgical instrument includes a shaft, a sensing array and a fluid detection circuit. The sensing array is positioned within the shaft. The fluid detection circuit is electrically coupled to the sensing array, and is configured to determine when a fluid originating from an environment external to the shaft is present within the shaft.

A processing device receives, from an image capture device associated with an augmented reality (AR) display, a plurality of images of a face of a patient. The processing device selects a subset of the plurality of images that meet one or more image selection criteria. The selection comprises determining, from the plurality of images, a first image that represents a first position extreme for the face; determining, from the plurality of images, a second image that represents a second position extreme of the face; selecting the first image; and selecting the second image. The processing device further generates a model of a jaw of the patient based at least in part on the subset of the plurality of images that have been selected.

A system includes a surgical lighthead including a lighthead housing including a plurality of light emitting elements therein that are arranged to emit light toward to a region of interest, and a handle attached to the lighthead housing. A sensor is integrated with the lighthead and configured to measure an ambient environmental condition at the lighthead. In other embodiments, a medical device support system includes a support and an ambient environmental condition sensor assembly coupled to the support column and including a sensor configured to measure an ambient environmental condition at the ambient environmental condition sensor assembly. A controller is operatively coupled to the sensor and configured to detect an ambient environmental condition based at least in part on the measured ambient environmental condition by the sensor.