A surgical planning system for use in surgical procedures to repair an anatomy of interest includes a preplanning system to generate a virtual surgical plan and a mixed reality system that includes a visualization device wearable by a user to view the virtual surgical plan projected in a real environment. The virtual surgical plan includes a 3D virtual model of the anatomy of interest. When wearing the visualization device, the user can align the 3D virtual model with the real anatomy of interest, thereby achieving a registration between details of the virtual surgical plan and the real anatomy of interest. The registration enables a surgeon to implement the virtual surgical plan on the real anatomy of interest without the use of tracking markers.

A method includes training a machine learning model to generate predicted images to obtain a trained machine learning model, based on: a) pre-treatment training images; b) a plan of treatment; and c) post-treatment training images; where the plan of treatment includes: a) a first mark identifying where to apply a product, b) a first product to be applied at the first mark, and c) a first volume of the first product to be applied at the first mark; generating a predicted post-treatment image by applying the trained predictive visualization machine learning model to a new pre-treatment image, based on: a) a second mark on a new pre-treatment image of the area of a patient, b) a second product to be applied at the second mark, and c) a second volume of the second product to be applied at the second mark; where the predicted images identifies a modified area.

Novel tools and techniques are provided for implementing intelligent assistance (“IA”) or extended intelligence (“EI”) ecosystem for pulmonary procedures. In various embodiments, a computing system might analyze received one or more first layer input data (i.e., room content-based data) and received one or more second layer input data (i.e., patient and/or tool-based data), and might generate one or more recommendations for guiding a medical professional in guiding a surgical device(s) toward and within a lung of the patient to perform a pulmonary procedure, based at least in part on the analysis, the generated one or more recommendations comprising 3D or 4D mapped guides toward, in, and around the lung of the patient. The computing system might then generate one or more XR images, based at least in part on the generated one or more recommendations, and might present the generated one or more XR images using a UX device.

A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator’s head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.

An exemplary system includes a memory storing instructions and a processor communicatively coupled to the memory. The processor may be configured to execute the instructions to obtain one or more parameters of a non-robotic device in a surgical space, the non-robotic device engaged by a computer-assisted surgical system; generate, based on at least the one or more parameters of the non-robotic device, guidance content for use by the computer-assisted surgical system to facilitate guided teleoperation of the non-robotic device; and provide the guidance content to the computer-assisted surgical system.

Robotic arms and surgical robotic systems incorporating such arms are described. A robotic arm includes a roll joint connected to a prismatic link by a pitch joint and a tool drive connected to the prismatic link by another pitch joint. The prismatic link includes several prismatic sublinks that are connected by a prismatic joint. A surgical tool supported by the tool drive can insert into a patient along an insertion axis through a remote center of motion of the robotic arm. Movement of the robotic arm can be controlled to telescopically move the prismatic sublinks relative to each other by the prismatic joint while maintaining the remote center of motion fixed. Other embodiments are also described and claimed.

A surgical assistance system may obtain a pre-revision model of a bone of a patient. The pre-revision model of the bone represents a pre-revision state of the bone after a prior orthopedic surgery on the bone. In this example, an orthopedic prosthesis was attached to the bone during the prior orthopedic surgery. Additionally, the surgical assistance system may obtain intra-revision imaging data of the bone. The intra-revision imaging data represents an intra-revision state of the bone during the orthopedic revision surgery after removal of the orthopedic prosthesis from the bone. The surgical assistance system may determine, based on the intra revision imaging data, damaged and intact parts of the bone. The surgical assistance system may then generate a second intra-revision model of the bone by modifying the pre-revision model of the bone to exclude damaged parts of the bone.

An apparatus for obtaining an image of a retina is described herein. The apparatus includes an optical relay that defines an optical path and is configured to relay an image of the iris along the optical path to a pupil, a shutter is disposed at the pupil and configured to define at least a first shutter aperture for control of light transmission through the pupil position, a tube lens disposed to direct light from the shutter aperture to an image sensor, and a prismatic input port disposed between the shutter and the tube lens and configured to combine, onto the optical path, light from the relay with light conveyed along a second light path that is orthogonal to the optical path.

A surgical navigation system includes a source of a patient anatomy data, wherein the patient anatomy data comprises a three-dimensional reconstruction of a segmented model comprising at least two sections representing parts of the anatomy. A surgical navigation image generator is configured to generate a surgical navigation image comprising the patient anatomy. A 3D display system is configured to show the surgical navigation image wherein the display of the patient anatomy is selectively configurable such that at least one section of the anatomy is displayed and at least one other section of the anatomy is not displayed.

The present disclosure relates to a method and a device for acquisition of a metric of an eye (1) located in an acquisition space (29). The device comprises at least one light source (11) configured to emit light towards the acquisition space, a camera (15) configured to receive light from the acquisition space to (29) generate image data, and an analyzing unit (14) configured to extract at least one metric from the image data. The camera (15) is configured to receive light from the acquisition space via at least two light paths (17, 19) which are differently angled with respect to the optical axis of the camera, the light of at least one path being received via a first mirror (21). The camera receives light from an overlapping portion of the acquisition space via the first and second paths, as to allow the camera to receive at least two representations of a single eye. This metric may be used for e.g. eye tracking or autorefraction/accomodation.