A fiber optic tracking sensor includes an outer tube, a plurality of optical fibers within the outer tube and including a central optical fiber and a plurality of additional optical fibers, and one or more structural members within the outer tube and configured to provide a spacing between the plurality of optical fibers such that the central optical fiber is positioned along a central longitudinal axis of the outer tube and the plurality of additional optical fibers are spaced apart from one another and from the central optical fiber.

A method for creating a patient-specific surgical plan includes receiving one or more pre-operative images of a patient having one or more infirmities affecting one or more anatomical joints. three-dimensional anatomical model of the one or more anatomical joints is created based on the one or more pre-operative images. One or more transfer functions and the three-dimensional anatomical model are used to identify a patient-specific implantation geometry that corrects the one or more infirmities. The transfer functions model performance of the one or more anatomical joints as a function of anatomical geometry and anatomical implantation features. surgical plan comprising the patient-specific implantation geometry may then be displayed.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

A computer assisted system is disclosed that includes an optical tracking system and one or more computing devices. The optical tracking system includes an RGB sensor and is configured to capture color images of an environment in the visible light spectrum and tracking images of fiducials in the environment in a near-infrared spectrum. The computer assisted system is configured to generate a color image of the environment using the color images, identify fiducial locations using the tracking images, generate depth maps from the color images, reconstruct three-dimensional surfaces of structures based on the depth maps, and output a display comprising the reconstructed three-dimensional surface and one or more surgical objects that are associated with the tracked fiducials. The computer assisted system can further include a monitor or a head-mounted display (HMD) configured to present augmented reality (AR) images during a procedure.

The present application relates to a motion control method and system for a mechanical arm and surgical system, the terminal end of the mechanical arm is adapted to carry an effector, the method includes steps of: receiving a first control command from a first input device by a graphical user interface, wherein the first control command is configured to control the mechanical arm to move according to a first movement mode; receiving a second control command from the first input device or a second input device, wherein the second control command is configured to control the mechanical arm to enter a second movement mode; and receiving a third control command from the second input device, wherein the third control command is configured to control the effector to perform a predetermined movement, wherein the first input device and the second input device are separated from each other.

A surgical system comprises an articulated mechanical arm comprising arm segments connected serially by arm joints that flex and rotate, and first and second input-devices. The second input-device comprises a handle configurable to be oriented in any orientation in an x-y-z space, and the handle comprises segment members and joint members corresponding to the arm segments and arm joints of the arm. The arm joints can be actuatable by, and have the same degrees of freedom as, the handle joint member. A method of using the surgical system includes retroflecting the arm, transitioning control of the arm from the first input device to the second input device, and performing a surgical action, during which a displacement vector or a reorientation arc of the handle member through the x-y-z space is translated to a corresponding displacement vector or corresponding reorientation arc of the end effector in the same x-y-z space.

A system and method are provided for aligning a tool with a targeted axis in tissue to perform a medical procedure. medical plan is registered to the location of the tissue using a computer-assisted medical system, where the medical plan include a planned position for the targeted axis based on pre-procedure data. The tool is aligned with the planned position for the targeted axis using a computer- assisted medical system. The computer-assisted medical system includes a hand- held device having a handle and a working portion adjustable relative to the handle so as to orient the tool. A computing system is also provided comprising a tracking system and a control system for registering the medical plan to the location of the tissue, tracking the hand-held device relative to the tissue and the medical plan, and adjusting the working portion of the hand-held device relative to its handle.

A system and method are provided for aligning a tool with a targeted axis in tissue to perform a medical procedure. medical plan is registered to the location of the tissue using a computer-assisted medical system, where the medical plan include a planned position for the targeted axis based on pre-procedure data. The tool is aligned with the planned position for the targeted axis using a computer- assisted medical system. The computer-assisted medical system includes a hand- held device having a handle and a working portion adjustable relative to the handle so as to orient the tool. A computing system is also provided comprising a tracking system and a control system for registering the medical plan to the location of the tissue, tracking the hand-held device relative to the tissue and the medical plan, and adjusting the working portion of the hand-held device relative to its handle.

A system for performing a surgical procedure includes a controller including a memory and a processor, the memory storing instructions, which when executed by the processor cause the processor to receive an image captured by a camera, generate a segmented image by applying a first threshold value to the image captured by the camera, identify a lumen within the segmented image, determine a centroid of the lumen within the segmented image, and align a portion of a surgical device operably coupled to the controller with the centroid of the lumen.

The present disclosure provides a system for enabling autonomous or semi-autonomous surgical operations. The system comprises: one or more processors that are individually or collectively configured to: process an image data stream comprising one or more images of a surgical site; fit a parametric model to a tissue surface identified in the one or more images; determine a direction for aligning a tool based in part on the parametric model; determine an optimal path for automatically moving the tool to perform a surgical procedure at the surgical site; and generate one or more control signals for controlling i) a movement of the tool based on the optimal path and ii) a tension force applied to the tissue by the tool during the surgical procedure.