A surgical system is provided. The surgical system includes a camera operable to capture images and/or video. A projector is operable to project light, and a controller is communicatively coupled with the camera and the projector. The controller is operable to track movement of bone in real-time during surgery based on the images and/or video captured by the camera, and control the projector to project the light including a cutting line on the bone to indicate a cutting plane for cutting the bone during surgery.

Devices and systems are provided for tracking a position and orientation of a handheld implement, such that the handheld implement may be trackable with an overhead tracking system. A support member secures one or more markers relative to a longitudinal portion of the handheld implement, and a marker plane containing the markers is orientated an angle relative to a longitudinal axis of the longitudinal portion. A marker assembly may include a support member for supporting the markers, and a connector for removably attaching the marker assembly to one or more handheld implements. The marker assembly may be configured to be removably attachable to a plurality of connection adapters, where each connection adapter is further connectable to a handheld implement, optionally at a calibrated position, such that a single connection adapter can be optionally employed to track a plurality of handheld implements. The handheld implement may be a medical instrument.

An optical marker for positioning a medical device outside a body and the medical device are disclosed. The optical marker comprises: a base having a concave or a convex, the concave or the convex being provided with a non-coplanar optical mark(s), and the optical mark(s) being visible on the entire surface of the concave or the convex; and a connecting portion connected to the base and used for connecting with the medical device. In the optical marker, the base provided with the optical mark(s) has a non-planar structure, being able to increase the recognizable angle of the medical device and improve the recognition accuracy and stability.

A surgical system is configured to augment the visualization environment presented to the surgeon by merging, in real-time, video feed and ultrasound imaging; tracking anatomy and instruments; identifying critical structures; generating and displaying 3-dimensional models of relevant anatomy; providing actionable guidance to the user; and enabling data collection and processing. The surgical system may include a tissue-marking surgical instrument configured to simultaneously identify critical structures beneath an organ surface and mark the organ surface at a location overlapping the identified critical structures.

Systems and methods are provided for performing intraoperative fusion of two or more volumetric image datasets via surface-based image registration. The volumetric image datasets are separately registered with intraoperatively acquired surface data, thereby fusing the two volumetric image datasets into a common frame of reference while avoiding the need for complex and time-consuming preoperative volumetric-to-volumetric image registration and fusion. The resulting fused image data may be processed to generate one or more images for use during surgical navigation.

A surgical system includes a detector, comprising an array of pixels configured to detect light reflected by a surgical instrument and generate a first signal comprising a first dataset representative of a visible image of the surgical instrument. The surgical system also includes a processor configured to receive the first signal, generate a modified image of the surgical instrument that includes a control panel. The control panel includes one or more control elements representative of one or more operating parameters of the surgical instrument. The processor is further configured to receive an input to the control panel from a user, the input being effective to change one of the operating parameters. The processor is also configured to generate a command signal based on the input to change the one of the operating parameters.

An energy source is offset from an elongate probe axis with an extension. The amount of offset of the energy source can be controlled by varying an amount of offset of the extension. The energy source rotated and translated at the offset distance to resect tissue. In some embodiments, the probe is configured to receive a second treatment probe comprising a second energy source, in which the second energy source is rotated and translated relative to the first treatment probe, which can improve positional accuracy and stability. The energy source and the extension can be coupled to a linkage to offset the energy source, and to translate and rotate the energy source with varying amounts of offset. The linkage can be coupled to a processor and one or more of the energy source moved in accordance with a treatment profile.

A positioning system includes a group of positioning devices including a first device comprising a first positioning source associated with a first positioning modality, the first positioning source being configured to view a first field, a second device comprising a second positioning source associated with a second positioning modality that is of a different type than the first positioning modality, the second positioning source being configured to view a second field, a third device comprising one or more first markers detectable within the first field using the first positioning modality, and a fourth device comprising one or more second markers detectable within the second field using the second positioning modality. A linking structure physically links two of the group of positioning devices to one another in a fixed, rigid relative position and orientation.

Embodiments are directed to a medical robot system including a robot coupled to an end-effectuator element with the robot configured to control movement and positioning of the end-effectuator in relation to the patient. One embodiment is a method for removing bone with a robot system comprising: taking a two-dimensional slice through a computed tomography scan volume of target anatomy; placing a perimeter on a pathway to the target anatomy; and controlling a drill assembly with the robot system to remove bone along the pathway in the intersection of the perimeter and the two-dimensional slice.

A method of determining a focal length of a camera and/or of adjusting a viewing direction in a graphical representation of a pre-operative image is provided. The method includes providing uncalibrated camera data of a camera, specifying an initial value of a focal length of the camera, specifying a working distance value of a distance between the camera and the at least part of the tracking system, calculating a distance value of the distance between the camera and the at least part of the tracking system based on the uncalibrated camera data and based on the specified initial value of the focal length of the camera, calculating a change factor based on the specified working distance value and the calculated distance value, and calculating an adapted value of the focal length of the camera based on the initial value of the focal length and based on the change factor.