A surgical system is provided. The surgical system includes a camera operable to capture images and/or video. A projector is operable to project light, and a controller is communicatively coupled with the camera and the projector. The controller is operable to track movement of bone in real-time during surgery based on the images and/or video captured by the camera, and control the projector to project the light including a cutting line on the bone to indicate a cutting plane for cutting the bone during surgery.

A surgical system is provided. The surgical system includes a camera operable to capture images and/or video. A projector is operable to project light, and a controller is communicatively coupled with the camera and the projector. The controller is operable to track movement of bone in real-time during surgery based on the images and/or video captured by the camera, and control the projector to project the light including a cutting line on the bone to indicate a cutting plane for cutting the bone during surgery.

An optical marker for positioning a medical device outside a body and the medical device are disclosed. The optical marker comprises: a base having a concave or a convex, the concave or the convex being provided with a non-coplanar optical mark(s), and the optical mark(s) being visible on the entire surface of the concave or the convex; and a connecting portion connected to the base and used for connecting with the medical device. In the optical marker, the base provided with the optical mark(s) has a non-planar structure, being able to increase the recognizable angle of the medical device and improve the recognition accuracy and stability.

A surgical system is configured to augment the visualization environment presented to the surgeon by merging, in real-time, video feed and ultrasound imaging; tracking anatomy and instruments; identifying critical structures; generating and displaying 3-dimensional models of relevant anatomy; providing actionable guidance to the user; and enabling data collection and processing. The surgical system may include a tissue-marking surgical instrument configured to simultaneously identify critical structures beneath an organ surface and mark the organ surface at a location overlapping the identified critical structures.

An optical tracking system is provided. The optical tracking system comprises an autoclavable fiducial marker assembly including an opaque housing, a light source, a window panel configured to refract light rays from the light source therethrough, and a metallized coating forming a hermetic seal at an interface of the window panel and the opaque housing. The fiducial marker assembly is configured to shield a peripheral edge of the window panel from the light rays. The system further comprises a tracking device comprising at least two optical sensors configured to detect a position of a light ray emitted by the light source. The system further comprises a processor configured to receive the position of the light rays from the optical sensors, shift the position of each light ray based on a calculated refraction deviation, and triangulate the location of the light source based on the shifted position of each light ray.

A medical instrument includes a first device (108) including shape-sensed flexible instrument, a second device (102) disposed over the first device and a third device (109) disposed over the first device and a portion of the second device. The second and third devices include a geometric relationship such that a position of the second device and the third device is determined from shape sensing information of the first device and the geometric relationship.

Embodiments are directed to a medical robot system including a robot coupled to an end-effectuator element with the robot configured to control movement and positioning of the end-effectuator in relation to the patient. One embodiment is a method for removing bone with a robot system comprising: taking a two-dimensional slice through a computed tomography scan volume of target anatomy; placing a perimeter on a pathway to the target anatomy; and controlling a drill assembly with the robot system to remove bone along the pathway in the intersection of the perimeter and the two-dimensional slice.

Embodiments are directed to a medical robot system including a robot coupled to an end-effectuator element with the robot configured to control movement and positioning of the end-effectuator in relation to the patient. One embodiment is a method for removing bone with a robot system comprising: taking a two-dimensional slice through a computed tomography scan volume of target anatomy; placing a perimeter on a pathway to the target anatomy; and controlling a drill assembly with the robot system to remove bone along the pathway in the intersection of the perimeter and the two-dimensional slice.

An implant in the form of a bone screw that meets device tracking requirements set for the in the FDA regulations is provided. The bone screw includes a screw body and a tag body formed as an integral extension of the screw body and is connected to the screw body via a frangible interface bone screw. The screw body has a head portion and a threaded shaft portion that extends along a longitudinal axis from the head portion to a screw tip of the screw body. The tag body defines at least one surface configured to display traceability information for the bone screw. The frangible interface is disposed between the tag body and the screw tip of the screw body. The frangible interface is configured to fracture upon application of a predefined mechanical force so that the tag body is removable from the bone screw.

A representation apparatus for displaying a graphical representation of an augmented reality includes a capture unit, a first display unit, and a processing unit. The first display unit is at least partially transparent. The capture unit is configured to capture a relative positioning of the first display unit relative to a representation area of a second display unit. The processing unit is configured to determine an observation geometry between the first display unit and the representation area of the second display unit based on the relative positioning, receive a dataset, generate the augmented reality based on the dataset, and provide the graphical representation of the augmented reality via virtual mapping of the augmented reality onto the representation area along the observation geometry. The first display unit displays the graphical representation of the augmented reality in at least partial overlaying with the representation area of the second display unit.