Haptic feedback from a robotic surgical tool can be adjusted based on intra-operative assessment of the accuracy of a pre-operative surgical navigational plans. Navigational reference points are identified in at least one pre-operative image. At least one haptic response is identified for interactions between at least one robotic surgical tool and at least one navigational reference point. At least one intra-operative image is compared to the pre-operative image to determine the relative position of at least two corresponding navigational reference points in the images. The reference points' relative position determines a confidence level in the accuracy of the pre-operative navigational reference point. The haptic response is adjusted in timing, location, type, or amplitude based upon the confidence level. Tolerances and surgical navigation plan may also be updated and altered based on the confidence level.

The present technology relates to devices and systems for multidimensional data visualization and interaction in an augmented reality, virtual reality, or mixed reality image guided surgery. The disclosed embodiment provides a tool for a physician or other medical specialist to load and review medical scans in an AR/VR/MR environment, assisting medical diagnostics, surgical planning, medical education, or patient engagement.

Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.

A system is disclosed that includes an optical tracking device and a surgical computing device. The optical tracking device includes a structured light module and an optical module that includes an image sensor and is spaced from the structured light module at a known distance. The surgical computing device includes a display device, a non-transitory computer readable medium including instructions, and processor(s) configured to execute the instructions to generate a depth map from a first image captured by the image sensor during projection of a pattern into a surgical environment by the structured light module. The pattern is projected in a near-infrared (NIR) spectrum. The processor(s) are further configured to execute the stored instructions to reconstruct a 3D surface of anatomical structure(s) based on the generated depth map. Additionally, the processor(s) are configured to execute the stored instructions to output the reconstructed 3D surface to the display device.

Modules for housing electronic and electromechanical medical equipment including a system to measure and record administration of one or more IV medications or fluids for IV administration.

An automated dose-response record system including a module for housing waste-heat producing electronic and electromechanical medical equipment including at least one physiologic monitor, and including a system to measure, temporally correlate and record dose and response events.

An anesthetic equipment storage and waste air management module configured to housing electronic and electromechanical surgical equipment including a system to measure and record administration of one or more IV medications or fluids for IV administration. The module can include a housing having a lower section and a tower-like upper section, wherein the lower section is configured to house unrelated waste heat-producing electronic and electromechanical surgical equipment. The module can also include a cowling that substantially confines waste heat generated by the unrelated waste heat-producing electronic and electromechanical surgical equipment, and can include a system for measuring and recording the administration of the one or more IV medications and fluids.

A supply tray for a surgical procedure is selected based on the surgical procedure and patient data retrieved from an electronic health records database. Multiple steps of the surgical procedure are retrieved from the electronic health records database. A message is sent to a first manipulator to move a supply from the supply tray to a staging area for performing a step. A first indication is received from a first sensor that the supply is needed at a present time. A position where the supply is needed in an operating area proximate to the staging area is determined using a second sensor. A second message is sent to a second manipulator to move the supply from the staging area to the position. A second indication is received from a third sensor that the step is complete. A third message is sent to a third manipulator to remove the supply.

An electromagnetic intramedullary nail screw positioning system is used to assist an orthopaedic surgeon to correctly aligned a screw drill guide with a screw receiving aperture in an intramedullary nail during surgery. However due to the large number of different types of intramedullary nail, the system must be calibrated during each surgery. An improved calibration system is described that no longer requires the surgeon to perform the calibration during the surgery in order to save time and improve robustness. The system is periodically calibrated and a memory stores offset information for a range of nails types relative to a reference nail. During surgery, the surgeon enters a nail identifier, and the system looks up the associated offset and applies this offset to the measured signals to guide alignment of the screw drill guide with the screw receiving aperture.

An electromagnetic intramedullary nail screw positioning system is used to assist an orthopaedic surgeon to correctly aligned a screw drill guide with a screw receiving aperture in an intramedullary nail during surgery. However due to the large number of different types of intramedullary nail, the system must be calibrated during each surgery. An improved calibration system is described that no longer requires the surgeon to perform the calibration during the surgery in order to save time and improve robustness. The system is periodically calibrated and a memory stores offset information for a range of nails types relative to a reference nail. During surgery, the surgeon enters a nail identifier, and the system looks up the associated offset and applies this offset to the measured signals to guide alignment of the screw drill guide with the screw receiving aperture.