An apparatus includes a shaft assembly, an end effector, and a drive member visualization assembly. The end effector includes a first jaw, a second jaw, a staple cartridge, and a drive member capable of actuating along a firing stroke to fire a plurality of staples out of the staple cartridge or to sever tissue. The drive member visualization assembly provides an electronic indication linked to a physical location of the drive member within the upper jaw and the lower jaw during the firing stroke.

An endoscopic vessel harvesting system for surgical removal of a blood vessel to be used for coronary bypass uses endoscopic instruments for isolating and severing the vessel. An endoscopic camera in the endoscopic instruments captures images from a distal tip of the instrument within a dissected tunnel around the vessel. An image processor assembles a three-dimensional model of the tunnel from a series of images captured by the endoscopic camera. An augmented-reality display coupled to the image processor renders (e.g., visibly displays to the user in their field of view) a consolidated map representing the three-dimensional model along with a marker in association with the map indicating a current location of the distal tip.

A method for performing a procedure on a patient includes acquiring a three-dimensional image of a location of interest on the patient and a two-dimensional image of the location of interest can be acquired. A computer system can relate the three-dimensional image with the two-dimensional image to form a holographic image dataset. The computer system can register the holographic image dataset with the patient. The augmented reality system can render a hologram based on the holographic image dataset from the patient. The hologram can include a projection of the three-dimensional image and a projection of the two-dimensional image. The practitioner can view the hologram with the augmented reality system and perform the procedure on the patient. The practitioner can employ the augmented reality system to visualize a point on the projection of the three-dimensional image and a corresponding point on the projection of the two-dimensional image during the procedure.

A vessel harvesting system removes a target vessel from a patient for use as a bypass. An elongated harvesting instrument inserts into a body along a path of a target vessel which includes at least one side branch. The harvesting instrument includes a cutter for applying thermal energy to sever and cauterize the side branch. An endoscopic camera captures visible-light images from a distal tip of the instrument within a dissected tunnel around the target vessel. A thermal camera captures thermograms coinciding with the visible-light images to characterize a temperature present at respective surfaces in the tunnel. An image processor (e.g., an electronic controller) renders a video stream including the visible-light images and an overlay depicting the temperatures present on at least some of the respective surfaces when applying the thermal energy. A display presenting the video stream and overlay to a user can be an augmented-reality display.

The method of locating at least one mobile perception device of a navigation platform, the mobile perception device intended to be worn or carried by a user in a surgical scene, the navigation platform including at least one perception sensor, comprises: —acquiring, by the at least one perception sensor, a plurality of successive images of the scene including the portion of the body of the patient intended to be subjected to the surgical operation; —processing the plurality of successive images to evaluate a relative position of the mobile perception device and the portion of the body intended to be subjected to the surgical operation, wherein the relative position of the mobile perception device and the portion of the body takes into account a movement of the mobile perception device.

The method of fitting a knee prosthesis in a knee of a patient includes displaying, by a visual display device of a mobile augmented reality navigation system worn or carried by a user performing or assisting at least one navigation-assisted stage of the method, at least one visual element superposed on a view of at least a portion of a surgical scene of the fitting of the knee prosthesis. The visual element can be a 3D model of at least one portion of the knee of the patient, a 3D model of another component of the surgical scene, information relative to the at least one portion of the knee of the patient, and/or information relative to the other component of the surgical scene.

A surgical stapling system for stapling the tissue of a patient is disclosed. The stapling system comprises a housing, a shaft extending from the housing, and an end effector extending from the shaft. The end effector comprises a plurality of staples removably stored therein and, also, an anvil configured to deform the staples. The stapling system further comprises a firing mechanism configured to deploy the staples along a staple firing path longer than 60 mm, a camera configured to capture an image of the patient tissue, a display, and a controller configured to generate an image of the staple firing path, wherein the images are displayed on the display.

A method of displaying an operational parameter of a surgical system is disclosed. The method includes receiving, by a cloud computing system of the surgical system, first usage data, from a first subset of surgical hubs of the surgical system; receiving, by the cloud computing system, second usage data, from a second subset of surgical hubs of the surgical system; analyzing, by the cloud computing system, the first and the second usage data to correlate the first and the second usage data with surgical outcome data; determining, by the cloud computing system, based on the correlation, a recommended medical resource usage configuration; and displaying, on respective displays on the first and the second subset of surgical hubs, indications of the recommended medical resource usage configuration.

A Robotic control system has a wand, which emits multiple narrow beams of light, which fall on a light sensor array, or with a camera, a surface, defining the wand's changing position and attitude which a computer uses to direct relative motion of robotic tools or remote processes, such as those that are controlled by a mouse, but in three dimensions and motion compensation means and means for reducing latency.

Systems and methods are provided for identifying a suitable surgical location and/or trajectory for proceeding with a surgical procedure based on local polarization-sensitive optical coherence tomography imaging (PS-OCT). PS-OCT images are obtained of a tissue region and are processed to provide a spatial map of anisotropic structure within the tissue region. The anisotropic structure is processed to determine one or more suitable surgical locations and/or trajectories for avoiding or reducing damage to local anisotropic tissue structure identified within the tissue region. The spatial map of the anisotropic structure is registered with pre-operative volumetric image data identifying anisotropic tissue structure within a second tissue region that is larger than the tissue region imaged by PS-OCT.