Tool exchange interface and control algorithm for cooperative surgical robots

Abstract

A system and method for tool exchange during surgery for cooperatively controlled robots comprises a tool holder for receiving a surgical tool adapted to be held by a robot and a surgeon, a tool holding element for constraining downward motion of the tool while allowing low force removal of the surgical tool from the holder, a first sensor for detecting if the surgical tool is docked within the tool holder, and a selector for automatically selecting different movements or actions of the tool holder to be performed based upon information detected by the first sensor. The system and method of the present invention provides an advantage to an often slow moving cooperative robot, by increasing the speed by which the tool holder may move in the direction away from the patient.

Claims

1. A cooperatively controlled robot for quick release of a tool, comprising: a robot arm; a tool holder assembly operatively coupled to an end of the robot arm, the tool holder assembly comprising a tool holding element and a sensor; and a data processor in communication with the robot arm and the sensor, and a second sensor in communication with the robot arm and the data processor, wherein the tool holder assembly is configured to receive a surgical tool adapted to be simultaneously held by the cooperatively controlled robot and a surgeon, wherein the tool holding element constrains downward motion of the surgical tool relative to the tool holder assembly while allowing low force removal of the surgical tool from the tool holder assembly, wherein the sensor is configured to detect if the surgical tool is docked within the tool holder assembly, wherein the data processor is configured to automatically select movements or actions of the tool holder assembly to be performed by the robot arm based upon information detected by the sensor, wherein the second sensor is configured to detect forces exerted by the surgeon on the surgical tool or on the cooperatively controlled robot when the surgical tool is engaged in the tool holder assembly, and wherein the data processor automatically instructs the robot arm to retract when the second sensor detects that forces exerted by the surgeon on the surgical tool or on the cooperatively controlled robot indicate that the surgical tool is not fully engaged in the tool holder.

2. The cooperatively controlled robot of claim 1, wherein the sensor is a proximity sensor embedded within the tool holder for sensing a location of the surgical tool with respect to the tool holder.

3. The cooperatively controlled robot of claim 2, wherein the proximity sensor is disposed at a distal end of the tool holder.

4. The cooperatively controlled robot of claim 1, wherein the sensor is a contact sensor.

5. The cooperatively controlled robot of claim 4, wherein the contact sensor is a toggle switch or a pressure sensor.

6. The system of claim 1, wherein the sensor is a displacement potentiometer.

7. The cooperatively controlled robot of claim 1, wherein the sensor is an optical sensor, said optical sensor being a beam break type of sensor for determining the location of the surgical tool inside the tool holder.

8. The cooperatively controlled robot of claim 1, wherein the system further comprises the surgical tool, and wherein the tool holding element comprises a flange in mechanical connection with the surgical tool.

9. The cooperatively controlled robot of claim 1, wherein the tool holding element includes a tapered surface on said tool holder that contacts a cooperative tapered surface on said surgical tool when said tool is engaged in said tool holder.

10. The cooperatively controlled robot of claim 1, wherein the robot arm moves the tool holder in a direction for reengagement of the surgical tool when the first-mentioned sensor senses a predetermined level of force consistent with removal of the surgical tool.

11. The cooperatively controlled robot of claim 1, wherein the data processor determines a movement or action of the cooperatively controlled robot based upon whether the surgical tool is engaged or not.

12. The cooperatively controlled robot of claim 1, further comprising a sensor for detecting tool to tissue distance, wherein the robot arm moves the tool holder to a desired standoff distance when the detected tool-to-tissue distance reaches a predetermined level.

13. A cooperatively controlled robot for quick release of a tool, comprising: a robot arm; a tool holder assembly operatively coupled to an end of the robot arm, the tool holder assembly comprising a tool holding element and a sensor; and a data processor in communication with the robot arm and the sensor, wherein the tool holder assembly is configured to receive a surgical tool adapted to be simultaneously held by the cooperatively controlled robot and a surgeon, wherein the tool holding element constrains downward motion of the surgical tool relative to the tool holder assembly while allowing low force removal of the surgical tool from the tool holder assembly, wherein the sensor is configured to detect if the surgical tool is docked within the tool holder assembly, wherein the data processor is configured to automatically select movements or actions of the tool holder assembly to be performed by the robot arm based upon information detected by the sensor, and wherein the data processor is configured to select a movement of the tool holder assembly according to {dot over (x)}.sub.h=F.sub.h with {dot over (x)}.sub.hZ=(s, t) if the sensor detects that the tool is disengaged, where F.sub.h is a force/torque resolved at a handle of the tool, F.sub.hZ is a force in handle coordinates along a Z-axis, {dot over (x)}.sub.h is a desired handle velocity in handle coordinates, is a constant that translates handle input force to handle velocity, and (s, t) is a function that generates a desired handle response based on sensor input and time.

14. The cooperatively controlled robot of claim 13, wherein (s, t)= for a period of time t after the sensor detects that the tool is disengaged so that the robot arm moves the tool up by a fixed amount bt.

15. The cooperatively controlled robot of claim 13, wherein the data processor is configured to select a movement of the tool holder assembly according to {dot over (x)}.sub.h=F.sub.h if the sensor detects that the tool is engaged, where F.sub.h is a force/torque resolved at a handle of the tool, {dot over (x)}.sub.h is a desired handle velocity in handle coordinates, and is a constant that translates handle input force to handle velocity.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The accompanying drawings provide visual representations which will be used to more fully describe the representative embodiments disclosed herein and can be used by those skilled in the art to better understand them and their inherent advantages. In these drawings, like reference numerals identify corresponding elements and:

(2) FIG. 1A illustrates a side elevated view of an exemplary product according to the features of the present invention.

(3) FIG. 1B illustrates a side elevated view of an exemplary product according to the features of the present invention.

(4) FIG. 2A illustrates a perspective view of an exemplary product according to the features of the present invention.

(5) FIG. 2B illustrates a perspective view of an exemplary product according to the features of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(6) The presently disclosed subject matter now will be described more fully hereinafter with reference to the accompanying Drawings, in which some, but not all embodiments of the inventions are shown. Like numbers refer to like elements throughout. The presently disclosed subject matter may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Indeed, many modifications and other embodiments of the presently disclosed subject matter set forth herein will come to mind to one skilled in the art to which the presently disclosed subject matter pertains having the benefit of the teachings presented in the foregoing descriptions and the associated Drawings. Therefore, it is to be understood that the presently disclosed subject matter is not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims.

(7) The present invention pertains to a system and method for tool exchange of a surgical tool during cooperatively controlled robots. An exemplary embodiment of the invention provides for use of the system and method in cooperatively controlled hand-over-hand systems is described in Development and Application of a New Steady-Hand Manipulator for Retinal Surgery, Mitchell et al., IEEE ICRA, pp. 623-629 (2007) and in New Steady-Hand Eye Robot with Microforce Sensing for Vitreoretinal Surgery Research, A. Uneri, M. Balicki, James Handa, Peter Gehlbach, R. Taylor, and I. Iordachita, International Conference on Biomedical Robotics and Biomechatronics (BIOROB), Tokyo, Sep. 26-29, 2010. pp. 814-819, the entire contents of which are incorporated by reference herein. In steady-hand control, the surgeon and robot both hold the surgical tool. The robot senses forces exerted by the surgeon on the tool handle, and moves to comply, filtering out any tremor. While a specific cooperative control system is described in connection with the above publication, it should be understood that the system and method of the present invention may also be applicable to other cooperatively controlled systems.

(8) With reference to FIGS. 1A and 1B and FIGS. 2A and 2B, an exemplary embodiment of a cooperatively controlled surgical system to be used in connection with the present invention is shown. The system 10 may be used in micro-surgery of organs, for example, hollow organs, such as the human eye. However, other applications are possible and within the scope of the invention. As shown in FIGS. 1A, 1B, 2A, and 2B, a robot 12 includes tool holder 14 for receiving a surgical tool 16 to be held by both the robot 12 and a surgeon 17 (FIGS. 2A and 2B). Preferably, the surgeon 17 holds the surgical tool 16 at a tool handle 18, and cooperatively directs the surgical tool 16 with the robot 12 to perform surgery of a region of interest with a tool tip 20.

(9) With reference to FIG. 1A, a tool holding element 24 is provided for constraining downward motion of the surgical tool 16 while allowing low force removal of the surgical tool 16 from the tool holder 14. In the exemplary embodiment in FIG. 1A, the tool holding element 24 is a d-tenting mechanism in which a small spring-loaded ball or pin in the tool holder 14 engages a socket or groove on the tool shaft to hold the surgical tool in place unless a sufficiently large force is exerted to disengage the surgical tool 16. A flange 22 on the surgical tool 16 may also be used to restrict downward motion of the tool.

(10) With reference to FIG. 1B, an alternative embodiment of the system 10 includes a different type of tool holding element 26. In particular, the tool holding element 26 may be one or more tapered surfaces along either the tool shaft itself, or the internal channel of the tool holder. For example, the tool holder channel may be a circular cross section or some other cross section constraining the axial rotation of the tool relative to the tool holder. Other examples of tool holding elements include magnets, vacuum chucks, or any other mechanical or electromechanical devices to keep the surgical tool in place, while allowing low breakaway forces. The tool holding element should be sufficiently strong so that the tool is held firmly enough to allow the operator to guide the tool without unintended breakaway while also ensuring that the required release force not be so large that the tool cannot be removed safely and quickly.

(11) According to the features of the present invention, a first aspect of the invention is to provide feedback information regarding whether a tool is engaged within the tool holder. That is, a first sensor may be provided for detecting if the surgical tool is docked within the tool holder 14. For example, with reference to FIG. 1B, a sensor 42 may be positioned in the tool holder 14 to detect the position of the surgical tool 16 within the tool holder 14. Sensor 42 may include, but is not limited to, a proximity sensor (IR, Hall Effect) imbedded in the tool holder. As shown in FIG. 1B, the sensor 42 is preferably disposed at a distal end of the tool. Because of the location of the sensor 42 at the distal end of the tool holder 14, the sensor 42 is operated when the tool is engaged in the holder.

(12) In addition, other sensors may be used to detect if the surgical tool 16 is docked or engaged in the tool holder 14, including but not limited to, a contact sensor, a toggle switch or pressure sensor, a beam-break type of optical sensor, direct contact force sensor, and a displacement potentiometer. Further, a multiplicity of sensors may be used in a redundant manner to detect whether the tool is fully engaged with the tool holder.

(13) According to the features of the present invention, a selector is provided that automatically selects different movements or actions of the tool holder to be performed based upon information detected by the sensor, e.g., whether the tool is engaged in the tool holder, which will be described in more detail below. For example, when a sensor detects that the tool is not fully engaged within the tool holder, the robot may actively move along the tool axis to restore that connection based on one or more contact sensing methods. If the tool is fully engaged in the tool holder, the robot moves to respond to motions commanded by the surgeon user, for example by exerting forces on the handle of the tool.

(14) According to another aspect of the present invention, the forces between a surgeon and tool may also be detected. For example, a number of sensors known in the art may be used to detect whether the tool 16 is held by the surgeon. For example, and with reference to FIG. 1B, a sensor 40 may be disposed on the tool handle. Sensor 40 may include but is not limited to micro-switches, capacitive sensors, optical sensors, force sensors, or pressure sensors on the tool handle 18. The robot can be programmed so that if the operator releases the tool handle, the robot will automatically retract the tool by a predetermined amount or a predetermined distance or to perform some other disengaged behavior. Similarly, when the tool is held firmly in the tool holder, the breakaway force is high. A rise in the axial force in the direction of tool retraction up to some known break-away force, followed by a sudden drop to zero force is characteristic of tool break-away. When handle forces fall below a desired threshold or there is no handle contact or until the system otherwise detects that the tool is no longer engaged in the tool holder, the robot may move along the tool axis in the designated direction, e.g., back away from the risky area (or performs any other predefined disengaged behavior). This backing away motion may continue for some pre-determined threshold distance or until re-engagement of the tool with the tool holder is detected. The robot may be prevented from moving in a particular direction, such as along the tool axis direction toward the patient, until the tool is fully re-engaged in the tool holder. In the case where a handle force sensor is used to detect re-engagement of the tool with the tool holder, there may be a characteristic time sequence of force values used to detect re-engagement. For example, if a D-tenting mechanism is used to hold the tool in the tool-holder, the axial force along the tool will typically rise to a characteristic value and then decrease. Subsequently, the surgeon can be instructed to pull the tool gently along the tool axis in the retraction direction, though not hard enough to disengage the tool. If the tool is properly engaged, these forces will be detected by the force sensor.

(15) With reference to FIG. 1A, the system may also include a force sensor 30 which provides forces for the force control laws. The force sensor 30 may also detect forces exerted by the surgeon on the surgical tool when a surgical tool 16 is engaged within the tool holder 14. As shown in FIG. 1A, force sensor 30 may be located between the tool holder 14 and the robot 12. Forces exerted by the surgeon on the tool handle are transmitted through the tool holder 14 to the force sensor 30. If the tool is not fully engaged in tool holder 14, then no forces in the downward z-direction along the tool shaft will be measured, but it may be possible to measure lateral forces in the other directions. In other embodiments, the force sensor 30 may be mounted in the handle 18 of the surgical tool or elsewhere.

(16) The force sensor 30 may also be used to detect if the surgical tool 16 is within the tool holder 14, or if the surgical tool 16 is held by the surgeon. That is, a single sensor 30 can sense (1) whether the surgical tool is within the tool holder; and (2) whether the surgical tool is held by the surgeon. However, two separate sensors may also be used. Alternatively, an existing force/torque sensor 30 may be used to sense when the tool is engaged in the tool holder 14 in the downward z-direction. If no downward force is detected by the sensor 30, the surgical tool 16 can be considered disengaged from the tool holder. If the only force detected by the sensor 30 is a downward force equal to the weight of the tool, then the tool may be considered engaged with the tool holder 14, but disengaged from the surgeon.

(17) It should be understood that any number of sensors (including just a single sensor) may be used to detect whether the tool is engaged in the tool holder. The information detected can then be used to determine the appropriate movement of the robot. The choice of sensors and location of sensors depends upon application and design preference.

(18) With reference FIGS. 1A and 1B, the detected values from the applied sensor(s) is/are sent to a data processor 32 for necessary processing according to features of the present invention. The data processor 32 includes a memory device 34 having a program with machine readable instructions for performing the necessary algorithms for assisting with tool exchange according to features of the present invention. The data processor 32 may be a stand-alone computer system, or could be incorporated into existing software. For example, in the context of robotic surgery, the data processor 32 could be incorporated into existing software for the cooperative surgical systems.

(19) The data processor 32 includes a program that automatically selects different movements or actions of the tool holder to be performed based upon information detected by the sensors. For example, with reference to FIG. 1A, if a sensor senses that the surgical tool 16 is docked in the tool holder 14 and senses a force that is consistent with removal of the surgical tool, the tool holder 14 is moved in a direction of the force applied along a tool axis to reengage the surgical tool 16. Preferably, the tool holder is moved with an asymmetric gain in velocity. Likewise, with reference to FIG. 1B, if the switch 40 is disengaged indicating non-use by the surgeon, the tool may be released from the tool holder 14 when the condition of non-use is sensed for a predetermined period of time.

(20) With reference to FIG. 1B, the surgical tool 16 may also include a proximity sensor 44 disposed at its tip for sensing tool to tissue distance. However, it should be understood that the proximity sensor 44 may be at other different locations, and need not be at the tool tip. Preferably, the tool to tissue distance is fed back to the data processor 32, and an appropriate action or movement may be performed in response to the detected value. For example, if the tool to tissue distance is a predetermined level indicative of non-use, the tool holder 14 may be moved to a desired standoff distance. See, e.g.,] M. Balicki, J.-H. Han, I. Iordachita, P. Gehlbach, J. Handa, R. H. Taylor, and J. Kang, Single Fiber Optical Coherence Tomography Microsurgical instruments for Computer and Robot-Assisted Retinal Surgery, in Medical Image Computing and Computer Assisted Surgery (MICCAI 2009), London, Sep. 20-24, 2009. pp. 108-115. PMID: 20425977, the entire contents of which are incorporated by reference herein.

(21) Importantly, the system and method of the present invention provides an advantage to an often slow moving cooperative robot, by increasing the speed by which the tool holder may move in the direction away from the patient.

EXAMPLE

(22) The following Example has been included to provide guidance to one of ordinary skill in the art for practicing representative embodiments of the presently disclosed subject matter. In light of the present disclosure and the general level of skill in the art, those of skill can appreciate that the following Example is intended to be exemplary only and that numerous changes, modifications, and alterations can be employed without departing from the scope of the presently disclosed subject matter. The following Example is offered by way of illustration and not by way of limitation.

(23) A variety of algorithms can be used to automatically select different movements or actions of the tool holder to be performed based upon information detected from a particular sensor. For example, if a sensor detects that the tool is disengaged then
{dot over (x)}.sub.h=F.sub.h but with {dot over (x)}.sub.hZ=(s,t)
Otherwise
{dot over (x)}.sub.h=F.sub.h F.sub.hForce/Torques resolved at the handle contact position F.sub.hZForce in handle coordinates along the Z axis {dot over (x)}.sub.hDesired handle velocity in handle coordinates Constant that translates handle input force to handle velocity. (s,t)function that generates a desired handle response based on sensor input and time.

(24) Some examples for (s,t) are provided below. For example, when the tool is disengaged, set constant velocity: (s,t)= for a short period t (after motion stops), so that the tool has moved up by a fixed amount bt. In addition, when using a proximity sensor sensing the distance s of the tool from the patient's anatomy, set (s,t)=g(s.sub.standoffs) or (s,t)=g to achieve a standoff distance s.sub.standoff. If there is a displacement or proximity sensor sensing a distance d.sub.tool of the tool from the engaged position in the tool holder, set (s,t)=gd.sub.tool to cause the tool holder to move up to fully seat the tool.

(25) The tool may be considered disengaged if F.sub.hZ=F.sub.thresh, where F.sub.thresh is some threshold force (negative for pushing down), and any of the above methods may be used to implement the desired disengaged behavior. Alternatively, the robot may be programmed to move to maintain a minimum desired tool-to-holder contact force. For example, x.sub.hZ=a(F.sub.hZF.sub.thresh) would cause the tool holder to creep slowly up if the tool handle is released.

(26) Although the present invention has been described in connection with preferred embodiments thereof, it will be appreciated by those skilled in the art that additions, deletions, modifications, and substitutions not specifically described may be made without departing from the spirit and scope of the invention as defined in the appended claims.