DISTAL FORCE SENSING IN THREE DIMENSIONS FOR ACTUATED INSTRUMENTS: DESIGN, CALIBRATION, AND FORCE COMPUTATION
20200275942 ยท 2020-09-03
Inventors
- Iulian Ioan Iordachita (Lutherville, MD, US)
- Berk Gonenc (Baltimore, MD, US)
- Russell H. Taylor (Severna Park, MD, US)
- Peter L. Gehlbach (Monkton, MD, US)
- James T. Handa (Baltimore, MD, US)
Cpc classification
A61B17/30
HUMAN NECESSITIES
A61B2090/064
HUMAN NECESSITIES
A61B2017/305
HUMAN NECESSITIES
International classification
Abstract
The present invention is directed to a device to firmly grasp and manipulate delicate tissues in microsurgery, while precisely measuring tool-tissue interaction forces in three dimensions (x-y-z). The design enables precise measurement of forces at the tool tip without being influenced by other forces that may act on the tool shaft. The device of the present invention is capable of measuring axial (z) forces together with the transverse forces (x-y) on an actuated (not static) instrument. Fiber optic sensors are embedded into strategic locations of the design to decouple and precisely detect force components (x-y-z) separately. The force information is used to provide feedback to the operator, or to a robotic platform. The exerted forces on critical tissues, such as the retina in eye surgery, can be maintained at a safe level, clinical complications due to excessive forces can be lessened, safety, and outcome of microsurgical procedures can be enhanced.
Claims
1. A device for micro surgery comprising: micro forceps; a guide tube having an outer wall defining an interior lumen, wherein the interior lumen is configured to receive the micro forceps; a first force sensor positioned at a distal end of the guide tube; and a second force sensor positioned at a distal end of the micro forceps; wherein the combination of the first and second force sensors together are configured to measure tool-tissue interaction forces in three dimensions.
2. The device of claim 1 further comprising the second force sensor being positioned axially at a center of the micro forceps and wherein the second force sensor is configured to detect tensile, axial forces.
3. The device of claim 1 further comprising the first force sensor being positioned laterally at the distal end of the guide tube and wherein the first force sensor is configured to detect transverse forces at a tip of the micro forceps.
4. The device of claim 3 wherein the first force sensor comprises three force sensors positioned laterally about the distal end of the guide tube.
5. The device of claim 1 further comprising the micro forceps having a first arm and a second arm wherein first arm is straight.
6. The device of claim 5 wherein the second force sensor is positioned on the first arm that is straight.
7. The device of claim 5 wherein the second arm comprises a bend.
8. The device of claim 7 wherein the second force sensor is positioned on the second arm that has a bend.
9. The device of claim 1 further comprising the micro forceps having a first arm and a second arm wherein both the first arm and the second arm comprise a bend.
10. The device of claim 9 wherein the second force sensor is positioned proximal to the first and second arms of the micro forceps.
11. The device of claim 9 wherein the second force sensor is positioned on one of the first arm and the second arm that comprise a bend.
12. The device of claim 1 further comprising a method for calibrating the micro forceps.
13. The device of claim 1 further comprising a motor for actuation of the device.
14. The device of claim 13 wherein the motor takes the form of a precision motor with an integrated encoder.
15. The device of claim 13 wherein an influence on the first and second sensors is modeled as a model function of a position of the motor.
16. The device of claim 15 wherein the model accounts for the frictional and elastic deformation forces at the micro forceps and guide tube interface inducing strain.
17. The device of claim 16 wherein the model accounts for strain induced on the second force sensor.
18. The device of claim 1 wherein the device is configured for vitreoretinal surgery.
19. The device of claim 19 wherein a diameter of the device is less than 0.9 mm.
20. The device of claim 12 wherein the calibration decouples the force readings (Fx, Fy, Fz) from the temperature and decouples the Fx, Fy, and Fz between them.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The accompanying drawings provide visual representations, which will be used to more fully describe the representative embodiments disclosed herein and can be used by those skilled in the art to better understand them and their inherent advantages. In these drawings, like reference numerals identify corresponding elements and:
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
DETAILED DESCRIPTION
[0031] The presently disclosed subject matter now will be described more fully hereinafter with reference to the accompanying Drawings, in which some, but not all embodiments of the inventions are shown. Like numbers refer to like elements throughout.
[0032] The presently disclosed subject matter may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Indeed, many modifications and other embodiments of the presently disclosed subject matter set forth herein will come to mind to one skilled in the art to which the presently disclosed subject matter pertains having the benefit of the teachings presented in the foregoing descriptions and the associated Drawings. Therefore, it is to be understood that the presently disclosed subject matter is not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims.
[0033] The present invention is directed to a device that can be used to firmly grasp and manipulate delicate tissues in microsurgery, meanwhile precisely measuring tool-tissue interaction forces in three dimensions (x-y-z). The design enables precise measurement of forces at the tool tip without being influenced by other forces that may act on the tool shaft (for instance, the forces at the insertion port, if the tool is inserted through an incision to reach to the operation site, as in retinal microsurgery). The device includes fiber Bragg grating (FBG) sensors in order to sense forces at the tool tip and on the tool shaft. In addition, due to the small dimensions of the optical fibers, the diameter of the sensitized tool can be maintained relatively small, and close to the diameter of the present standard surgical instrument (for eye surgery, the tool diameter is less than 1 mm as required to fit through the scleral incision). The device of the present invention is capable of measuring axial (z) forces together with the transverse forces (x-y) on an actuated (not static) instrument. Preserving the grasping functionality of a micro-forceps, fiber optic sensors are embedded into strategic locations of the design to decouple and precisely detect each force component (x-y-z) separately. The force information can be used to provide feedback to the operator, or to a robotic platform. In this way, the exerted forces on critical tissues, such as the retina in eye surgery, can be maintained at a safe level, clinical complications due to excessive forces can be lessened, safety, and outcome of microsurgical procedures can be enhanced.
[0034] More particularly, the design of the present invention, directed to micro-forceps for grasping and manipulating tissues in microsurgery, embeds fiber-optic sensors at strategic locations to capture tool-tissue interaction forces at the instrument's tip in 3 dimensions (x-y-z). Until now, static tools (such as an ophthalmic pick) were developed to capture both transverse (x-y) and axial (z) forces at the tool tip. And actuated tools (with parts in motion for tool functionality, such as a micro-forceps) were available to detect forces only in the transverse plane (x-y). The technology developed for 3-dimensional force-sensing static tools does not directly translate to actuated tools due to the structural parts in motion (such as the grasper jaws in the case of the micro-forceps). The present invention identifies two distinct configurations for actuated instruments to detect both transverse (x-y) and axial (z) forces: [0035] (1) Fibers can be integrated around the tubular tool shaft to capture transverse forces (x-y). The grasper jaws can be modified to have one arm flat. While the bent arm provides the grasping (open/close) functionality, the flat arm can be used to carry a force-sensitive fiber to capture the axial (z) loads without getting affected from the frictional and elastic deformation forces during open/close action of the forceps. [0036] (2) The transverse (x-y) force sensing remains the same, but the axial (z) force sensor can be put inside the tool shaft in the center, connected to standard grasper jaws. In this configuration, the jaws need not be modified. To reduce the frictional forces associated with the actuation of the tool, an extra trocar piece is embedded at the distal end of the tubular tool shaft. This reduces the generated frictional forces as it squeezes the grasper jaws during grasping. Therefore, the problem of hysteresis can be prevented and the axial force sensor readings can be maintained accurate. In other possible embodiments the trocar and the tool shaft could form a single piece.
[0037] The developed sensor configurations allow for a small tool diameter (0.9 mm, can be reduced to 0.63 mm to match the current standard in ophthalmic surgical tools), so that it can fit through very small openings (such as the small sclera incision in eye surgery, through which the tools are inserted to reach the retinal surface). The use of optical fibers also allows for very fine force-sensitivity. Force sensing resolutions are approximately 0.25 mN in the transverse direction and less than 2 mN in the axial direction.
[0038] The actuated tool of the present invention (in contrast to static instruments) can provide firm grasping of the tissue, which may enable dexterous and comfortable tissue manipulation with less slippage. In the case of eye surgery, for a membrane peeling task for instance, this means fewer attempts taken towards the retinal surface to initiate the membrane peel, and therefore reduced risks of injuring the retina. During tissue manipulation (while peeling the membrane off the retina surface), in case excessive and dangerous tool-tissue forces are detected, the motorized design allows automatically opening the grasper jaws and quickly releasing the grasped tissue in order to avoid deleterious force transfer to critical structures and to prevent injuries. The modular design carries all the necessary actuators and sensors, which provide an operation (grasping and force sensing) independent from site of attachment. The tool can be mounted on a manual handle, or can be easily integrated and used with robotic devices for robot-assisted surgery.
[0039] A calibration method was developed to model the effect of actuation, ambient temperature changes and decouple the effect of (x-y-z) forces on the integrated sensors. For a consistent actuation effect on the sensors, the tool is motorized (rather than manual actuation by hand), so that the factors affecting sensor readings (acceleration, velocity and relative position of parts within the moving mechanism of the actuated tool) are controlled. After the effect of actuation on sensor readings is modeled as a function of the tool's state (in case of a forceps, the open/close state of jaws), by inducing various combinations of x-y-z forces on the tool tip, the effect on each sensor can be identified at that particular state, by fitting a linear or a nonlinear model. In contrast to static tools, the sensor responses may vary according to the state of the actuated tool (jaw opening of forceps). Therefore, the decoupling of x-y-z forces is by an experimental calibration that also takes into account the tool state (based on the motor position).
[0040] The micro-forceps of the present invention include a grasping mechanism and force-sensitive elements as shown in
[0041] In order to sense the applied forces after the membrane is grasped, the design employs four FBGs (80 m by Technica, Ga., USA). Three lateral FBGs are fixed evenly around the guide tube to capture the transverse forces at the tool tip. This results in a sufficiently small tool shaft diameter of 0.9 mm. The fourth FBG is responsible for detecting the tensile axial forces while the membrane is pulled away from the retina. The location of this sensor is critical to maximize accuracy. Centrally locating this sensor inside the guide tube at the distal end of the jaws of the tool could provide the best decoupling between transverse and axial forces. In this configuration, although the sensor is positioned along the neutral axis for transverse loads and thus should sense only the axial loads, preliminary experiments have shown that the frictional and elastic deformation forces generated at the guide tube/jaw interface during tool actuation significantly degrades the response of the sensor. As a remedy, an alternative concept is also presented, where the forceps jaws are modified by flattening one arm. When the guide tube is moved up and down, the flat arm is kept straight always while the other bent arm in contact with the guide tube elastically deforms to open/close the jaws. The central FBG is fixed on the flat arm of the jaws, where the sensitive region of the fiber is maintained close to the jaw tip outside the guide tube, bypassing the undesired actuation forces at the guide tube/jaw interface.
[0042] The elastic deformation of the guide tube can be modeled as an Euler-Bernoulli beam under transverse (F.sup.tr) and axial (F.sup.ax) loading at the tool tip, inducing a linearly proportional local elastic strain on each of the attached lateral FBGs and thus a linearly proportional shift in the Bragg wavelength of each sensor. In addition, even slight variations in ambient temperature (T) may cause a drift in the Bragg wavelength. Then, the combined Bragg wavelength shift (.sub.i) for each lateral FBG (FBGs 1, 2 and 3) can be expressed as
.sub.i=C.sub.i.sup.F_trF.sup.tr+C.sup.F_axF.sup.ax+C.sup.TT, where i=1,2,3 (1)
where C.sub.i.sup.F_tr, C.sup.F_ax and C.sup.T are constants. The effect of temperature and axial load in eqn. (1) can be eliminated by subtracting the common mode from the individual wavelength shift of each sensor. The transverse force is computed using the remaining differential mode (.sub.i.sup.diff) in the linear mapping given by eqn. (2), where C.sup.tr is a coefficient matrix found by calibration.
F.sup.tr=C.sup.tr[.sub.1.sup.diff.sub.2.sup.diff.sub.3.sup.diff].sup.T (2)
[0043] For the present invention, in addition to the elastic strain due to axial load, the axial FBG (FBG 4) also experiences a bending moment induced by the transverse force at the tool tip. Furthermore, changes in ambient temperature will induce a drift in the measured Bragg wavelength. Because the axial and transverse FBGs share the same environment, the thermal drift of the axial FBG and that of the common mode of the three lateral FBGs are linearly correlated. Based upon this hypothesis, multiplying the common mode of lateral FBGs (.sup.mean) with a proper coefficient () and subtracting it from .sub.4, the effect of temperature change can be eliminated.
.sub.4.sup.diff=.sub.4.sup.mean=C.sup.axF.sup.ax+C.sub.4.sup.F_trF.sup.tr (3)
F.sup.tr is already found based upon lateral FBGs, the axial load can be computed after C.sup.ax and C.sub.4.sup.F_tr constants are identified via calibration.
F.sup.ax=(.sub.4.sup.diffC.sub.4.sup.F_trF.sup.tr)/C.sup.ax (4)
[0044] Due to the very small dimensions and imperfections in tool fabrication, it may not be possible to accurately decouple the effect of axial and lateral loads using a linear model, especially on the axial FBG. Such a linear fitting may perform well only locally, when the transverse forces are much smaller than the axial load. In order to obtain a global estimate of force, a nonlinear fitting method based on Bernstein polynomials can be used as
where the coefficients in C.sup.Bernstein can be found by applying known forces (F.sup.tr and F.sup.ax) in various directions at the tool tip and monitoring the corresponding FBG data (.sub.i*).
[0045]
[0046] The second experiment was for modeling the lateral and axial FBG response under various forces. For this, the forceps were mounted on a rotary stage and used the jaws to grasp a wire hook, as illustrated in
[0047] When the tool was held at =0, the entire loading was axial, therefore affecting only the axial FBG linearly with a slope of 0.78. This suggests C.sup.ax=0.78 pm/mN in eqn. (3). At =90, the induced force was purely transverse which caused a linear response in all FBGs. The sensitivity of the axial FBG in this orientation revealed C.sub.4.sup.F_tr=2.32 pm/mN. Based upon the slope of lateral FBG response curves, the coefficient matrix in eqn. (2) was found as C.sup.tr=[0.0342 0.089 0.0548] mN/pm. The wavelength resolution of the interrogator is 1 pm, which propagates to a transverse force resolution of 0.17 mN and an axial force resolution of 1.8 mN considering the identified coefficients for the linear method. Finally, using the entire data set of 252 measurements, the least squares problem formulated in eqn. (5) was solved to find C.sup.Bernstein. The identified coefficient provided a transverse force resolution of 0.08 mN and an axial force resolution of about 1.08 mN. The fit polynomial could estimate the transverse and axial forces in the calibration data set with mean absolute residual errors of 0.11 mN and 1.23 mN and RMS errors of 0.15 mN and 1.69 mN, respectively.
[0048] Forces ranging from 0 mN to 25 mN were applied on the tool with 5 mN intervals at 20, 40 and 70 orientations; each test was repeated 6 times, producing 108 measurements. The data set was extended by adding 15 more measurements at randomized angles (0-90) and forces (0-25 mN).
[0049] The first attempt to estimate applied force using a linear model performed well for the transverse load with an RMS error of 0.13 mN (
[0050] In accordance with the present invention, a force computation method was developed that (1) isolates the effect of tool actuation from the optical sensor readings (based on the motor position, therefore the tool state), (2) cancels out the drift in all sensor readings due to ambient temperature fluctuations (based on a common mode of sensor readings), and (3) computes the individual components of 3D forces at the tool tip in real time (using the model that corresponds to the current state of the tool, which was identified by an experimental calibration). The force computation methods can be linear or nonlinear. The design of the micro-forceps of the present invention involves (1) an actuation mechanism to open/close the forceps jaws for firmly grasping thin membranous layers and (2) four strategically embedded FBG sensors to measure forces about the x, y and z axes of the tool separately. The assigned coordinate system of the forceps is shown in
[0051] The x and y axes form the transverse plane while the z-axis lies along the tool axis. During the grasping action, the jaws elastically deform to move toward each other along the x-axis. After grasping the membrane edge, the tool is moved mostly along its z-axis and x-axis to respectively pull and peel the membrane away from the adherent inner retina surface.
[0052] In vitreoretinal surgery, membrane peeling is often performed either by using a hook or a micro-forceps. Due to the inherent grasping capability, the latter is usually considered safer and preferred by surgeons. It enables easier and more controlled removal of the membrane from the eye with less slippage of the tissue and reduced number of grasping attempts close to the retina surface. Currently a standard tool for this procedure is the disposable micro-forceps by Alcon Inc. (Fort Worth, TX), shown in
[0053] The Alcon device operates based on a squeezing mechanism. When the tool handle is compressed, the tubular tool shaft is pushed forward, and squeezes flexible jaws anchored to the back of the tool handle. When the tool handle is released a spring loaded mechanism pulls the tubular tool shaft back opening the jaws. Due to the moving parts within the mechanism during this actuation, studies have shown significant motion artifact at the tool tip, which limits tool tip positioning accuracy while trying to catch the membrane edge to begin delamination. Furthermore, such mechanical coupling between the tool handle and tip for actuation challenges the integration of the tool with many of the available systems for robot-assisted surgery as it can easily interfere with the operation of the attached robotic system. To address these issues, the design goal of the present invention has been toward devising a compact, lightweight and modular unit that can be controlled independently and remotely when necessary regardless of its site of attachment (such as a manual tool handle, a handheld micromanipulator or a teleoperated/cooperatively-controlled robot), resulting in the motorized micro-forceps shown in
[0054] The actuation of the micro-forceps of the present invention is provided by a compact (2813.27.5 mm) and lightweight (4.5 g) piezoelectric linear motor (M3-L, New Scale Technologies Inc., Victor, N.Y.) with an embedded driver and encoder providing precise position control. The normally-open, compliant jaws are standard disposable 23 Gauge micro-forceps. They are passed through a 23 Gauge stainless steel guide tube and firmly anchored to the motor body. The guide tube is attached to the shaft of the linear motor, so that when the motor is actuated, it drives the guide tube up and down along the z-axis, releasing or squeezing (thus opening or closing) the forceps jaws, as illustrated in
[0055] The exerted forces in membrane peeling are typically along the x-axis of the instrument during delamination and mostly tensile in z-axis while pulling the membrane away from the retina. Experiments in porcine cadaver eyes have shown forces mostly less than 7.5 mN. Measuring these very fine forces without adverse contribution from the sclerotomy requires locating the sensor inside the eye, hence a sensor that (1) can fit through a small incision (0.9mm) on the sclera, (2) is sterilizable and biocompatible, and (3) can provide sub-mN accuracy for transverse force measurements and predict the axial load within an accuracy less than 2 mN. Based upon these constraints, the design employs 4 FBG sensors which all have one 3 mm FBG segment with center wavelength of 1545 nm (Technica S.A., Beijing, China).
[0056] Three lateral FBGs (=80 m) are fixed evenly around the 23 Gauge guide tube using medical epoxy adhesive (Loctite 4013, Henkel, Conn.) to capture the transverse forces (F.sub.x and F.sub.y) at the tool tip, as illustrated in
[0057]
[0058] however, this is still within the travel range of the linear actuator (6 mm) and does not correspond to a significant difference in the time it takes to fully close the jaws thanks to the fast response of the actuator (>5 mm/s).
[0059] Next, the variation of the strain induced on the axial FBG during the actuation of the forceps is simulated. Since the exact value of the friction coefficient at the jaw/guide tube interface is not known, the behavior for three different coefficients (C.sub.f=0.4, 0.5 and 0.6) was analyzed considering typical steel-steel dry contact properties. Results in
[0060] In order to monitor the influence of axial forces at the tool tip, additional simulations were completed for the configuration with the trocar attachment. Forces were applied at the tip of jaws along the z-axis for various levels of jaw opening. Simulations involved forces ranging from 0 to 25 mN in increments of 5 mN. For each load condition, the motor was moved from 0 (fully open state) to 1400 m (fully closed state), and the strain on the axial FBG sensor was recorded at each 100 m step. After subtracting the previously identified actuation-induced strain component for each motor position (
[0061] In order to transform the optical wavelength information from each embedded sensor to axial and transverse force values, the force computation algorithm summarized in
[0062] As discussed above, the FBG sensors in the present invention are bonded to parts that move during the actuation of the forceps, i.e. opening/closing the jaws induces undesired drift in sensor readings. Since the actuation is performed by a precision motor with an integrated encoder, the deformation and resulting reaction forces during actuation are highly repeatable, and the influence on each FBG sensor can be modeled as a function of the motor position. This model accounts for the frictional and elastic deformation forces at the jaw/guide tube interface inducing strain especially on the axial FBG. The effect of actuation on lateral FBGs are presumably minor because the lateral FBGs are mostly sensitive to the transverse deformations, which ideally do not take place assuming perfectly aligned parts and purely linear translation of the guide tube. Furthermore, apart from the material and dimensions of the forceps structure, the model may vary depending upon the medium in which the forceps is being operated (air, water, etc.) as the coefficient of friction at the jaw/guide tube interface may change.
[0063] During the actual use of the micro-forceps, based on the identified actuation model and sensed motor position, the readings from each FBG sensor are corrected, simply by subtracting the estimated Bragg wavelength shift due to actuation. Although the temperature in patients' eyeballs is fairly constant, FBG sensors are typically very sensitive to temperature changes (approximately 10 m/ C.). Hence, force sensing robustness against small thermal fluctuations is a desired feature. After the actuation effect correction, the drift due to thermal changes based on the common mode of lateral FBGs is cancelled out, which tool tip forces from will be further detailed in the remainder of this section. To compute the corrected and temperature compensated sensor readings, two distinct methods are described: (1) a linear method based on ideal decoupling of transverse and axial forces, (2) a nonlinear regression based on Bernstein polynomials.
[0064] Assuming small elastic deformations, the guide tube can be modeled as an Euler-Bernoulli beam under transverse (F.sub.x and F.sub.y) and axial (F.sub.z) loading at the tool tip, inducing a linearly proportional local elastic strain on each lateral FBG and thus a linearly proportional shift in the Bragg wavelength of each sensor. In addition, even slight variations in ambient temperature (T) may cause a drift in the Bragg wavelength. Then, the combined Bragg wavelength shift (.sub.i) for each lateral FBG sensor (FBGs 1, 2 and 3) can be expressed as
.sub.i=C.sub.i.sup.F_xF.sub.x+C.sub.i.sup.F_yF.sub.y+C.sub.i.sup.F_zF.sub.z+C.sup.TT, i=1,2,3 (6)
where C.sub.i.sup.F_x, C.sub.i.sup.F_y, C.sub.i.sup.F_z and C.sub.i.sup.T are constants associated with the x, y, z forces and the temperature change, respectively. Since the lateral FBGs are closely located within the same ambient, ideally, they are equally affected from the axial load (C.sub.1.sup.F_z=C.sub.2.sup.F_z=C.sub.3.sup.F_z=C.sup.F_z) and the temperature variation (C.sub.1.sup.T=C.sub.2.sup.T=C.sub.3.sup.T=C.sup.T). When the mean Bragg wavelength shift in all three lateral sensors is computed, due to axisymmetric distribution of lateral FBGs around the guide tube (120 apart from each other as shown in
.sup.mean=C.sup.F_zF.sub.z+C.sup.TT (7)
The effect of temperature change and axial force in sensor readings can be eliminated by subtracting the common mode from Bragg wavelength shift of each sensor.
.sub.i.sup.diff=.sub.i.sup.mean=C.sub.i.sup.F_xF.sub.x+C.sub.i.sup.F_yF.sub.y, i=1,2,3 (8)
[0065] The remaining differential mode of each sensor (.sub.i.sup.diff) can then be used in the following equation to compute the transverse forces:
F.sup.tr=[F.sub.xF.sub.y].sup.T=C.sup.tr[.sub.1.sup.diff.sub.2.sup.diff.sub.3.sup.diff].sup.T (9)
[0066] where C.sup.tr is a 23 coefficient matrix which represents the linear mapping from optical sensor readings to the force domain, and will be found via a calibration procedure.
[0067] In the design of the present invention, the axial FBG (FBG 4) lies along the tool axis ideally centered inside the guide tube, which would result in an ideal decoupling of transverse and axial loads, i.e. an axial FBG response immune to F.sub.x and F.sub.y, sensing purely F.sub.z. However, due to the very small dimensions and imperfections resulting from tool assembly, this condition is very hard to achieve. Even if the axial FBG is slightly off-centered, besides the elastic strain due to F.sub.z, the axial FBG will experience a bending moment due to F.sub.x and F.sub.y. In addition, excessive off-centered loading at the tool tip may also induce torsion on the axial fiber and deteriorate the FBG response, which will be negligible considering the targeted force range (0-25 mN) and the small tool diameter (0.9 mm). Furthermore, changes in ambient temperature will induce a drift in the measured Bragg wavelength. Assuming all aforementioned sources of strain contribute linearly to the axial sensor reading, the total wavelength shift observed in FBG can be formulated as
.sub.4=C.sub.4.sup.F_xF.sub.x+C.sub.4.sup.F_yF.sub.y+C.sub.4.sup.F_zF.sub.z+C.sub.4.sup.TT (10)
where C.sub.4.sup.F_x, C.sub.4.sup.F_y, C.sub.4.sup.F_z and C.sub.4.sup.T are constants associated with F.sub.x, F.sub.y, F.sub.z and temperature change, respectively. Since the axial and lateral FBGs share the same environment, the thermal drift of the axial FBG and that of the common mode of the three lateral FBGs are linearly correlated (C.sub.4.sup.T=C.sup.T), which will be experimentally verified herein.
.sub.4=C.sub.4.sup.F_xF.sub.x+C.sub.4.sup.F_yF.sub.y+C.sub.4.sup.F_zF.sub.z+C.sup.TT (11)
Based upon this hypothesis, by multiplying the common mode of lateral FBGs with a proper coefficient () and subtracting it from .sub.4, the effect of temperature change can be eliminated.
.sub.4.sup.diff=.sub.4.sup.mean=C.sub.4.sup.F.sup.
Using the linear relationship previously found for the transverse forces and rearranging the terms, the axial force can be expressed as a linear combination of each sensor's differential mode
F.sub.z=C.sup.ax[.sub.1.sup.diff.sub.2.sup.diff.sub.3.sup.diff.sub.4.sup.diff].sup.T (13)
where C.sup.ax is a 14 coefficient vector which will be identified via a calibration procedure described further herein.
[0068] Due to the very small dimensions and imperfections in tool fabrication, it may not be possible to accurately decouple the effect of axial and lateral loads using a linear model, especially on the axial FBG. Such a linear fitting may perform well only locally, when the transverse forces are much smaller than the axial load, which is hard to guarantee in epiretinal membrane peeling procedure. In order to obtain a global estimate of force, a nonlinear fitting method based on Bernstein polynomials, as demonstrated earlier for a 3-DOF force-sensing pick tool, can be used:
[F.sub.xF.sub.yF.sub.z]=.sub.j=0.sup.n.sub.k=0.sup.n.sub.l=0.sup.n.sub.m=0.sup.nc.sub.jklmb.sub.j,n(*.sub.1)b.sub.k,n(*.sub.2)b.sub.l,n(*.sub.3)b.sub.m,n(*.sub.4) (14)
[0069] where c.sub.jklm denotes constant coefficients and *.sub.i denotes the differential mode (thermal drift eliminated response as described by equations (3) and (7)) of each FBG scaled down to [0,1] intervalsince Bernstein polynomials exhibit good numerical stability within this range [51]using the following equation:
b.sub.v,n(*.sub.i) terms in equation (10) are the Bernstein basis polynomials of order n defined as follows:
[0070] In the approach of the present invention, in order to avoid overfitting with a reasonable sample size, a 2n.sup.d order regression is used by setting n=2 and defining
B.sub.jklm=b.sub.j,2(*.sub.1)b.sub.k,2(*.sub.2)b.sub.l,2(*.sub.3)b.sub.m,2(*.sub.4) (17)
Then, equation (9) can be rearranged as
[F.sub.xF.sub.yF.sub.z]=.sub.i=0.sup.2.sub.j=0.sup.2.sub.k=0.sup.2.sub.l=0.sup.2B.sub.ijklc.sub.ijkl=BC.sup.Bernstein (18)
where B is a 181 row vector formed by the product of Bernstein basis polynomials and C.sup.Bernstein is a 813 constant matrix. The coefficients in C.sup.Bernstein can be found by applying known forces (F.sub.x, F.sub.y and F.sub.z) in various directions at the tool tip, acquiring FBG wavelength data and forming a B vector for each recorded sample, and finding the best fit in the least-squares sense.
[0071]
[0072] Using the setup shown in
F.sub.x=F.sub.loadcos sin (19)
F.sub.y=F.sub.loadsin sin (20)
F.sub.z=F.sub.loadcos (21)
[0073] The goal of this experiment was to generate a model for compensating the detrimental effect of grasping motion on the FBG sensors. For this, the linear motor of the micro-forceps was actuated back and forth in discrete steps of 100 m, and gradually opening/closing the forceps jaws. The jaws were fully closed after the motor was driven about 1400 m forward from the fully open state, which is consistent with the simulation results previously presented in
[0074]
[0075] Results in
[0076] This experiment explored the consistency of the FBG sensor readings in response to axial and transverse loads. Forces were applied at the tool tip in 28 different directions by orienting the tool at 4 roll () and 7 pitch () angles. The roll angle ranged from 0 to 90 with 30 increments while the pitch angle was altered from 0 to 90 in steps of 15 . The magnitude of applied forces varied evenly at 6 levels within 0-23.35 mN. For each direction, the forcing was gradually increased up to 23.35 mN and then decremented back to zero by unloading the washers at the tool tip. The wavelength information from all four FBGs was acquired after the oscillations due to loading/unloading were fully damped out. This cycle was repeated 3 times, generating 6 measurements for each load case. For each measurement, 500 samples were recorded. As an example,
[0077] The log data involved a total of 168 distinct loading conditions, 1008 measurements and 504,000 samples. To examine the repeatability of each sensor's response, the recorded samples were grouped into 168 subsets so that each subset contained 3000 samples associated with the same loading condition. Within each subset, after identifying the mean Bragg wavelength shift for each FBG sensor, the deviations from the mean value (residuals) were computed. The residuals of all subsets were then combined to obtain the standard deviation for each FBG sensor as a measure of repeatability.
[0078]
[0079] In order to identify the coefficients used in the force computation algorithm of the present invention, a set of calibration experiments was performed. The goal in the first calibration experiment was to test the hypothesis of linear correlation between the temperature drift in common mode of lateral FBGs and the axial FBG. The Bragg wavelength variation was recorded in each FBG sensor while the tool was exposed to routine changes in room temperature, which involved gradual changes within 2.5 C. In order to avoid disturbances due to air flow in the room, the setup was maintained inside a plastic box while acquiring data. The test was completed in 4 sessions; each session spanned a 225 minute period during which a measurement was taken in every 15 minutes. In between the sessions, the roll and pitch angles were altered to capture the effect of tool orientation on the thermal drift coefficient, if any.
[0080]
[0081] The results are shown in
[0082] The second calibration experiment was aimed at monitoring the FBG response under various combinations of transverse and axial forces. In order to collect sufficient data with a fine enough sampling grid, 504,000 samples of log data with 6 levels of forcing in 28 different directions were taken and 4 additional analyses performed: global linear calibration, local linear calibration, global nonlinear calibration, and local nonlinear calibration.
[0083] After computing the differential mode of each sensor, the linear system of equations was formed and solved by using the method of least squares. The resulting coefficient matrix for the transverse forces in equation (9) was
[0084]
[0085] Considering the wavelength resolution of the optical sensing interrogator (1 pm) and the identified coefficient matrix, the linear method produces a transverse force resolution of about 0.14 mN, which is within the initial design target of 0.25 mN. The linear fitting results are shown in
[0086] Solving the system of equations given by (13), an adequately accurate fitting was not identified to estimate the axial load. The resulting coefficient C.sup.ax led to very large errors (an rms error of 8.34 mN, a mean absolute error of 6.19 mN, and a standard deviation of 3.87 mN) especially in the presence of significant transverse loads in addition to axial forces.
[0087] In membrane peeling, forces applied in the transverse plane are mostly along the peeling direction, which corresponds to the x-axis of the tool. Previous membrane peeling experiments on various types of artificial phantom also support that transverse loads containing large F.sub.y (associated with >30) are not very likely in practical use of the micro-forceps. In an attempt to find a more accurate linear fitting for the axial force, a subset of the calibration data associated with 30 is analyzed. However, limiting a and hence F.sub.y alone did not lead to any significant improvement in axial force sensing accuracy. The rms error in estimated F.sub.z was still 7.08 mN and the mean absolute error was 5.41 mN. Next, a smaller subset is considered limiting both the pitch (<15) and roll (30) angles so that both of the transverse force components were constrained (F.sub.x<6.04 mN and F.sub.y<3.02 mN), and the applied forces were dominantly axial. For this subset of 72,000 samples, it was possible to obtain
which indicates an axial force resolution of about 1.32 mN.
[0088]
[0089] Using the entire log data of 504,000 samples, a nonlinear regression model based on 2.sup.nd order Bernstein polynomials is fit to better estimate both the transverse and axial forces. The obtained coefficient vector C.sup.Bernstein derives a resolution of 0.074 mN for F.sub.x and F.sub.y, and 1.85 mN for F.sub.z, respectively. The accuracy in computing the transverse forces are slightly better than the linear method with an rms error of 0.15 mN for F.sub.x and 0.25 mN for F.sub.y. More importantly, the axial force estimation is significantly improved in comparison to the global linear fitting results. The residual error spans approximately 4.33 mN while the mean absolute error is 3.34 mN. Although the results displayed in
[0090]
[0091] Considering that forces associated with large F.sub.y forces are not very probable during an actual membrane peeling operation as discussed previously, the nonlinear calibration method was repeated using a reduced dataset (30), without limiting F.sub.x (0-23.35 mN) which is expectedly the dominant force component along the peeling direction but constraining F.sub.y below 11.7 mN. This corresponds to a dataset of 252,000 samples with 84 distinct loading conditions. The regression analysis revealed a coefficient vector (C.sup.Bernstein) providing a finer force resolution in comparison to all of the previous fittings: 0.01 mN for F.sub.x and F.sub.y and 0.38 mN for F.sub.z. The resulting force estimates and associated errors are plotted in
[0092] For validating the performance of the nonlinear force computation method, measurements were taken at loading conditions that were not used during the calibration, still limiting the transverse loads to the range of interest in membrane peeling, i.e. a<30 . The validation experiment consisted of forces ranging from 0 mN to 23.35 mN in increments of 4.67 mN, while holding the tool at 2 different roll angles (=0, 30) and 3 different pitch angles (=20,40,70). Each case was repeated 6 times and 500 samples were collected per case. The data set was further extended by adding 15 more measurements per each roll angle at randomized pitch angles (0-90) and forces (0-23.35 mN), producing a total of 66 distinct loading conditions and 123,000 samples. Using a validation dataset, a similar force computation performance to what was obtained with the calibration dataset was computed.
[0093] The locally fit nonlinear model is able to accurately predict the applied transverse forces within the considered force range, 0-25 mN for F.sub.x and 0-11.7 mN for F.sub.y. The rms errors are 0.16 mN and 0.07 mN for F.sub.x and F.sub.y, respectively. The axial forces are captured with an rms error of 1.68 mN, which is satisfactorily smaller than the design target of 2 mN. The standard deviation of errors indicate a force sensing repeatability of 0.15 mN, 0.07 mN and 1.67 mN about x, y and z axes, respectively. These results demonstrate that the 3-DOF force-sensing micro-forceps with the nonlinear force computation method can provide measurements within the desired sensitivity and accuracy.
[0094] The earlier works demonstrated that the temperature compensation method described herein provides robust transverse and axial force measurements against thermal changes for other tools. The first set of the calibration experiments explored the thermal influence on each FBG sensor output in response to slow and gradual ambient temperature variation. In case of sudden ambient temperature variations though, such as the instant when the tool is inserted into the eye, whether the linear correlation between the axial sensor response and the common mode of lateral sensors is valid remains controversial. In practice, this issue can be alleviated by rebiasing the force sensor to adapt to the new temperature level right after the tool is placed inside the eyeball. After this time, the expected thermal fluctuations inside the eye will be relatively small and gradual so that the thermal drift method cancelling based on common mode of lateral sensors can be used. There are several potential solutions that can improve the robustness of the force-sensing tool to thermal changes: adding a separate reference FBG, using two different wavelengths, or using different optical modes.
[0095] In order to compute forces from the optical sensor information, the use of a nonlinear fitting based on second order Bernstein polynomials was explored. Increasing the polynomial order may potentially improve the sensing accuracy, especially in the axial direction. However, identifying a higher order polynomial without overfitting requires calibration experiments that capture the FBG sensor outputs for a finer grid of forces. Such extensive dataset is quite challenging to acquire with the presented setup. Furthermore, the manual operation of rotary stages and loading/unloading of washers to modulate the loading induced at the tool tip is prone to human error. However, using a robotic calibration approach similar to, it is possible to collect more samples reliably in a shorter time and identify a more accurate higher order nonlinear force computation model.
[0096] In the calibration and validation experiments, the applied forces in the axial direction were always tensile. Therefore, the identified models do not describe the behavior for compressive loads. In addition, the final accuracy and resolution values were obtained for a limited force range of 0-25 mN with minor force component perpendicular to the peeling direction (F.sub.y<11.7 mN). Although, these may be interpreted as limitations of the approach, they are highly relevant to the actual clinical scenario. In epiretinal membrane peeling, to avoid retinal injuries, the magnitude of forces need to be maintained typically below 10 mN. Also, the membrane is pulled away from the retina surface, which causes axial loads on the micro-forceps tip to be tensile if any. The exerted forces in the transverse plane follow the direction of tool motion, which means they are usually along the opening/closing direction of the jaws (x-axis of the tool). These practical facts support the constraints of the force computation model for epiretinal membrane peeling. Nevertheless, using the same experimental method, the instrument can be calibrated to the desired force domain for a different application as well.
[0097] Based on the practically relevant force ranges, using the nonlinear method showed that the rms error in axial force sensing could be lowered under 2 mN. This is a significant improvement on the previously reported results, and is presumably useful for limiting intra-operative forces and preventing retinal injuries in epiretinal membrane peeling. Nevertheless, for other aimsincluding quantitative assessment of differing surgical techniques, objective evaluation of the surgical performance and accurate modeling of retinal tissuesfuture work aims to further improve the axial sensing accuracy. Some potential methods include using higher order nonlinear models for force computation, and exploring customized sensor architectures that provide better decoupling between axial and transverse forces.
[0098] The present invention includes a novel force-sensing micro-forceps that can capture 3-DOF tool-tissue interaction forces during membrane peeling in vitreoretinal surgery. This is the first micro-forceps that can sense not only transverse but also the axial forces at the tool tip to be used in vitreoretinal surgery. Main contributions are the calibration procedure and force computation methodology using FBG sensor readings influenced by a mixture of sources, such as thermal changes and tool actuation apart from tool tip forces. In design, the sensitized segment of the instrument was located close to tool apex inside of the eye so that tool-tissue interaction forces at the tool tip could be detected without the influence of any other forces along the tool shaft. By strategically embedding 4 FBG sensors on the tool shaft, the decoupling between transverse and axial forces was maximized. The grasping functionality was provided via a compact motorized unit which enabled tool actuation without requiring any mechanically coupled handle mechanism in contrast to the existing standard micro-forceps and ensured a highly repeatable behavior in FBG sensor outputs during actuation. Through experiments inside air and water, the actuation influence on sensor outputs was determined as a function of motor position. The resulting model was later used to cancel out the undesired influence on the sensors due to tool actuation. Experiments were carried out to test the repeatability of sensor outputs, calibrate the force sensor and validate its performance. For computation of forces, two distinct methods were explored: a linear regression and a nonlinear fitting based on second-order Bernstein polynomials. Results showed that the FBG sensors provide a highly repeatable output, and the nonlinear force computation approach provides superior accuracy. Based upon the developed calibration and force computation methods, future studies aim at optimization of the tool structure and fabrication process to improve the force sensing accuracy.
[0099] This work modeled and evaluated the force response of the tool of the present invention based upon static measurements, where samples were acquired after the response of each sensor reached steady-state. The dynamic response of the tool and its performance in estimating rapidly changing force profiles will be explored in future experiments. In addition, the micro-forceps was devised as a modular unit so that it can be easily combined with robotic systems. Future work aims at integrating the tool with a robotic assistant by combining motion compensation and image-guidance features with various force feedback and force control methods to aid safe grasping and peeling of epiretinal membranes. Upon system integration, feasibility studies will be performed initially on artificial membrane peeling phantoms, then on biological membranes, and eventually using ex vivo and in vivo animal models.
[0100] The control of the present invention can be carried out using a computer, non-transitory computer readable medium, or alternately a computing device or non-transitory computer readable medium incorporated into the robotic device.
[0101] A non-transitory computer readable medium is understood to mean any article of manufacture that can be read by a computer. Such non-transitory computer readable media includes, but is not limited to, magnetic media, such as a floppy disk, flexible disk, hard disk, reel-to-reel tape, cartridge tape, cassette tape or cards, optical media such as CD-ROM, writable compact disc, magneto-optical media in disc, tape or card form, and paper media, such as punched cards and paper tape. The computing device can be a special computer designed specifically for this purpose. The computing device can be unique to the present invention and designed specifically to carry out the method of the present invention. The operating console for the device is a non-generic computer specifically designed by the manufacturer. It is not a standard business or personal computer that can be purchased at a local store. Additionally, the console computer can carry out communications through the execution of proprietary custom built software that is designed and written by the manufacturer for the computer hardware to specifically operate the hardware.
[0102] The many features and advantages of the invention are apparent from the detailed specification, and thus, it is intended by the appended claims to cover all such features and advantages of the invention which fall within the true spirit and scope of the invention. Further, since numerous modifications and variations will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention. While exemplary embodiments are provided herein, these examples are not meant to be considered limiting. The examples are provided merely as a way to illustrate the present invention. Any suitable implementation of the present invention known to or conceivable by one of skill in the art could also be used.