Robot for use with orthopaedic inserts
09872733 ยท 2018-01-23
Assignee
Inventors
- Moshe Shoham (Hoshaya, IL)
- Leo Joskowicz (Jerusalem, IL)
- Charles Milgrom (Jerusalem, IL)
- Ziv Yaniv (Jerusalem, IL)
- Ariel Simkin (Jerusalem, IL)
Cpc classification
A61B17/1725
HUMAN NECESSITIES
G05B2219/49113
PHYSICS
Y10S128/923
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10S128/908
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
G05B19/402
PHYSICS
G05B2219/39011
PHYSICS
A61B34/70
HUMAN NECESSITIES
A61B17/1721
HUMAN NECESSITIES
A61B90/11
HUMAN NECESSITIES
A61B2034/304
HUMAN NECESSITIES
G05B2219/40267
PHYSICS
Y10S128/922
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
A61B2017/681
HUMAN NECESSITIES
A61B34/10
HUMAN NECESSITIES
International classification
A61B17/17
HUMAN NECESSITIES
G05B19/402
PHYSICS
A61B34/00
HUMAN NECESSITIES
Abstract
A robot-guided system to assist orthopedic surgeons in performing orthopedic surgical procedures on pre-positioned inserts, including for the fixation of bone fractures, and especially for use in long bone distal intramedullary locking procedures. The system provides a mechanical guide for drilling the holes for distal screws in intramedullary nailing surgery. The drill guide is automatically positioned by the robot relative to the distal locking nail holes, using data derived from only a small number of X-ray fluoroscopic images. The system allows the performance of the locking procedure without trial and error, thus enabling the procedure to be successfully performed by less experienced surgeons, reduces exposure of patient and operating room personnel to radiation, shortens the intra-operative time, and thus reduces post-operative complications.
Claims
1. A surgical system comprising: an orthopaedic insert having at least one predrilled hole for attaching said insert to a bone; a drill guiding plate carried by a robot which is mounted in a fixed position relative to said bone, said guiding plate having at least one hole to enable guiding a drill into said bone and through said at least one predrilled hole; and a control system which utilizes data from at least one image generated during said surgery to instruct said robot to align the axis of said at least one hole defined by said drill guiding plate essentially colinearly with the axis of said at least one predrilled hole defined by said insert.
2. A surgical system according to claim 1 wherein said drill guiding plate comprises a plurality of fiducial markers disposed in a predetermined pattern, to enable said robot to align said drill guiding plate into a fronto-parallel orientation in said at least one image.
3. A surgical system according to claim 1, wherein said at least one image is generated at an alignment such that said at least one target hole has a minimum elliptic shape in said at least one image.
4. A surgical system according to claim 1, and wherein said at least one image is generated at an alignment such that said at least one predrilled hole is imaged in a fronto-parallel orientation.
5. A surgical system according to claim 1, and wherein said at least one image is generated at an alignment such that said at least one predrilled hole has a minimum elliptic shape in said at least one image.
6. A surgical system according to claim 1 and wherein said control system aligns said guiding plate by utilizing data from only one image of said imaging system.
7. A surgical system according to claim 1 and wherein said robot is mounted either directly on said bone or is attached to said insert associated with said bone.
8. A surgical system according to claim 1 and wherein said robot maintains its position relative to said bone such that tracking of said bone position or immobilization of said bone is obviated.
9. A surgical system according to claim 1 and wherein said bone is a long bone, and said orthopaedic insert is an intramedullary nail, and said at least one predrilled hole is a distal locking hole.
10. A surgical system according to claim 9 and wherein said robot is attached either directly to said bone or to the proximal end of said intramedullary nail.
11. A surgical system according to claim 1 and wherein said orthopaedic insert is an externally attached connector plate, and said at least one predrilled hole is a connecting hole.
12. A surgical system according to claim 11 and wherein said bone is a femur, and said connector plate is a percutaneous compression plate, and said connecting hole accommodates a screw for connecting said plate to the shaft of said femur or a fractured head of said femur to its shaft.
13. A surgical system comprising: an orthopaedic insert having at least one predrilled hole for attaching said insert to a bone; a drill guiding plate having a plurality of fiducial markers disposed in a predetermined pattern, and attached to a robot which is mounted in a fixed position relative to said bone, said guiding plate having at least one hole for guiding a drill into said bone and through said at least one predrilled hole; and a control system which utilizes data obtained from the positions of at least some of said plurality of fiducial markers in at least one image generated during said surgery, to instruct said robot to align said drill guiding plate in a fronto-parallel orientation.
14. A surgical system according to claim 13, and wherein said at least one image is generated at an alignment such that said at least one predrilled hole is imaged in a fronto-parallel orientation.
15. A surgical system according to claim 13, wherein said control system is further configured to utilize data obtained from said at least one image to instruct said robot to align the axis of said at least one hole defined by said drill guiding plate essentially colinearly with the axis of said at least one predrilled hole defined by said insert.
16. A surgical system according to claim 13, wherein said at least one image is generated at an alignment such that said at least one predrilled hole has a minimum elliptic shape in said at least one image.
17. A surgical system according to claim 13, wherein said at least one image is generated at an alignment such that said at least one target hole has a minimum elliptic shape in said at least one image.
18. A surgical system according to claim 13, wherein said robot is mounted either directly on said bone or is attached to said insert associated with said bone.
19. A surgical system according to claim 13 and wherein said robot maintains its position relative to said bone such that tracking of said bone position or immobilization of said bone is obviated.
20. A surgical system according to claim 13, wherein said control system is further configured to utilize data obtained from said at least one image to instruct said robot to translate said target guide laterally so that the positions in said at least one image of the axes of at least one hole for guiding a drill and of at least one predrilled hole coincide.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
(12) Reference is first made to
(13) In performing the procedure, the surgeon first reduces the fracture by manipulating the proximal and distal bone fragments through the leg 12 until they are aligned. The surgeon then inserts a guide wire, reams the canal if necessary, and drives in the nail 14. The surgeon then drills the appropriate distal locking nail holes in the bone, opposite the pre-prepared holes 16, 18 in the nail, and inserts lateral proximal and distal interlocking screws 20, 22, to prevent fragment rotation and bone shortening. In
(14) Reference is now made to
(15) In
(16) The robot carries a guiding assembly, which preferably comprises three components, an adjustable slide head 33, a connecting block 38, and a targeting drill guide 36. The slide head 33 is mounted directly on top of the robot. Its location along the bone long axis can be manually adjusted over a range of typically up to 50 mm., to one of several predetermined positions, as defined by positioning pins and holes in the members of the slide, depending on the application envisaged. The use of predetermined positions is necessary in order to maintain a known predefined registration between the robot frame of reference and the position of the drilling guide hole axes. The pin position selected must be input to the control system so that the actual registration selected is used in the subsequent position calculations. The connecting block 38 and the targeting drill guide 36, are made of radiolucent plastic, since they are visible in the X-ray fluoroscopic images to be taken of the drilling area. The targeting drill guide 38 is preferably in the form of a 405520 mm block, and in the preferred example shown, has two drill guide holes 40, 42, disposed with their axes 30 mm apart, which are predetermined to correspond to the spacing between the centers of the distal locking nail holes. The targeting drill guide 38 is parallel to the robot base 34, and close to the skin of the leg of the patient. The drilling guide has predetermined patterns of fiducial markers that are used for determining its spatial and angular localization in the X-ray fluoroscopic images. In the preferred embodiment shown in
(17) There are several methods of mounting the robot on the bone. In the preferred embodiment shown in
(18) Reference is now made to
(19) Reference is now made to
(20) Reference is now made to
(21) An image calibration ring 56, such as of the type used in calibration and prior art tracking systems, is preferably attached with clamps to the C-arm image intensifier, and according to a preferred embodiment, has two parallel radiolucent plate targets, spaced 76 mm apart, with 120 embedded fiducial steel balls of 2 mm and 3 mm diameter, arranged in a predetermined asymmetrical pattern. Any suitable pattern which allows for the performance of accurate calibration and registration procedures may preferably be used.
(22) Reference is now made to
(23) An outline of a preferred surgical protocol, and system operational procedure to perform it, is as follows. Once the fracture has been reduced and the nail 14 has been inserted to its desired position, the image calibration ring 56 is mounted on the fluoroscopic C-arm image intensifier 55, as shown in
(24) The controller moves the robot according to this computed transformation, and locks the robot with the targeting drill guide holes co-linear with the nail holes. The surgeon then preferably inserts a K-wire in each drill guide hole, and verifies with a new pair of X-ray fluoroscopic images their correct alignment with respect to the distal locking nail hole centers. The surgeon proceeds to drill the screw holes, removes the robot base from its mounting screws, fastens the lateral locking screws into the newly drilled holes, such that they pass exactly through the distal locking nail holes and firmly lock the intramedullary nail to the bone, and then completes the surgery according to the standard protocol.
(25) The preferred procedure described above requires the accurate registration of the targeting drill guide axes with the distal locking nail hole axes, by means of image processing of the X-ray fluoroscopic images obtained, and the use of registration algorithms to define the mutual spatial relation between the targeting drill guide and the locking nail holes. The registration procedure preferably uses spherical fiducial markers, as their centers can readily be located accurately by well-known image processing techniques. The algorithm preferably provides a registration error estimate and notifies the surgeon when the registration cannot be performed because of poor image quality or because of an excessive number of fiducial occlusions.
(26) Reference is now made to
(27) In order to achieve this accuracy, according to a further preferred embodiment of the present invention, a model-based method generally consisting of four main steps is used:
(28) (a) X-ray fluoroscopic image distortion correction and camera calibration;
(29) (b) targeting drill guide localization;
(30) (c) distal locking nail hole axes localization; and
(31) (d) registration.
(32) It is to be understood that even though the model-based method is described below as applied to the orthopaedic system described in the preferred embodiments of the present invention, the method is generally applicable to any imaging system application, whether medical, industrial or scientific, where a predefined feature of an image of a target must be made to coincide with a similar predefined feature in an image of a target guide. One common application of such a system is when the predefined features are holes, and the system is utilized for the lining up of a target guide hole in an image, with a hole in an image of the intended target itself. A computing system for performing such a lining-up procedure is described in
(33) Modern C-arm X-ray fluoroscopic imaging systems are often provided with a built-in distortion correction and calibration capability, such that step (a) of this preferred method may be optionally pre-supplied by such a system.
(34) A brief description of each step follows.
(35) (a) Distortion Correction and Camera Calibration.
(36) A robust automatic C-arm calibration algorithm is provided that includes fiducial localization, distortion correction and camera calibration. The algorithm has been described in the article by H. Livyatan, et al., entitled Robust automatic C-arm calibration for fluoroscopy-based navigation: a practical approach, in the Proceedings of the 5th International Conference on Medical Image Computing and Computer-Aided Intervention, MICCAI 2002, October 2002, Tokyo, Japan, Elsevier Science Publishers, Amsterdam. This novel algorithm computes the distortion correction and camera calibration parameters from an X-ray fluoroscopic image in three steps: (i) The algorithm first locates the projections of the image calibration ring fiducials and pairs them with their known spatial location in the pattern; (ii) the distortion correction parameters are next computed; and (iii) finally the calibration parameters themselves are computed.
Accurate and robust localization of the fiducials and their pattern is an important step, since all other parameters depend on it to provide accuracy. Use of this algorithm allows the attainment of submillimetric accuracy for the combined dewarping and camera calibration, even when only some of the fiducials are detected.
(b) Targeting Drill Guide Localization.
(37) Reference is now made to
(38) Targeting drill guide localization is performed by identifying the fiducials 60 and the pattern 64 which they form. In this preferred embodiment of the present invention, the targeting drill guide contains 28 spherical metal balls of 2 mm diameter, asymmetrically distributed in the form of an A, disposed on two parallel planes 20 mm apart, one in the top surface of the targeting drill guide and the other in the bottom surface. The targeting drill guide pattern preferably used for the registration procedure consists of two orthogonal pairs of parallel lines 64. Since the fiducials are spheres, they appear as circles in the fluoroscopic image. The white dots inside the spheres show the localization of their centers. However, some of the spheres might be occluded, since the dewarping and calibration fiducials 62 and the nail 14 are also present in the image. Using the localization algorithm of the present invention, three fiducials per line are sufficient to determine the location of the line with an accuracy sufficient to meet the above-mentioned requirements for the determination of the position of the drill guide holes.
(39) The localization algorithm, according to this preferred embodiment of the present invention uses the following four steps:
(40) (i) Salient circles are detected using the Hough transform, and a circle template is inferred from them.
(41) (ii) A new image is generated, comprising the original image from which the fiducials have been morphologically removed.
(42) (iii) The Normalized Cross Correlation (NCC) value, also known as the Pearson correlation coefficient, of the circle templates at pixel locations with negative values, is computed, to determine the centers of the fiducial spheres. This procedure is well known, such as is described in Chapter 12 of the book Digital Image Processing, by R. C. Gonzalez and R. E. Woods, Prentice Hall, 2002. Since the fiducials appear darker than the background, these locations constitute possible locations for the fiducials.
(43) (iv) A search for fiducials is conducted in a small area around the local maxima of the NCC, using one of the methods known in the art, such as, for example, the detection and characterization technique described by H. J. Noordmans H. J. et al., in the article Detection and characterization of isolated and over-lapping spots, published in Computer Vision and Image Understanding, Vol. 70(1), 1998. This procedure enables detection of most of the fiducials, including those with partial occlusions, but not those totally occluded. The major and minor axes of the targeting drill guide pattern are then determined from the fiducial locations, preferably using Principal Component Analysis (PCA), or any other suitable calculation routine.
(44) (c) Distal Locking Nail Holes' Axes Localization
(45) Reference is now made to
(46) The location of the distal locking nail holes in the X-ray fluoroscopic image is preferably determined by first locating the longitudinal contours 66 of the nail, and then locating the holes from their expected position with respect to the contour. To locate the nail longitudinal contours 66, according to a preferred embodiment of the present invention, the Canny edge detector with sub-pixel edge localization, such as that described by F. Devernay, in A Non-maxima suppression method for edge detection with sub-pixel accuracy, INRIA Research Report No. 2724, Sophia-Antipolis, France, November 1995, is applied to the image. A 3-D Hough transform is then preferably applied to the image data, whereby the nail is modeled as a band consisting of two parallel lines 66 with a known distance between them. The Hough transform voting scheme is constrained so that pixels which are on parallel lines only cast their vote if the gray level values between them are lower than the gray level values outside the band. It is to be understood that this scheme is only one possible method for defining the nail contours, and that other edge detection algorithms, as known in the art, may equally be employed for identifying the nail contours.
(47) Having found the nail's longitudinal contours 66, the algorithm now searches for holes in the area of the image contained between the two lines representing the contour in a 2-D view. The search is performed by moving a virtual parallelepiped window, whose lateral dimensions are equal to the nail width, along the nail's medial axis. The algorithm determines the two locations 68 containing the maximal number of edge elements, which thus correspond to the locations of the distal locking nail holes. An ellipse is then fitted to the edge elements at these locations, such as by means of the algorithm described in the article by R. Halir and J. Flusser, entitled Numerically stable direct least squares fitting of ellipses, published in Proceedings of the 6th International Conference in Central Europe on Computer Graphics and Visualization (WSCG), pp. 125-132, 1998.
(48) (d) Registration
(49) The distal locking nail holes are modeled as circles, and the X-ray fluoroscopic camera as a pinhole camera. According to this model, the circles in space are mapped to circles in the image when the camera viewing direction is perpendicular to the plane of the circle. This requires a fronto-parallel imaging setup. The use of the fronto-parallel setup, enables the registration procedure of this preferred method of the present invention, to be performed from single 2-dimensional images. To achieve this setup, the X-ray technician images the nail in several orientations until the distal locking nail holes appear as close as possible to circles. The measure of hole circularity is the aspect ratio of the ellipse which is fit to the data points of the edge elements of the holes, as determined in step (c) above. Once a ratio close to unity is achieved, the closeness to unity being decided by a predetermined condition dependent on the accuracy practically required, the targeting drill guide is introduced into the imaging field of view, and an additional image is acquired. The rigid transformation between the drill guide hole axes and the distal locking nail hole axes is computed by the following method. Since the targeting drill guide is pre-calibrated, in that the drill guide dimensions are known, and the mounting position of the slide head of the drill guide relative to the robot top is known, the transformation from the robot coordinate system to the targeting drill guide is also known. The transformation between the targeting drill guide and the fluoroscopic C-arm camera is determined from the extrinsic camera parameters and the known geometry of the targeting drill guide. In order to bring the drill guide hole axes and the distal locking nail hole axes into coincidence, the robot is first orientated so that the drill guide hole axes are aligned with the camera axis, as described above, and is then translated laterally according to the above-described computation, until the centers of the targeting drill guide hole axes and the distal locking nail hole axes coincide. The robot is such as to provide sufficient degrees of freedom of movement to allow alignment both in the lateral plane, as well as the required angular alignment.
(50) Though the system of the present invention, and the use thereof has been described hereinabove by means of its preferred application to the drilling of pilot holes for distal locking screws in long bone intramedullary nailing surgery, it is to be understood that this is only one example of the uses of the system of the present invention. The robot-guided system can be used to assist orthopaedic surgeons in performing other orthopaedic surgical procedures involving pre-positioned bone inserts which have pre-drilled holes for attachment to the bone undergoing the procedure, and the holes are invisible to the surgeon's eye.
(51) As an example of another preferred application of the system of the present invention, reference is now made to
(52) Using the robot guided system of the present invention, with the robot 30 mounted on the femur by means of its mounting screws 35, it becomes feasible to perform the insertion of the connector plate, and to accurately drill the connecting screw holes without the use of the prior art handle arm arrangement. A minimal number of X-ray fluoroscopic images are required, first of all to ensure that the plate is inserted with its obliquely aligned holes 84 correctly positioned opposite the femur head. The drilling guide 92 is then aligned with its perpendicular drill guide holes 94 opposite the corresponding holes 82 in the connector plate 80, to the required accuracy, by means of the preferred methods and registration procedures of the present invention, as described hereinabove. The drilling guide plate 92 is, however, different from that used in the intramedullary locking procedure, in that it preferably has a second angled part connected at an angle of 140 to the part parallel to the femur shaft, such that each part is parallel to the corresponding part of the connecting plate. The adjustable slide head 33 is moved such that the angled part of the drilling guide is aligned with its drilling holes 96 approximately opposite the angled holes 84, and the robotic alignment procedure is repeated with the C-arm suitably aligned so as to generate the appropriate fluoroscopic images down the obliquely angled holes, such that they too can be accurately drilled. Alternatively and preferably, the previously used straight drilling guide plate can be used, and the robot tilted at the predetermined angle such that the drilling plate is approximately parallel to the angled part of the connector plate.
(53) It is to be understood by one of skill in the art that the robotic system of the present invention, and the associated methods of use thereof, are not limited to the two preferred applications described hereinabove, but can be used for similar procedures, where the drilling of holes is required into existing pre-drilled holes in orthopaedic inserts inaccessible to the surgeon's eye. Furthermore, the computing system and associated algorithms described hereinabove are understood to be generally applicable to any imaging system application, where a predefined feature of an image of a targeting guide must be brought to coincide with a similar predefined feature in an image of the intended target itself.
(54) It is appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and subcombinations of various features described hereinabove as well as variations and modifications thereto which would occur to a person of skill in the art upon reading the above description and which are not in the prior art.