Computer Assisted Surgery Device Having A Robot Arm And Method For Operating The Same
20230106323 · 2023-04-06
Inventors
Cpc classification
A61B2034/305
HUMAN NECESSITIES
A61B34/20
HUMAN NECESSITIES
A61B2034/102
HUMAN NECESSITIES
A61B2017/00694
HUMAN NECESSITIES
A61B2090/3966
HUMAN NECESSITIES
A61B2034/107
HUMAN NECESSITIES
A61B34/10
HUMAN NECESSITIES
International classification
A61B34/10
HUMAN NECESSITIES
A61B34/20
HUMAN NECESSITIES
Abstract
A computer assisted surgery device and a method for operating the same which allows a more efficient positioning and application of an implant with respect to a bony structure, wherein the computer-assisted surgery device having a robot arm and a method for operating the same resulting in a shorter operation time and less intensity of x-ray exposure for a patient.
Claims
1. A method for operating a computer assisted surgery device, the method comprising: acquiring an x-ray image of a bony structure together with at least one (1)of an implant targeting device having an implanting trajectory and a reference geometry, and (2) an implant having an implanting trajectory and a reference geometry, the bony structure having an implanting area with a predetermined implanting axis; acquiring a deviation of the implanting trajectory of at least one of (1) the implant targeting device and (2) the implant from the predetermined implanting axis of the implanting area based on the acquired x-ray image; determining a measure of a required motion of the at least one of (1) the implant targeting device and (2) the implant to be executed, based on the deviation, for bringing the implanting trajectory of the at least one of (1) the implant targeting device and (2) the implant from a deviated state of the implanting trajectory of the at least one of (1) the implant targeting device and (2) the implant into alignment with the predetermined implanting axis of the implanting area; and controlling a motion of at least one of (1) the implant targeting device and (2) the implant based on the determined measure of required motion.
2. The method according to claim 1, wherein the computer assisted surgery device has a segmented robot arm with a plurality of segments and a plurality of joints, wherein two adjacent segments of the plurality of segments are coupled with a joint of the plurality of joints, the segmented robot arm capable of being transitioned from a fixed state to a released state and vice versa, wherein a first end of the segmented robot arm is connected to a fix point and wherein a second end of the segmented robot arm is connected to the implant targeting device, wherein the method further comprises: before acquiring the x-ray image, transitioning the plurality of joints of the segmented robot arm into the fixed state, after determining a measure of required motion, transitioning at least one of the plurality of joints to the released state, controlling a motion of at least one of the segments of the plurality of segments adjacent to the released joints in order to move the at least one of the implant targeting device and the implant according to the determined measure of required motion, and transitioning the released joints from the released state into the fixed state.
3. The method according to claim 2, wherein the segmented robot arm ) has a plurality of actuators each adapted to controllably actuate a motion of two adjacent segments of the plurality of segments with respect to each other along their connecting joint, wherein the method further comprises: before acquiring the x-ray image, controlling the plurality of actuators to transition the plurality of joints of the segmented arm into the fixed state, after determining a measure of required motion, controlling the plurality of actuators to transition the plurality of joints to the released state and move at least a part of the segments of the plurality of segments to move the at least one of the implant targeting device and the implant according to the determined measure of required motion, and controlling the plurality of actuators to transition the plurality of joints of the segmented arm into the fixed state.
4. The method according to claim 1, wherein acquiring the x-ray image of the bony structure together with at least one of the implant targeting device and the implant comprises: acquiring a first at least bi-planar image from a first view point onto the bony structure together with the at least one of the implant targeting device and the implant, and a second at least bi-planar image from a second view point onto the bony structure together with the at least one of the implant targeting device and the implant, correlating the first at least bi-planar image and the second at least hi-planar image; and generating a three dimensional image of the bony structure based on the first at least bi-planar image, the second at least bi-planar image, and a correlation of the first at least bi-planar image and the second at least bi-planar image.
5. The method according to claim 1, further comprising determining the implanting area and the predetermined implanting axis based on the acquired x-ray image of the bony structure and a bone data base having stored therein a plurality of data of bony structures, optimized implanting areas thereon and/or therein, and predetermined implanting axes, as well as correlations thereof.
6. The method according to claim 1, wherein the implanting area of the bony structure represents an area which is defined by a geometry of an implant to be implanted on and/or in the bony structure.
7. The method according to claim 1, wherein the method comprises after controlling a motion of the at least one of the implant targeting device and the implant, acquiring a further at least bi-planar image from a first view point onto the bony structure together with the at least one of the implant targeting device and the implant, and a further at least bi-planar image from a second view point onto the bony structure together with the at least one of the implant targeting device and the implant, determining a deviation of the implanting trajectory of the at least one of the implant targeting device and the implant from the predetermined implanting axis of the implanting area of the bony structure, and if the deviation is above a predetermined threshold, repeating the step of determining a measure of a required motion of the at least one of the implant targeting device and the implant to be executed for bringing the implanting trajectory of the at least one of the implant targeting device and the implant from an acquired deviation of the implanting trajectory of the at least one of the implant targeting device and the implant into alignment with the implanting axis of the implanting area of the bony structure, and controlling a motion of the at least one of the implant targeting device and the implant.
8. A device for computer assisted surgery, the device comprising: an image acquiring unit adapted for acquiring an x-ray image of a bony structure together with at least one of an implant targeting device and an implant having an implanting trajectory and a reference geometry; a deviation acquiring unit adapted for acquiring a deviation of the implanting trajectory of the at least one of the implant targeting device and the implant from a predetermined implanting axis of an implanting area of the bony structure based on the acquired x-ray image; a motion determining unit adapted for determining a measure of a required motion of the at least one of the implant targeting device and the implant to be executed, based on the deviation, for bringing the implanting trajectory of the at least one of the implant targeting device and the implant from the acquired deviation of the implanting trajectory of the at least one of the implant targeting device and the implant into alignment with the predetermined implanting axis of the implanting area; and a motion controlling unit adapted for controlling a motion of the at least one of the implant targeting device and the implant based on the measure of required motion determined by the motion determining unit.
9. (canceled)
10. The device according to claim 8, further comprising: a segmented arm with a plurality of segments, wherein at least two adjacent segments of the plurality of segments are coupled with a joint being capable of being transitioned from a fixed state to a released state and vice versa, wherein a first end of the segmented arm is connected to a fix point and a second end of the segmented arm is connectable to at least one of (1) the implant targeting device and (2) the implant, wherein the image acquiring unit is adapted to acquire the x-ray image in the fixed state of the segmented arm; and wherein the motion controlling unit is adapted for transitioning the segmented arm from the fixed state to the released state for controlling the motion of the segmented arm based on the measure of the required motion determined by the motion determining unit, and for transitioning the segmented arm from the released state to the fixed state.
11. A device for computer assisted surgery, the device comprising: a first segmented robot arm having a plurality of segments and a plurality of actuators each being adapted to controllably actuate a motion of two adjacent segments with respect to each other about a connecting joint of the two adjacent segments, wherein the connecting joint is capable of being transitioned from a fixed state to a released state and vice versa, wherein a first end of the the first segmented robot arm is connected to a fix point and a second end of the first segmented robot arm is connectable to at least one of (1) an implant targeting device having an implanting trajectory and a reference geometry, and (2) an implant having an implanting trajectory and a reference geometry, an image acquiring unit adapted for acquiring an x-ray image of a bony structure together with the at least one of the implant targeting device and the implant at a fixed state of the first segmented robot arm; a deviation acquiring unit adapted for acquiring a deviation of the implanting trajectory of the at least one of the implant targeting device and the implant from a predetermined implanting axis of an implanting area of the bony structure based on the acquired x-ray image; a motion determining unit adapted for determining a measure of a required motion of the at least one of the implant targeting device and the implant to be executed, based on the deviation, for bringing the implanting trajectory of the at least one of the implant targeting device and the implant from the acquired deviation of the implanting trajectory of the at least one of the implant targeting device and the implant into alignment with the predetermined implanting axis of the implanting area; and a motion controlling unit adapted for transitioning connecting joints of the first segmented robot arm from the fixed state to the released state, for controlling the motion of the plurality of actuators of the first segmented robot arm based on the measure of required motion determined by the motion determining unit, and for transitioning the connecting joints of the first segmented robot arm from the released state to the fixed state.
12. The device according to claim 8, wherein the image acquiring unit is adapted for acquiring a first at least bi-planar image from a first view point onto the bony structure together with at least one of an implant targeting device and an implant, and a second at least bi-planar image from a second view point onto the bony structure together with the at least one of the implant targeting device and the implant, and for composing an x-ray image out of the first at least bi-planar image and the second at least bi-planar image.
13. The device according to claim 11, wherein the image acquiring unit comprises a correlation unit adapted for correlating the first at least bi-planar image and the second at least bi-planar image and generating a three dimensional image of the bony structure based on the first at least bi-planar image, the second at least bi-planar image, and the correlation of the first at least bi-planar image and the second at least bi-planar image.
14. The device according to claim 8, further comprising an implanting area determining unit being adapted for determining the implanting area and the predetermined implanting axis based on the acquired bony structure and a bone data base having stored therein a plurality of data of bony structures, optimized implanting areas thereon and/or therein, and predetermined implanting axes, as well as a correlation thereof.
15. The device according to claim 8, further comprising as part of a system a reference geometry, wherein the reference geometry is a reference body which is attachable to at least one of the implant targeting device and the implant, representing a unique position and orientation of the at least one of the implant targeting device and the implant.
16. The device according to claim 8, further comprising as part of a system an implant targeting device, wherein the reference geometry is an integral portion of the implant targeting device, wherein the integral portion has a geometry having a unique projection pattern for each projection direction.
17. The device according to claim 8, further comprising as part of a system an implant, wherein the reference geometry is an integral portion of the implant, wherein the integral portion has a geometry having a unique projection pattern for each projection direction.
18. The device according to claim 8, wherein the reference geometry has a plurality of fiducial markers, wherein the fiducial markers have a spatial arrangement having a unique projection pattern for each projection direction.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057] Exemplary embodiments will be described in more detail with respect to the enclosed figures, where same or corresponding references refer to the same or corresponding elements and structures.
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
[0058] The present invention provides a computer assisted surgery system and method for operating the same that allows an easier positioning of implants with respect to bony structures. This device and method for operating the same also allow a support in positioning implants and sub-implants, as well as implants and tooling devices with respect to each other. The invention overcomes problems with pin and screw targeting, that in multiple indications require significant radiation, and in some cases requires multiple passes with a K-wire and further has a limited accuracy in case 3D information on the pin or screw position is normally not available in the operational room. As in the past, often iterative and free-hand targeting with fluoroscopy was applied, for some applications combined with temporary K-wires to verify position or a full navigation with bone trackers and a stereo camera, the drawbacks of such methods and devices can be overcome with the present invention.
[0059] The present invention provides a device and a method for operating the device, which constitutes a combination of a stereotactic method with a robotic arm arrangement for multiple targeting exercises in traumatology. The concept is to identify the relative spatial position of bony and anatomical structures to e.g. a sleeve held by a robotic arm by stereotactic imaging, which stereotactic imaging may be a fluoroscopy imaging or an ultrasound imaging. The targeting sleeve or targeting device itself or a rigidly connected structure may serve as reference between multiple C-arm views. With the assumption that the position of the bony structure is relatively stable, movements of the targeting device can then be displayed live relative to the bony structures by simply feeding in the relative position information from a robotic arm, without the need for further imaging. That means, that a targeting task for example for a pin or screw placement can be accurately performed in simple steps of for example acquiring bi- or multi-planar images of the relevant bony structure with a reference body, which may be attached to the robotic arm, positioning by a surgeon a targeting sleeve or targeting device connected to the robot to be aligned with the desired pin or screw trajectory while the relative position is displayed on a screen by the arm movement information coming from position sensors in the robot and the assumption that the bony fragment stays stationary during the process. Then, a verification can be performed that the relative position of targeting device and anatomical structure is now correct through additional imaging.
[0060] Robotic arm in this context means a mechanical arm with at least 5 degrees of freedom DoF for the end effector, which may be the targeting device, where relative movements of the tip can be tracked through position sensors in all relevant moving parts and hinges. The hinges or joints of the robotic arm could also be equipped with actuators and/or clutches in order to constrain movements in certain direction and/or block the device position during control imaging.
[0061] Stereotactic imaging is calculating the position and orientation of a three dimensional representation of an anatomic structure by correlating for example two fluoroscopic images with a relative angle between them. Since the relative position and orientations by standard C-arms is typically not tracked or known, the invention may utilize a stationary reference body with for example radio-dense markers that are visible in both images. In the targeting application for the femoral head, the femoral head is assumed as spherical. So in this particular case, no underlying CT scan is needed to display the position of a screw relative to the head in the three dimensional image. For application in more general structures, a three dimensional shape estimation may be provided with assumptions about the bone shape by comparing the same with a bone data base. For a more accurate registration of three dimensional structures, a pre- or intra-operative CT scan may be fed in as underlying information, and by identifying the outer contour of structures or fragments and comparing them to the object shape known from the three dimensional scan, the position and orientation may be identified. This may be facilitated by replacing a reference body in the field of view for images. In the approach, this reference body may be connected to the robotic arm or be integrated in the arm.
[0062] Thus, the invention provides a highly accurate reproducible process and a device, which may provide a highly accurate and reproducible process to target pins or screws. Especially, if there is an underlying CT, the position of any screw or pin or implant can be accurately planned and executed by the surgeon in the surgery while significantly reducing the need for radiation and potential increase speed of surgery.
[0063] For this purpose, the following exemplary embodiments are described along the figures to illustrate the operation of the device for computer assisted surgery and the method for operating the same.
[0064]
[0065] An image of the implanting situation, which is taken by the imaging device 112, may be transferred to the processing unit 101. In case that the imaging device 112 acquires more than one image, in particular more than one image from different points of view, the different images may be provided to the processing unit 101. In case a plurality of images are acquired, in particular from different points of view, a correlation unit 111 may correlate the different images, in order to for example combine two or more bi-planar images to a three dimensional illustration of the implanting situation. This image information may then be provided to different units of the processing unit 101. The processing unit 101 may determine based on the acquired imaging information acquired by the image acquiring unit 110 a deviation of an intended implantation axis of the bony structure and an implant trajectory of an implant to be implanted. This deviation may be determined and acquired by the deviation acquiring unit 120. The processing unit 101 may use a determined position, which may be determined by the position determining unit 160 based on the acquired images. The processing unit may also receive supporting information, for example received from an implanting area determining unit 150 and an identification unit for identifying a type of an implant 170. The implanting area determining unit 150 and the identification unit fora type of an implant 170 may receive information for determining the implanting area and the identification of a type of an implant from an external data base 200. The external data base 200 may have included information regarding anatomical geometries. This information regarding anatomical geometries may have included a statistical bone data base where empirical information of different bone geometries are stored, but may also include individual patient related bone data, acquired before.
[0066] The deviation acquiring unit 120 may acquire a deviation from the implanting trajectory of the implant targeting device and/or implant and the implanting axis of the implanting area of the patient's bone. Based thereon the motion determining unit 130 may determine the required motion. The motion determining unit 130 provides this information to a motion controlling unit 140, which in turn may control the motion of for example a robot arm (which is not illustrated here) to bring the implantation trajectory 25 related to the implant targeting device and/or implant and the implanting axis 15 of the implanting area 14 of the bony structure 10 into an alignment, as illustrated in
[0067]
[0068] Further,
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075] The device as described above with respect to any of the figures, in particular
[0076]
[0077]
REFERENCE LIST
[0078] 1 patient
[0079] 10 bony structure
[0080] 14 implanting area of bony structure
[0081] 15 implanting axis
[0082] 20 (main-)implant targeting device
[0083] 21 reference geometry of (main-)implant targeting device
[0084] 22 reference body of (main-)implant targeting device
[0085] 23 fiducial markers of (main-)implant targeting device
[0086] 24 reference geometry as integral portion
[0087] 25 implanting trajectory of (main-)implant targeting device and/or implant
[0088] 28 (main-)implant
[0089] 30 (sub-)implant targeting device
[0090] 100 device for computer assisted surgery
[0091] 101 processing unit
[0092] 110 image acquiring unit
[0093] 111 correlation unit
[0094] 112 imaging device
[0095] 120 deviation acquiring unit
[0096] 130 motion determining unit
[0097] 140 motion controlling unit
[0098] 150 implanting area determining unit
[0099] 160 position determining unit
[0100] 170 identification unit for identifying a type of an implant
[0101] 180 (first) segmented arm
[0102] 181 first end of (first) segmented arm
[0103] 182 second end of (first) segmented arm
[0104] 183 segments of (first) segmented arm
[0105] 184 joints between segments of (first) segmented arm
[0106] 185 actuators of (first) segmented arm
[0107] 200 bone data base
[0108] dx, dy deviation of the predetermined implanting trajectory
[0109] F fixed/reference point, mounting point
[0110] i1, i2 first/second (bi-)planar images of bony structure with implant targeting device
[0111] i1′, i2′ first/second monitoring/verification images
[0112] i3D three dimensional bony structure
[0113] vp1, vp2 first/second view point
[0114] S105 bringing joints of segmented arm into fixed/locked state
[0115] S110 acquiring a three dimensional image
[0116] S112 acquiring a first/second (bi-)planar image
[0117] S114 correlating first and second (bi-)planar image
[0118] S116 generating three dimensional image
[0119] S120 acquiring a deviation of implanting trajectory
[0120] S130 determining a measure of a required motion
[0121] S135 bringing joint into a released state
[0122] S140 controlling a motion of implant targeting device
[0123] S141 controlling a motion of segments
[0124] S145 bringing joint into a fixed state
[0125] S150 determining implanting area and predetermined implanting trajectory
[0126] S160 acquiring first and second (bi-)planar image for verification
[0127] S165 determining deviation of predetermined implanting trajectory