Automatic recognition method for spatial position and pose of parallel external fixator for fracture reduction
11596444 · 2023-03-07
Assignee
Inventors
Cpc classification
A61B17/66
HUMAN NECESSITIES
A61B17/62
HUMAN NECESSITIES
A61B2034/102
HUMAN NECESSITIES
A61B90/37
HUMAN NECESSITIES
A61B2090/3983
HUMAN NECESSITIES
A61B90/39
HUMAN NECESSITIES
International classification
A61B17/66
HUMAN NECESSITIES
A61B17/62
HUMAN NECESSITIES
A61B34/10
HUMAN NECESSITIES
Abstract
The present invention discloses an automatic recognition method for spatial position and pose of parallel external fixator, including the following steps of: installing three markers on each of the two fixation rings of the parallel external fixator; obtaining 3D images of six marker balls after scanning and reconstruction by a common 3D clinical imaging system; recognizing the sphere center coordinates of the six marker balls by sphere fitting algorithm; according to the mounting configuration of the markers on the two fixation rings, establishing coordinate systems of two fixation rings and determining the spatial position and pose of the external fixator; in addition, by obtaining the 3D images of the fracture bone segments with the 3D clinical imaging system and simulating the movement of the fracture deformity correction, the adjustment schedule of the external fixator struts can be achieved.
Claims
1. An automatic recognition method for spatial position and pose of a parallel external fixator, including the following steps of: (1) installing markers, including: defining two fixation rings of the parallel external fixator as a proximal fixation ring (210) and a distal fixation ring (211); installing three markers on the proximal fixation ring and three on the distal fixation ring, wherein the six markers have the same structure and each comprise a marker ball and a marker pin shaft; the distance from a sphere center of each marker ball on the proximal fixation ring to an upper surface of the proximal fixation ring is a fixed value h.sub.M; the distance from a sphere center of each marker ball on the distal fixation ring to an upper surface of the distal fixation ring is the same fixed value h.sub.M; the marker balls and the marker pin shafts are made of different materials, so that the marker balls can be recognized by a common three-dimensional (hereinafter referred to as 3D) clinical imaging system, and the marker pin shafts will not be recognized; (2) acquiring 3D images, including: 3D scanning the fracture site and the parallel external fixator with installed markers; performing threshold division and 3D reconstruction to obtain 3D images of a proximal bone segment (310), a distal bone segment (311) and six marker balls; storing the data of the 3D images in a computer system by using a 3D point cloud format, wherein the 3D point cloud format is composed of a plurality of data points to describe the surface shape of a 3D object; (3) sphere fitting the marker balls, including: (a) based on the 3D point cloud data of the six marker balls and a known diameter of the marker balls, fitting the 3D point cloud of the six marker balls into six spheres by a sphere fitting algorithm; (b) by referring to 3D images of the proximal bone segment and the distal bone segment, specifying the correspondence relationship between the six marker balls in the 3D images and the six markers on the parallel external fixator, and then storing the correspondence relationship into the computer system; (4) specifying installation information of the markers, including: (a) establishing a proximal coordinate system p-uvw attached to the proximal fixation ring and a distal coordinate system P-UVW attached to the distal fixation ring; (b) according to a mounting configuration among a first marker (201), a second marker (202), a third marker (203) and the proximal fixation ring, by using the structural dimensions of the proximal fixation ring, calculating the coordinates of a first sphere center of the first marker ball M.sub.1(u.sub.1v.sub.1w.sub.1), a second sphere center of the second marker ball M.sub.2(u.sub.2v.sub.2w.sub.2), and a third sphere center of the third marker ball M.sub.3(u.sub.3v.sub.3w.sub.3) in the proximal coordinate system p-uvw, respectively; and according to a mounting configuration among a fourth marker (204), a fifth marker (205), a sixth marker (206) and the distal fixation ring (211), by using the structural dimensions of the distal fixation ring (211), calculating the coordinates of the fourth sphere center of the fourth marker ball M.sub.4(U.sub.4V.sub.4W.sub.4), the fifth sphere center of the fifth marker ball M.sub.5(U.sub.5V.sub.5W.sub.5), and the sixth sphere center of the sixth marker ball M.sub.6(U.sub.6V.sub.6W.sub.6) in the distal coordinate system P-UVW, respectively; the sphere center coordinates of the six marker balls constitute the markers installation information of the external fixator; (c) inputting the markers installation information into the computer system; (5) recognizing spatial position and pose of the coordinate systems, including: (a) according to the plane formed by the first sphere center, second sphere center and third sphere center that is parallel to the upper surface of the proximal fixation ring, calculating a normal vector {right arrow over (pw)} of the upper surface of the proximal fixation ring by the following formula, which corresponds to the axis w of the proximal coordinate system p-uvw:
{right arrow over (pv)}={right arrow over (pw)}×{right arrow over (pu)} (e) repeating step (5a) to step (5d), according to the coordinates of the fourth sphere center M.sub.4(U.sub.4V.sub.4W.sub.4), the fifth sphere center M.sub.5(U.sub.5V.sub.5 W.sub.5) and the sixth sphere center M.sub.6(U.sub.6V.sub.6W.sub.6) in the distal coordinate system P-UVW, calculating the coordinate of an origin P of the distal coordinate system P-UVW, in the point cloud reference coordinate system O-xyz, P.sub.O-xyz=(x.sub.POY.sub.POZ.sub.PO), and determining the value of unit vectors {right arrow over (PU)}, {right arrow over (PV)} and {right arrow over (PW)} of the three coordinates axes of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz; (f) determining the position and pose of the proximal coordinate system p-uvw relative to the point cloud reference coordinate system O-xyz by using the origin coordinate p.sub.O-xyz and the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)}; determining the position and pose of the distal coordinate system P-UVW relative to the point cloud reference coordinate system O-xyz by using the origin coordinate P.sub.O-xyz and the unit vectors {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)}; and storing the spatial position and pose of the proximal and distal coordinate systems into the computer system; (6) determining the spatial position and pose of the external fixator, including: (a) calculating the relative position of the proximal fixation ring and the distal fixation ring by using the origin coordinate P.sub.O-xyz of the proximal coordinate system and the origin coordinate P.sub.O-xyz of the distal coordinate system, and expressing the relative position with a position vector {right arrow over (r.sub.P.sub.
{right arrow over (r.sub.P.sub.
2. The method according to claim 1, wherein the three markers on the proximal fixation ring are arranged as far as possible from each other, and the three markers on the distal fixation ring are arranged as far as possible from each other.
3. The method according to claim 1, wherein the marker balls are made of stainless steel or aluminum alloy, and the marker pin shafts are made of ABS plastic or PE plastic.
4. The method according to claim 1, wherein a STL format is adopted to store the 3D images data of the proximal bone segment, the distal bone segment and the six marker balls.
5. The method according to claim 1, wherein adopting least square method to fit the 3D point cloud of each marker ball into a sphere comprising: unifying the 3D point cloud data of each marker ball into the reference coordinate system O-xyz, assuming the coordinates of the sphere center obtained by sphere fitting a marker ball point cloud as (x.sub.MkY.sub.MkZ.sub.Mk) in the reference coordinate system (where Mk represents an arbitrary k.sup.th marker ball), and the distance D.sub.i from the i.sup.th point of the k.sup.th marker ball's point cloud to the fitted sphere center yields the following equation:
D.sub.i.sup.2(x.sub.M.sub.
S(x.sub.Mk,y.sub.Mk,z.sub.Mk)=ΣS.sub.i.sup.2−Σ(D.sub.i−r.sub.m).sup.2 taking partial derivation of the sum S with respective to x.sub.Mk, Y.sub.Mk and Z.sub.Mk, a plurality of (or one) extreme values of the sum S are obtained when the partial derivation equals to 0; obtaining the minimum value of the sum S by comparing the extreme values, and the coordinates x.sub.Mk, Y.sub.Mk and Z.sub.Mk corresponding to the minimum value is the best fitted sphere center of the chosen marker ball.
6. The method according to claim 5, wherein the three markers on the proximal fixation ring are arranged as far as possible from each other, and the three markers on the distal fixation ring are arranged as far as possible from each other.
7. The method according to claim 5, wherein the marker balls are made of stainless steel or aluminum alloy, and the marker pin shafts are made of ABS plastic or PE plastic.
8. The method according to claim 5, wherein a STL format is adopted to store the 3D images data of the proximal bone segment, the distal bone segment and the six marker balls.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The accompanying drawings illustrate one or more embodiments of the present invention and, together with the written description, serve to explain the principles of the invention. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or like elements of an embodiment.
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION OF THE EMBODIMENTS
(7) The present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the present invention are shown. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure is thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout.
(8) The embodiments of the present invention will be described below in detail with reference to the drawings.
(9) As shown in
(10) (1) installing markers, including: defining two fixation rings of the parallel external fixator as a proximal fixation ring 210 and a distal fixation ring 211; installing three markers on the proximal fixation ring 210 and three on the distal fixation ring 211; wherein the six markers is defined as a first marker 201, a second marker 202, a third marker 203, a fourth marker 204, a fifth marker 205 and a sixth marker 206 in order (see
(11) (2) Acquiring 3D images, including: 3D scanning the fracture site and the parallel external fixator with installed markers, performing threshold division and 3D reconstruction to obtain 3D images of a proximal bone segment 310, a distal bone segment 311 and six marker balls 301, 302, 303, 304, 305, 306 (see
(12) (3) Sphere fitting the marker balls, including:
(13) (3a) based on the 3D point cloud data of the six marker balls and the known diameter of the marker balls, fitting the 3D point cloud of the six marker balls into six spheres by a certain sphere fitting algorithm.
(14) Preferably, adopting the least square method to fit the 3D point cloud of each marker ball into a sphere. Setting up a point cloud reference coordinate system O-xyz, assuming the fitted sphere center coordinates of an arbitrary k.sup.th marker ball in the reference coordinate system O-xyz as (x.sub.Mky.sub.Mkz.sub.Mk), and the distance D.sub.i from the i.sup.th point of the k.sup.th marker ball's point cloud to the fitted sphere center can be expressed as:
D.sub.i.sup.2(x.sub.M.sub.
(15) in which, x.sub.i, y.sub.i and z.sub.i represent the coordinates of the i.sup.th point of the k.sup.th marker ball's point cloud in the reference coordinate system O-xyz. The sum of square residual between D.sub.i and the actual marker ball radius r.sub.M is:
S(x.sub.Mk,y.sub.Mk,z.sub.Mk)=Σ(D.sub.i.sup.2−d.sub.Mk.sup.2).sup.2 (2)
(16) When the sum of square residual S reaches its minimum value, the corresponding coordinates x.sub.Mk, y.sub.Mk and z.sub.Mk is the best fitted sphere center of the k.sup.th marker ball's point cloud.
(17) (3b) By referring to the 3D images of the proximal bone segment 310 and the distal bone segment 311, specifying the corresponding relationship between six marker balls 301, 302, 303, 304, 305, 306 in the 3D images and the six markers 201, 202, 203, 204, 205, 206 on the parallel external fixator, and then storing it into the computer system.
(18) (4) Specifying installation information of the markers, including:
(19) (4a) establishing a proximal coordinate system p-uvw attached to the proximal fixation ring 210 and a distal coordinate system P-UVW attached to the distal fixation ring 211.
(20) (4b) According to the actual mounting configuration among the first marker 201, second marker 202, third marker 203 and proximal fixation ring 210, by using the structural dimensions of the proximal fixation ring 210, calculating to obtain the coordinates M.sub.1(u.sub.1v.sub.1w.sub.1), M.sub.2(u.sub.2v.sub.2w.sub.2) and M.sub.3(u.sub.3v.sub.3w.sub.3) of the first sphere center of the first marker ball 201, the second sphere center of the second marker ball 202 and the third sphere center of the third marker ball 203 in the proximal coordinate system p-uvw, respectively (see
(21) (4c) Inputting the markers installation information into the computer system.
(22) (5) Recognizing spatial position and pose information of the coordinate system, including:
(23) (5a) According to the plane formed by first sphere center, second sphere center and the third sphere center is parallel to the upper surface of the proximal fixation ring 210, calculating a normal vector {right arrow over (pw)} of the upper surface of the proximal fixation ring 210 by the following formula, which corresponds to the axis w of the proximal coordinate system p-uvw:
(24)
(25) in which, {right arrow over (M.sub.1M.sub.2)} is a vector pointing from the first sphere center to the second sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M.sub.1M.sub.2)}=(x.sub.M2−x.sub.M1y.sub.M2−y.sub.M1z.sub.M2−z.sub.M1); {right arrow over (M.sub.2M.sub.3)} is a vector pointing from the second sphere center to the third sphere center in the point cloud reference coordinate system O-xyz, and {right arrow over (M.sub.2M.sub.3)}=(x.sub.M3−x.sub.M2y.sub.M3−y.sub.M2z.sub.M3−z.sub.M2).
(26) (5b) Assuming the coordinates of the origin p of the proximal coordinate system p-uvw be p.sub.O-xyz=(x.sub.pO y.sub.pO z.sub.pO) in the point cloud reference coordinate system O-xyz, according to the coordinates M.sub.1(u.sub.1v.sub.1w.sub.1), M.sub.2(u.sub.2v.sub.2w.sub.2) and M.sub.3(u.sub.3v.sub.3w.sub.3) obtained by the step (4b) in the proximal coordinate system p-uvw, calculating the coordinates of the origin p in the point cloud reference coordinate system O-xyz by solving the following distance equations:
(27)
(28) (5c) In the point cloud reference coordinate system O-xyz, assuming the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw be {right arrow over (pu)}=(x.sub.pu y.sub.puz.sub.pu); respectively taking the scalar products of vectors {right arrow over (pM.sub.1)}, {right arrow over (pM.sub.2)} and {right arrow over (pM.sub.3)} of the first sphere center, the second sphere center and the third sphere center with the unit vector {right arrow over (pu)}, the outcomes are equivalent to the vector components u.sub.1, u.sub.2 and u.sub.3 of the first sphere center, the second sphere center and the third sphere center along the axis {right arrow over (pu)}, expressing as the following:
(29)
(30) in which, the vectors {right arrow over (pM.sub.1)}, {right arrow over (pM.sub.2)} and {right arrow over (pM.sub.3)} are determined by {right arrow over (pM.sub.1)}=(x.sub.M1−x.sub.py.sub.M1−y.sub.p z.sub.M1−z.sub.p), {right arrow over (pM.sub.2)}=(x.sub.M2−x.sub.p y.sub.M2−y.sub.p z.sub.M2−z.sub.p) and {right arrow over (pM.sub.3)}=(x.sub.M3−x.sub.p y.sub.M3−y.sub.p z.sub.M3−z.sub.p), respectively; solving the equation set (5) to obtain the value of unit vector {right arrow over (pu)} of the proximal coordinate system p-uvw.
(31) (5d) Calculating the unit vector {right arrow over (pv)} of the proximal coordinate system p-uvw by using the right-hand rule, as the following equation:
{right arrow over (pv)}={right arrow over (pw)}×{right arrow over (pu)} (6)
(32) (5e) Repeating step (5a) to step (5d), according to the coordinates of the fourth sphere center M.sub.4(U.sub.4V.sub.4W.sub.4), the fifth sphere center M.sub.5(U.sub.5V.sub.5W.sub.5) and the sixth sphere center M.sub.6(U.sub.6V.sub.6W.sub.6) in the distal coordinate system P-UVW, calculating the coordinate of the origin P of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz, P.sub.O-xyz=(x.sub.PO y.sub.PO z.sub.PO), and determining the value of unit vectors {right arrow over (PU)}, {right arrow over (PV)} and {right arrow over (PW)} of the three coordinates axes of the distal coordinate system P-UVW in the point cloud reference coordinate system O-xyz.
(33) (5f) Determining the position and pose of the proximal coordinate system p-uvw relative to the point cloud reference coordinate system O-xyz by using the origin coordinate p.sub.O-xyz and the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)}; determining the position and pose of the distal coordinate system P-UVW relative to the point cloud reference coordinate system O-xyz by using the origin coordinate P.sub.O-xyz and the unit vectors {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)}; and storing the spatial position and pose of the proximal and distal coordinate systems p-uvw, P-UVW into the computer system.
(34) (6) Determining the spatial position and pose of the external fixator, including:
(35) (6a) calculating the position of the proximal coordinate system p-uvw relative to the distal coordinate system P-UVW by using the origin p of proximal coordinate system and the origin P of distal coordinate system, determining the relative position vector {right arrow over (r.sub.P.sub.
{right arrow over (r.sub.P.sub.
(36) (6b) calculating the relative pose of the proximal fixation ring and the distal fixation ring by using the unit vectors {right arrow over (pu)}, {right arrow over (pv)}, {right arrow over (pw)} of proximal coordinate system and {right arrow over (PU)}, {right arrow over (PV)}, {right arrow over (PW)} of distal coordinate system, and express the relative pose with a pose matrix R.sub.P.sup.p of the proximal fixation ring 210 and the distal fixation ring 211 as the following:
(37)
(38) (6c) determining the spatial position and pose of the external fixator according to the relative position vector {right arrow over (r.sub.P.sub.
(39) (7) Determining the adjustment values of the external fixator for fracture reduction, including:
(40) displaying the 3D images of the proximal bone segment 310 and the distal bone segment 311 on the screen of the computer system, translating and rotating the 3D images on the computer according to the desired fracture reduction movement, achieving the correct alignment of the proximal bone segment 310 and the distal bone segment 311 in the screen display; automatically calculating and storing, by the computer system, the translation and rotation movement values of the 3D images of the proximal bone segment 310 relative to the 3D image of the distal bone segment in the point cloud reference coordinate system O-xyz during the reduction; wherein the translation and rotation movement values of the proximal bone segment 310 relative to the distal bone segment 311 in the screen display equal to the translation and rotation adjustment value of the proximal fixation ring 210 relative to the distal fixation ring 211 during the reduction, thus the adjustment values of the external fixator for fracture reduction is determined.
(41) (8) According to the recognized spatial position and pose of the external fixator, the adjustment values of the external fixator for fracture reduction, and by using a certain kinematics algorithm in the field of robotics, the adjustment schedule of the external fixator struts for fracture reduction is obtained. Surgeons could reduce bone fracture deformity by adjusting the struts of the external fixator according to the adjustment schedule.
(42) The above description of the present invention is only exemplary rather than restrictive. Therefore, the embodiments of the present invention are not limited to the specific embodiments described above. If inspired by the present invention, one skilled in the art may make other changes or variations without departing from the spirit of the present invention and the scope protected by the claims, which, however, shall all fall into the protection scope of the present invention.
(43) The foregoing description of the exemplary embodiments of the present invention has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teaching.
(44) The embodiments were chosen and described in order to explain the principles of the invention and their practical application so as to activate others skilled in the art to utilize the invention and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its spirit and scope. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description and the exemplary embodiments described therein.