Medical tracking system comprising multi-functional sensor device
10762341 · 2020-09-01
Assignee
Inventors
- Stefan Vilsmeier (Munich, DE)
- Christian Brack (Neusaß, DE)
- Ingmar Hook (Feldkirchen, DE)
- Timo Neubauer (Grasbrunn, DE)
Cpc classification
A61B2017/00199
HUMAN NECESSITIES
G06V40/103
PHYSICS
A61B2034/2068
HUMAN NECESSITIES
A61B34/20
HUMAN NECESSITIES
A61B2034/2072
HUMAN NECESSITIES
A61B2090/3983
HUMAN NECESSITIES
International classification
A61B34/20
HUMAN NECESSITIES
Abstract
The present invention relates to a medical tracking system comprising at least one sensor device which can be positioned in a fixed position relative to a target, the sensor device comprising a marker device and a marker device detector, the marker device detector being capable of obtaining information for determining a relative position between the marker device detector and another marker device, the system further comprising a control unit configured to process a medical navigation workflow and to select the function of the sensor device as either acting as a marker device detector or as a marker device in a step of the medical navigation workflow.
Claims
1. A medical tracking system comprising: a first navigation sensor device which can be selectively positioned in a fixed position relative to an associated first target, the first navigation sensor device comprising a first housing, a first orientation sensor operatively coupled with the first housing, and a first position sensor operatively coupled with the first housing, the first navigation sensor device selectively behaving as either of a first marker device or as a first marker detection device; a second navigation sensor device which can be selectively positioned in a fixed position relative to an associated second target, the second navigation sensor device comprising a second housing different than the first housing, a second orientation sensor operatively coupled with the second housing, and a second position sensor operatively coupled with the second housing, the second navigation sensor device selectively behaving as either of a second marker device or as a second marker detection device; and a control unit configured to process a medical navigation workflow, wherein the control unit selects, based on a first step of the medical navigation workflow, a function of the first navigation sensor device as behaving as the first marker detection device in the first step of the medical navigation workflow, and a function of the second navigation sensor device as behaving as the second marker device in the first step of the medical navigation workflow, wherein the first navigation sensor device is responsive to a first control signal received from the control unit to behave as the first marker detection device in the first step of the medical navigation workflow, the first navigation sensor device when behaving as the first marker detection device transmitting to the control unit: position output data of the first position sensor of the first navigation sensor device imaging, while the first navigation sensor device is positioned in the fixed position relative to the associated first target, one or more optical markers displayed by the second marker device of the second navigation sensor device, and orientation output data of the first orientation sensor of the first navigation sensor device determining an orientation of the first navigation sensor device relative to a selected reference, wherein the second navigation sensor device is responsive to the first control signal received from the control unit to behave as the second marker device in the first step of the medical navigation workflow, the second navigation sensor device when behaving as the second marker device displaying, while the second navigation sensor device is positioned in the fixed position relative to the associated second target, the one or more optical markers comprising a plurality of optically detectable markers operatively coupled with the second housing and disposed in a predetermined spatial relationship relative to each other, and transmitting to the control unit: orientation output data of the second orientation sensor of the second navigation sensor device determining an orientation of the second navigation sensor device relative to the selected reference, wherein the control unit receives: i) the position output data of the first position sensor from the first navigation sensor device, ii) the orientation output data of the first orientation sensor from the first navigation sensor device, and iii) the orientation output data of the second orientation sensor from the second navigation sensor device, and determines a relative position between the first and second navigation sensor devices based on the position output data of the first position sensor of the first navigation sensor device, the orientation output data of the first orientation sensor of the first navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
2. The medical tracking system according to claim 1, wherein the control unit determines the relative position between the first and second navigation sensor devices as: a position of the first navigation sensor device relative to the second navigation sensor device, or a position of the second navigation sensor device relative to the first navigation sensor device.
3. The medical tracking system according to claim 1, wherein: the first orientation sensor of the first navigation sensor device comprises one or more of: a first orientation sensor; and/or a first acceleration sensor; the first position sensor of the first navigation sensor device comprises one or more of: a first marker device detector; a first still camera; a first video camera; a first two-dimensional (2D) camera; a first three-dimensional (3D) camera; and/or a first ultrasound receiver; the second orientation sensor of the second navigation sensor device comprises one or more of: a second orientation sensor; and/or a second acceleration sensor; the second position sensor of the second navigation sensor device comprises one or more of: a second marker device detector; a second still camera; a second video camera; a second two-dimensional (2D) camera; a second three-dimensional (3D) camera; and/or a second ultrasound receiver.
4. The medical tracking system according to claim 1, wherein: the second navigation sensor device comprises a display unit operable to display the one or more optical markers in the first step of the medical navigation workflow; and the first position sensor of the first navigation sensor device comprises one or more of: a second marker device detector; a second still camera; a second video camera; a second two-dimensional (2D) camera; a second three-dimensional (3D) camera; and/or a second ultrasound receiver operable to image in the first step of the medical navigation workflow the one or more optical markers displayed by the display unit.
5. The medical tracking system according to claim 1, wherein the second navigation sensor device acts as a pointer device in the first step of the medical navigation workflow, wherein the second housing is coupled with an associated pointer rod member as the associated second target in the first step of the medical navigation workflow.
6. The medical tracking system according to claim 1, wherein: the control unit receives the position output data from the first navigation sensor device as an image captured by the first position sensor of the first navigation sensor device; and the control unit determines in the first step of the medical navigation workflow the relative position between the first and second navigation sensor devices based on the received image, the orientation output data of the first orientation sensor of the first navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
7. The medical tracking system according to claim 1, wherein: the control unit receives the position output data from the first navigation sensor device as relative position data representative of a position of the second navigation sensor device relative to the first navigation sensor device; and the control unit determines in the first step of the medical navigation workflow the relative position between the first and second navigation sensor devices based on the received relative position data, the orientation output data of the first orientation sensor of the first navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
8. The medical tracking system according to claim 1, wherein the control unit is disposed in the first housing of the first navigation sensor device.
9. The medical tracking system according to claim 1, wherein: the control unit selects, based on a second step of the medical navigation workflow, the function of the first navigation sensor device as behaving as the first marker device in the second step of the medical navigation workflow, and the function of the second navigation sensor device as behaving as the second marker detection device in the second step of the medical navigation workflow, wherein the first navigation sensor device is responsive to a second control signal received from the control unit to behave as the first marker device in the second step of the medical navigation workflow, the first navigation sensor device when behaving as the first marker device displaying, while the first navigation sensor device is positioned in the fixed position relative to an associated third target, one or more optical markers comprising a plurality of optically detectable markers operatively coupled with the second housing and disposed in a predetermined spatial relationship relative to each other, and transmitting to the control unit: orientation output data of the first orientation sensor of the first navigation sensor device determining an orientation of the first navigation sensor device relative to the selected reference, wherein the second navigation sensor device is responsive to the second control signal received from the control unit to behave as the second marker detection device in the second step of the medical navigation workflow, the second navigation sensor device when behaving as the second marker detection device transmitting to the control unit: position output data of the second position sensor of the second navigation sensor device imaging, while the second navigation sensor device is positioned in a fixed position relative to an associated fourth target, one or more optical markers displayed by the first marker device of the first navigation sensor device, and orientation output data of the second orientation sensor of the second navigation sensor device determining an orientation of the second navigation sensor device relative to the selected reference, wherein the control unit receives: i) orientation output data of the first orientation sensor from the first navigation sensor device, ii) position output data of the second position sensor from the second navigation sensor device, and iii) orientation output data of the second orientation sensor from the second navigation sensor device, and determines a relative position between the first and second navigation sensor devices based on the orientation output data of the first orientation sensor of the first navigation sensor device, the position output data of the second position sensor of the second navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
10. The medical tracking system according to claim 9, wherein the control unit determines the relative position between the first and second navigation sensor devices as: a position of the first navigation sensor device relative to the second navigation sensor device, or as a position of the second navigation sensor device relative to the first navigation sensor device.
11. The medical tracking system according to claim 9, wherein the first navigation sensor device acts as a pointer device in the second step of the medical navigation workflow, wherein the first housing is coupled with an associated pointer rod member as the associated third target in the second step of the medical navigation workflow.
12. The medical tracking system according to claim 9, wherein: the control unit receives the position output data from the second navigation sensor device as an image captured by the second position sensor of the second navigation sensor device; and the control unit determines in the second step of the medical navigation workflow the relative position between the first and second navigation sensor devices based on the received image, the orientation output data of the first orientation sensor of the first navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
13. The medical tracking system according to claim 9, wherein: the control unit receives the position output data from the second navigation sensor device as relative position data representative of a position of the first navigation sensor device relative to the second navigation sensor device; and the control unit determines in the second step of the medical navigation workflow the relative position between the first and second navigation sensor devices based on the received relative position data, the orientation output data of the first orientation sensor of the first navigation sensor device, and the orientation output data of the second orientation sensor of the second navigation sensor device.
14. The medical tracking system according to claim 9, wherein the control unit is disposed in the second housing of the second navigation sensor device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present invention shall be explained in more detail with reference to the accompanying drawings. The figures show:
(2)
(3)
(4)
(5)
DETAILED DESCRIPTION
(6)
(7) In this exemplary example, a sensor device 1, 2 comprises a processor or central processing unit (CPU) 3 which is connected to a display 4, the gyroscope 5, two cameras 6 and 7 and a Bluetooth transceiver 8. The 2D-cameras 6 and 7 are located on opposite sides of a housing of the sensor device 1, 2. Preferably, camera 6 is located on the same side as the display 4. The cameras 6 and 7 act as position sensors. A sensor device 1,2 further comprises an optional distance sensor 19.
(8) The gyroscope 5 is configured to determine orientation data which represent the orientation of the sensor device 1, 2 in three rotational dimensions in an absolute, ground-fixed reference system based on the direction of gravity. The gyroscope 5 acts as an orientation sensor. The processor 3 acts as control unit. This means that both sensor devices 1, 2 comprise a control unit.
(9) At least one of the sensor devices 1, 2 comprises optical markers 9, which in the present case are rectangles or squares. The markers 9 have the same size and are arranged in a known pattern. This pattern is preferably three-dimensional, which means that the markers 9 are preferably arranged in two or more (parallel) planes. The sizes of some or all of the markers 9 can also be different. The shape of a sensor device can also be used as a marker.
(10)
(11) In the step shown in
(12) In the workflow step shown in
(13) In the implementation shown in
(14) As a preferred option, the AP arrow is overlaid on an image captured by the camera 7 which is located in the housing of the sensor device 1 on an opposite side of the display 4. This image typically shows a part of the tibia, and preferably also a part of the foot. This overlay leads to an improved accuracy of the manually inputted AP direction. In addition or as an alternative, the AP direction can be automatically determined from an image analysis performed by the CPU 3.
(15) In general, any property of an anatomical structure can be acquired by manipulating information, such as an arrow, displayed on the display of a sensor device.
(16) In the workflow steps shown in
(17) The pointer 13 comprises an adaptor for accommodating a sensor device 1 or 2 in an unambiguous, reproducible position relative to its tip. Some or all of the fixed markers 9 may be located on the pointer 13.
(18) In the medical workflow, landmarks of the tibia T are sampled by touching the landmark with the tip of the pointer 13 and determining the position of the markers 9 and 14. Due to the known constellation of the markers relative to the tip of the pointer 13, the position of the tip can be determined from the position of the markers. The positions of the markers are determined by the sensor device 1. The camera 7 of the sensor device 1 captures an image comprising the markers. Due to the known constellation and sizes of the markers, the CPU 3 of the sensor device 1 can analyze the output image of the camera 7 in order to detect the markers and hence the positions of the landmarks in a reference system of the sensor device 1. The CPU 3 uses the size, the shape and the relative positions of the markers in the output image of the camera to determine the position of the tip of the pointer. The position of the markers may be more accurate by using the distance sensor 19, such as a laser beam generator, to calculate the distance of the markers from the sensor device.
(19) A landmark is a defined element of an anatomical body part which is always identical or recurs with a high degree of similarity in the same anatomical body part of multiple patients. Typical landmarks are for example the epicondyles of a femoral bone or the tips of the transverse processes and/or dorsal process of a vertebra. The points (main points or auxiliary points) can represent such landmarks. A landmark which lies on (in particular on the surface of) a characteristic anatomical structure of the body part can also represent said structure. The landmark can represent the anatomical structure as a whole or only a point or part of it. A landmark can also for example lie on the anatomical structure, which is in particular a prominent structure. An example of such an anatomical structure is the posterior aspect of the iliac crest. Other landmarks include a landmark defined by the rim of the acetabulum, for instance by the center of the rim. In another example, a landmark represents the bottom or deepest point of an acetabulum, which is derived from a multitude of detection points. Thus, one landmark can in particular represent a multitude of detection points. As mentioned above, a landmark can represent an anatomical characteristic which is defined on the basis of a characteristic structure of the body part. Additionally, a landmark can also represent an anatomical characteristic defined by a relative movement of two body parts, such as the rotational center of the femur head when moved relative to the acetabulum.
(20) A detection point is in particular a point on the surface of the anatomical structure which is detected, for example by a pointer.
(21) In the workflow step shown in
(22) With the tibia T being registered, the mechanical axis of the tibia T is known. The reference system of the sensor device 1 is in a known relation to the cutting slot 12. As long as the adjustment of the cutting slot 12 is not changed compared to the base 11, then the registration is also known with the base 11 as a reference.
(23) In the next workflow steps, the femur F is registered. In the workflow step shown in
(24) In the workflow step shown in
(25) In the workflow step shown in
(26) In the workflow step shown in
(27) Now that the distal endpoint of the femoral axis, the center of the femoral head and the AP direction of the femur F are known, the femur F is registered in a reference system of the sensor device 2, which is in a fixed relation to a reference system of the cutting slot 17.
(28) In the workflow steps shown in
(29) For the workflow step shown in
(30) In the workflow step shown in
(31) In addition or as an alternative, a reference object 18 is used as a reference. In this implementation, the reference object 18 is imaged by at least one camera 6 or 7 of each sensor device 1 and 2. By image analysis, the relative position of the reference object 18 relative to the sensor devices 1 and 2 is calculated by the respective CPU 3. The position data representing the relative position of the reference object 18 to a sensor device is then transmitted to the other sensor device using the Bluetooth transceivers 7. In this implementation, again, the position information of (just) one sensor device can be transmitted to the other sensor device, or each sensor device can receive the position data from the other sensor device.
(32) After measurement of the relative position, at least one of the sensor devices 1 or 2 knows the relative position, this means at least the relative orientation in three-rotational dimensions, of the other sensor device in its own reference system. The relative spatial location is not needed in the present workflow, but may also be determined. Since the tibia T and the femur F are registered, the sensor device thus also knows the relative position of the femur F and the tibia T. Preferably, the registration data representing the relation of the bone and the sensor device is also transmitted to the other sensor device. This, again, is performed either in one direction only or both sensor devices transmit the registration data.
(33) This approach for determining the relative position between the two sensor devices can also be used if one of the sensor devices is used as a marker device detector, such as in the workflow step shown in
(34) In the workflow step shown in
(35)
(36) In the workflow step shown in
(37) A first measurement of the relative position between the sensor devices 1 and 2 is then performed as explained above with reference to
(38) In this workflow step, the adjustment of the cutting block 10 is tracked using the sensor device 2 as a reference. If the sensor device 1 would use gravity as a reference, then any movement of the tibia T would impair the adjustment of the cutting slot 12. This is overcome by using the sensor device 2, which is rigidly attached to the tibia T via the base 11 of the cutting block 10, as a reference and performing measurements of the relative position by exchanging the orientation data and/or position data.
(39) In the optional workflow step shown in
(40) In the workflow step shown in
(41) In the optional workflow step shown in
(42) The desired setting of the cutting slot 12 or 17, respectively, can be calculated automatically based on a 3D image dataset representing a 3D image of the tibia or femur, respectively. In addition or as an alternative, the varus/valgus value and/or the range of motion acquired in the workflow step described with reference to
(43) When performing a medical workflow using the medical tracking system of this exemplary embodiment, the next step of the workflow is begun once the completion of the previous step is automatically detected or manually inputted. So the completion is typically known only to the sensor device which determines the completion. Thus, this sensor device preferably notifies to the other sensor device(s) of the tracking system that the next step is to be performed. This may result in one or more of the sensor devices to change its function from being a marker device to being a marker detection device or vice versa. In addition, a sensor device may display on its display 4 some guidance information on what to do in the next workflow step, thus leading the operator of the tracking system through the workflow.
(44) A sensor device 1, 2 may further comprise an acceleration sensor (not shown). When the sensor data of the acceleration sensor is integrated over a period of time, this results in an information on the change of the position of the sensor device in this period of time. This information may also be exchanged between the sensor devices and used for calculating the relative position between the sensor devices.
(45) It is to be noted that the methods and workflows described herein do not relate to or comprise any surgical step. In particular, attaching a cutting block to a bone and performing a cut are not part of the present invention. This invention solely relates to the step of navigating, tracking and verifying by acquiring and analyzing data.
(46) Any embodiment described so far may be combined with one or more features of the following additional embodiments, wherein a position sensor is a marker device detector:
Embodiment 1
(47) A medical tracking system comprising at least two sensor devices (1, 2) which are independently maneuverable and can be positioned in a fixed position relative to targets (10, 13, 15), each sensor device (1, 2) comprising at least one of an orientation sensor (5) and a position sensor (6, 7) for respectively determining sensor data, the system further comprising a control unit (3) configured to receive and combine the at least two sensor data of the at least two sensor devices (1, 2) in order to determine a relative position between at least two of the at least two sensor devices (1, 2).
Embodiment 2
(48) The tracking system of embodiment 1, wherein the at least two sensor data represent insufficient information for determining the relative position between the at least two sensor devices (1, 2).
Embodiment 3
(49) The tracking system of embodiment 1 or 2, wherein the at least two sensor data respectively are data describing the relative position between the respective sensor device (1, 2) and a relative position reference (18).
Embodiment 4
(50) The tracking system of one of embodiments 1 to 3, wherein the control unit (3) is located in one of the sensor devices (1, 2), each sensor device (1, 2) comprises a control unit (3) or each sensor device (1, 2) comprises a part of the control unit (3).
Embodiment 5
(51) The tracking system of any one of embodiments 1 to 4, further comprising at least one marker (12) attached to at least one of the sensor devices (1, 2).
Embodiment 6
(52) The tracking system according to any one of embodiments 1 to 5, wherein at least one of the sensor devices (1, 2) comprises an orientation sensor (5) and the control unit (3) is configured to convert orientation data of an orientation sensor (5) into a coordinate system determined by a target (9, 10) to which one of the sensor devices (1, 2) is attached.
Embodiment 7
(53) The tracking system according to any one of embodiments 1 to 6, wherein a position sensor (6, 7) comprises a still or video camera and/or at least one of the sensor devices (1, 2) comprises an orientation sensor (5) and a position sensor (6, 7) and/or at least one of the at least two sensor devices (1, 2) comprises an acceleration sensor.
Embodiment 8
(54) The tracking system of embodiment 7, wherein a position sensor comprises a distance sensor (19) comprising a laser beam source, wherein the laser beam is angled compared to the optical axis of the camera.
Embodiment 9
(55) The tracking system of any one of embodiments 1 to 8, wherein a position sensor (6, 7) is a marker device detector, the sensor device (1, 2) comprises a marker device (9, 14) and the control unit (3) is configured to select the function of the sensor device (1, 2) as either acting as a marker device detector or as a marker device in a step of the medical navigation workflow.
Embodiment 10
(56) A method of determining a relative position between two sensor devices (1, 2) of a medical tracking system, wherein the sensor devices (1, 2) are independently maneuverable and can be positioned in a fixed position relative to targets (10, 13, 15), comprising the steps of determining sensor data comprising at least one of orientation data and position data with two or more of the sensor devices (1, 2) transferring the sensor data to a control unit (3) and determining the relative position between two sensor devices (1, 2) by the control unit (3) by combining the sensor data.
Embodiment 11
(57) The method of embodiment 10, wherein each sensor device (1, 2) is attached to a target (10, 13, 15) and the relative position of the targets (10, 13, 15) is determined from the relative position of the sensor devices (1, 2).
Embodiment 12
(58) The method of embodiment 10 or 11, characterized by using a sensor device (1, 2) comprising a marker device (9, 14) and a position sensor being a marker device detector (6, 7) as a marker device detector in one step of the medical navigation workflow for obtaining information for determining the position of a marker device (9, 14) and using the same sensor device (1, 2) as a marker device in another step of the medical navigation workflow.
Embodiment 13
(59) A method for determining a mechanical property of a joint between two bones, comprising the steps of: positioning a first sensor device (1) in a fixed position relative to the first bone (T), registering the first bone (T) by sampling a plurality of sample points using a pointer (13) and the first sensor device (1), positioning a second sensor device (2) in a fixed position relative to the second bone (F), registering the second bone (T) by sampling a plurality of sample points using a pointer (13) and the second sensor device (2), optionally re-positioning the first sensor device (1) in its fixed position relative to the first bone (T) if the first sensor device was used as a marker device of the pointer in the previous step, determining at least one relative position between the first sensor device (1) and the second sensor device (2) for at least one position of the joint as described in embodiment 10 and determining the mechanical property of the joint between the first bone (T) and the second bone (F) from the at least one relative position between the first sensor device (1) and the second sensor device (2).
Embodiment 14
(60) A method for aiding the adjustment an adjustable cutting block (10, 15) comprising a base (11, 16) and a cutting slot (12, 17) which is adjustable relative to the base (11, 16), the base (11, 16) being attached to a bone (T, F), comprising the steps of positioning a first sensor device (1) in a fixed position relative to the cutting slot (12, 17), registering the bone (T, F) by sampling a plurality of sample points using a pointer (13) and the first sensor device (1) such that the initial alignment of the cutting slot (12, 17) relative to the bone (T, F) is known, positioning a second sensor device (2) in a fixed position relative to the base (11, 16) of the cutting block (10, 15), determining the relative position between the first sensor device (1) and the second sensor device (2) as described in embodiment 10 for the initial alignment of the cutting slot (12, 17), determining the relative position between the first sensor device (1) and the second sensor device (2) as described in embodiment 10 while the cutting slot (12, 17) is adjusted and determining the current alignment of the cutting slot (12, 17) from the initial alignment of the cutting slot (12, 17) and the current relative position between the first sensor device (1) and the second sensor device (2).
(61) Preferably, the sensor data provided by a single sensor device is not sufficient for determining all parameters for all desired dimensions of the relative position. In other words, the sensor data of a single sensor device is not sufficient to determine the desired number of parameters of the relative position. In yet other words, the sensor data of a single sensor device describe insufficient information on the relative position. The number of parameters which can be determined from the sensor data of a single sensor device might be less than the desired number of parameters, or the determination of a parameter might require more than the information given by the sensor data of a single sensor device. However, if the sensor data of two or more sensor devices is combined, the available information (also referred to as sufficient information) is sufficient to determine all parameters for all desired dimensions of the relative position. Preferably, the available information is more than sufficient, such that the information is overdetermined. In this case, the sensor data is also understood as representing sufficient information. This can be used for increasing the quality of the determined relative position.