INTERVENTIONAL DEVICE RECOGNITION
20180356493 ยท 2018-12-13
Inventors
- Hendrik Roelof Stapert (Rosmalen, NL)
- Carina SNIJDER (EINDHOVEN, NL)
- Ameet Kumar JAIN (BOSTON, MA, US)
- Willem-Jan Arend De Wijs (Oss, NL)
Cpc classification
A61B8/12
HUMAN NECESSITIES
A61B8/463
HUMAN NECESSITIES
A61B34/20
HUMAN NECESSITIES
A61B90/37
HUMAN NECESSITIES
G01S7/52073
PHYSICS
A61B2034/2063
HUMAN NECESSITIES
A61B2090/3782
HUMAN NECESSITIES
G01S15/8977
PHYSICS
A61B8/4438
HUMAN NECESSITIES
International classification
G01S5/30
PHYSICS
A61B90/00
HUMAN NECESSITIES
A61B34/20
HUMAN NECESSITIES
Abstract
The present invention relates to an apparatus (10) for tracking a position of an interventional device (11) respective an image plane (12) of an ultrasound field. The position includes an out-of-plane distance (Dop). A geometry-providing unit (GPU) includes a plurality of transducer-to-distal-end lengths (Ltde.sub.1 . . . n), each length corresponding to a predetermined distance (Ltde) between a distal end (17, 47) of an interventional device (11, 41) and an ultrasound detector (16, 46) attached to the interventional device, for each of a plurality of interventional device types (T.sub.1 . . . N). An image fusion unit (IFU) receives data indicative of the type (T) of the interventional device being tracked; and based on the type (T): selects from the geometry-providing unit (GPU), a corresponding transducer-to-distal-end length (Ltde); and indicates in a reconstructed ultrasound image (RUI) both the out-of-plane distance (Dop) and the transducer-to-distal-end length (Ltde) for the interventional device within the ultrasound field.
Claims
1. Apparatus for determining a position of an interventional device respective an image plane of an ultrasound field defined by a plurality of beams (B.sub.1 . . . k) emitted by an ultrasound transducer array of a beamforming ultrasound imaging system in which the position is determined based on ultrasound signals emitted by the ultrasound transducer array that have been detected by an ultrasound detector attached to the interventional device; the apparatus comprising: an image reconstruction unit (IRU) configured to provide a reconstructed ultrasound image (RUI) corresponding to the image plane based on the ultrasound signals detected by the ultrasound transducer array; and a position determination unit (PDU) configured to identify, based on a correlation of the ultrasound signals emitted by the ultrasound transducer array with the ultrasound signals detected by the ultrasound detector, the position of the interventional device respective the image plane; and wherein the position includes an out-of-plane distance (Dop) corresponding to the shortest distance between the ultrasound detector and the image plane; and a geometry-providing unit (GPU) comprising a plurality of transducer-to-distal-end lengths (Ltde.sub.1 . . . n) wherein each length corresponds to a predetermined distance (Ltde) between a distal end of an interventional device and an ultrasound detector attached to the interventional device, for each of a plurality of interventional device types (T.sub.1 . . . n); and an image fusion unit (IFU) configured to: receive data indicative of the type (T) of the interventional device within the ultrasound field; and based on the type (T) to: select from the geometry-providing unit (GPU), a corresponding transducer-to-distal-end length (Ltde); and to indicate in the reconstructed ultrasound image (RUI) both the out-of-plane distance (Dop) and the transducer-to-distal-end length (Ltde) for the interventional device within the ultrasound field wherein the out-of-plane distance (Dop) is indicated in the reconstructed ultrasound image (RUI) as the size of a first shape (Cop); and wherein the transducer-to-tip length (Ltde) is indicated in the reconstructed ultrasound image (RUI) as the size of a second shape (Cde); and wherein the first shape (Cop) and the second shape (Cde) share a common centre, and wherein the common centre corresponds to the position of the ultrasound detector.
2. The apparatus of claim 1 wherein: the size of the first shape is the radius of a first circle (Cop); and to wherein the size of the second shape is the radius of a second circle (Cde).
3. The apparatus of claim 2 wherein the common centre is located in the image plane at the closest point to the position of the ultrasound detector.
4. The apparatus of claim 2 wherein the image fusion unit (IFU) is further configured such that when the perimeter of the first circle (Cop) and the perimeter of the second circle (Cde) coincide, the first circle and the second circle are indicated as a common circle and at least one of the following occurs: the perimeter of the common circle is indicated in a color that differs from the color of the first circle and from the color of the second circle; the perimeter of the common circle is indicated with a contrast that differs from the contrast of the first circle and from the contrast of the second circle; the common circle is displayed with a dashed perimeter; the perimeter of the common circle is configured to pulse over time.
5. The apparatus of claim 1 further comprising an ultrasound transducer array.
6. The apparatus of claim 1 further comprising an interventional device having an ultrasound detector attached thereto; wherein the ultrasound detector is attached to the interventional device at a predetermined distance (Ltde) from a distal end of the interventional device.
7. The apparatus of claim 1 wherein the beamforming ultrasound imaging system comprises an imaging probe selected from the group: a 2D ultrasound imaging probe, a 3D ultrasound imaging probe, a transrectal ultrasonography probe, an intravascular ultrasound probe, a transesophageal probe, a transthoracic probe, a transnasal probe, an intracardiac probe.
8. The apparatus of claim 1 further comprising an interventional device wherein said interventional device comprises: an ultrasound detector for detecting ultrasound signals emitted by an ultrasound transducer array of a beamforming ultrasound imaging system; and a data carrier; wherein the ultrasound detector is attached to the interventional device at a predetermined distance (Ltde) from a distal end of the interventional device; and wherein the data carrier comprises data indicative of a type (T) of the interventional device, and the data, when received by the image fusion unit (IFU) of the apparatus, causes the image fusion unit (IFU) to: select from the geometry-providing unit (GPU) of the apparatus, the transducer-to-distal-end length (Ltde) corresponding to the predetermined distance between the distal end of the interventional device and the ultrasound detector attached thereto, for the interventional device type (T); and to indicate in the reconstructed ultrasound image (RUI) that is reconstructed by the image reconstruction unit (IRU) of the apparatus the transducer-to-distal-end length (Ltde) for the interventional device within the ultrasound field.
9. The interventional device of claim 8 wherein the ultrasound detector is formed from a piezoelectric material, for example Polyvinylidene fluoride, a PVDF co-polymer such as polyvinylidene fluoride trifluoroethylene, a PVDF ter-polymer such as P(VDF-TrFE-CTFE).
10. The interventional device of claim wherein the interventional device is selected from the group: a needle, a catheter, a guidewire, a probe, an endoscope, an electrode, a robot, a filter device, a balloon device, a stent, a mitral clip, a left atrial appendage closure device, an aortic valve, a pacemaker, an intravenous line, a drainage line, a surgical tool such as a tissue sealing device or a tissue cutting device.
11. Computer program product comprising instructions which when executed on a processor of an apparatus for determining a position of an interventional device respective an image plane of an ultrasound field defined by a plurality of beams (B.sub.1 . . . k) emitted by an ultrasound transducer array of a beamforming ultrasound imaging system in which the position is determined based on ultrasound signals emitted by the ultrasound transducer array that have been detected by an ultrasound detector attached to the interventional device, cause the processor to carry out the method steps of: reconstructing an ultrasound image (RUI) corresponding to the image plane based on the ultrasound signals detected by the ultrasound transducer array; identifying, based on a correlation of the ultrasound signals emitted by the ultrasound transducer array with the ultrasound signals detected by the ultrasound detector, the position of the interventional device respective the image plane; and wherein the position includes an out-of-plane distance (Dop) corresponding to the shortest distance between the ultrasound detector and the image plane; receiving data indicative of a type (T) of the interventional device within the ultrasound field; and based on the type (T): selecting, from a lookup table, a transducer-to-distal-end length that corresponds to a predetermined distance (Ltde) between a distal end of the interventional device and the ultrasound detector attached to the interventional device; indicating, in the reconstructed ultrasound image (RUI), both the out-of-plane distance (Dop) and the transducer-to-distal-end length (Ltde) for the interventional device within the ultrasound field; wherein the out-of-plane distance (Dop) is indicated in the reconstructed ultrasound image (RUI) as the size of a first shape (Cop); and wherein the transducer-to-tip length (Ltde) is indicated in the reconstructed ultrasound image (RUI) as the size of a second shape (Cde); and wherein the first shape (Cop) and the second shape (Cde) share a common centre, and wherein the common centre corresponds to the position of the ultrasound detector.
12. Computer program product of claim 13 wherein the size of the first shape is the radius of a first circle (Cop); and wherein the size of the second shape is the radius of a second circle (Cde),
Description
BRIEF DESCRIPTION OF THE FIGURES
[0018]
[0019]
[0020]
[0021]
[0022]
DETAILED DESCRIPTION OF THE INVENTION
[0023] In order to illustrate the principles of the present invention, various systems are described in which the position of an interventional device, exemplified by a medical needle, is determined within the image plane of an ultrasound field defined by the beams emitted by the linear array of a 2D ultrasound imaging probe.
[0024] It is however to be appreciated that the invention also finds application in determining the positon of other interventional devices such as a catheter, a guidewire, a probe, an endoscope, an electrode, a robot, a filter device, a balloon device, a stent, a mitral clip, a left atrial appendage closure device, an aortic valve, a pacemaker, an intravenous line, a drainage line, a surgical tool such as a tissue sealing device or a tissue cutting device.
[0025] It is also to be appreciated that the invention finds application in beamforming ultrasound imaging systems having other types of imaging probes and other types of ultrasound arrays which are arranged to provide a planar image, such as the 2D array of a 3D imaging probe, a TRUS transrectal ultrasonography probe, an IVUS intravascular ultrasound probe, a TEE transesophageal probe, a TTE transthoracic probe, a TNE transnasal probe, an ICE intracardiac probe.
[0026]
[0027] In-use, the beamforming ultrasound imaging system 15 is operated in the following way. An operator may plan an ultrasound procedure via imaging system interface ISI. Once an operating procedure is selected, imaging system interface ISI triggers imaging system processor ISP to execute application-specific programs that generate and interpret the signals transmitted to and detected by 2D ultrasound imaging probe 18. Beamforming ultrasound imaging system 15 may also include a memory (not shown) for storing such programs. The memory may for example store ultrasound beam control software that is configured to control the sequence of ultrasound signals transmitted by and/or received by imaging probe 18. Image reconstruction unit IRU, which may alternatively form part of imaging system processor ISP, reconstructs data received from the imaging probe 18 into an image corresponding to image plane 12 and which thus intercepts volume of interest VOI, and subsequently displays this image via display DISP. The reconstructed image may for example be an ultrasound Brightness-mode B-mode image, otherwise known as a 2D mode image, a C-mode image or a Doppler mode image, or indeed any ultrasound planar image.
[0028] Also shown in
[0029] In-use, the position of interventional device 11, or more specifically that of ultrasound detector 16 attached thereto, is tracked respective image plane 12 by position determination unit PDU based on the ultrasound signals corresponding to its beams B.sub.1 . . . k that have been detected by ultrasound transducer 16. Position determination unit PDU identifies the position of ultrasound detector 16 based on a correlation of the ultrasound signals emitted by the ultrasound transducer array with the ultrasound signals detected by the ultrasound detector. More specifically this correlation may be based on i) the time delay between emission of each beam B.sub.1 . . . k and its detection by ultrasound detector 16, and ii) based on the amplitude of the ultrasound signals corresponding to each beam detected by the ultrasound detector. In more detail, the correlation essentially determines the ultrasound detector 16 position that, based on the emitted sequence of ultrasound signals, most closely matches the detected ultrasound signals. This may be illustrated as follows. When the ultrasound detector 16 is in the vicinity of image plane 12, ultrasound signals from the nearest of beams B.sub.1 . . . k to the detector will be detected with a large amplitude whereas more distant beams will be detected with relatively smaller amplitudes. This amplitude can be modeled to vary in dependence on the range between the emitter and the detector, and the out-of-plane distance Dop between the detector 16 and the image plane 12. Moreover the time delay between emission and detection of the beam depends upon the range between the emitter and the detector for each emitted beam. The range is determined by multiplying the time delay by the speed of ultrasound propagation. The correlation between the ultrasound signals emitted by the ultrasound transducer array with the ultrasound signals detected by the ultrasound detector determines the best fit position of ultrasound detector 16 respective image plane 12. The out-of-plane distance may also be obtained by triangulating the position of the detector respective the ultrasound image plane.
[0030] The geometry-providing unit GPU of the first embodiment includes a plurality of transducer-to-distal-end lengths. Moreover, each length corresponds to a predetermined distance between a distal end of an interventional device and an ultrasound detector attached to the interventional device, for each of a plurality of interventional device types. The geometry-providing unit GPU may, for example, be provided by a lookup table.
[0031] The image fusion unit IFU of the first embodiment is arranged to receive data indicative of the type T of the interventional device within the ultrasound field. Moreover, based on the type T of the interventional device, the image fusion unit IFU selects from the above-described geometry-providing unit GPU, a corresponding transducer-to-distal-end length Ltde; and indicates in the reconstructed ultrasound image that is reconstructed by the image reconstruction unit IRU, both the out-of-plane distance Dop and the transducer-to-distal-end length Ltde for the interventional device within the ultrasound field. Since both the out-of-plane distance Dop and the transducer-to-distal-end length Ltde are indicated in the reconstructed image by image fusion unit IFU, it is immediately apparent when the distal end of the interventional device is in image plane 12. Moreover, the image fusion unit IFU that automatically selects the corresponding transducer-to-distal-end length Ltde from the geometry-providing unit GPU allows the tracking system to operate with different types of interventional device, and to correctly indicate their geometry in the reconstructed ultrasound image.
[0032] Each of the units: image fusion unit IFU, geometry-providing unit GPU, position determination unit PDU, and image reconstruction unit IRU may be provided by one or more processors including instructions to perform its respective function. Moreover, one or more of these units may be provided by imaging system processor ISP of beamforming ultrasound imaging system 15.
[0033] In one implementation the type T of the interventional device may be received by image fusion unit IFU wirelessly from a data carrier associated with the interventional device. In this example the data carrier may be, for example, an RFID chip, or a barcode or a QR code. In another example the data may be received via wired communication with the data carrier, for example from a memory associated with the interventional device. Thus the data carrier may be, for example, an RFID chip, or a barcode such as a linear or matrix barcode or a QR code, a memory or indeed any machine-readable data carrier. The image fusion unit may thus include a reader such as a barcode reader, an RFID reader, or a data reader for reading a memory, for reading the data in the data carrier. Alternatively a user may input this data manually to the image fusion unit.
[0034] The out-of-plane distance Dop and the transducer-to-distal-end length Ldte may be indicated in the reconstructed ultrasound image by various means, including in the form of a numerical indicator, a dial, or as a shape having a size that corresponds to the respective distance, or length. This may be provided for example as an overlay image on the reconstructed image, i.e. by fusing data from the indicator with the ultrasound image. Various colors may also be used to provide the desired indication. In a preferred example that is illustrated in
[0035] Optionally, the image fusion unit may be further configured such that when the perimeter of the first circle and the perimeter of the second circle coincide, the first circle and the second circle are indicated as a common circle and at least one of the following occurs i) the perimeter of the common circle is indicated in a color that differs from the color of the first circle and from the color of the second circle; ii) the perimeter of the common circle is indicated with a contrast that differs from the contrast of the first circle and from the contrast of the second circle; iii) the common circle is displayed with a dashed perimeter; iv) the perimeter of the common circle is configured to pulse over time. These indications in the common circle alert to a user that the tip of the interventional device is in-plane respective the image plane of the ultrasound imaging system.
[0036]
[0037] In
[0038] Thus, when the interventional device of
[0039] Optionally the data carrier's data, when received by the image fusion unit IFU of
[0040] Optionally the data carrier's data, when received by the image fusion unit IFU of
[0041] Optionally the data carrier's data, when received by the image fusion unit IFU of
[0042] Advantageously these additional effects that are triggered in the image fusion unit IFU bring about improved accuracy of determination of the position of the interventional device respective the image plane of the beamforming ultrasound imaging system.
[0043] Whilst the exemplary interventional device illustrated in
[0044] The ultrasound detector 46 illustrated in
[0045] Preferably ultrasound detector 46 is formed from Polyvinylidene fluoride, otherwise known as PVDF whose mechanical properties and manufacturing processes lend themselves to attachment to curved surfaces such as needles. Alternative materials include a PVDF co-polymer such as polyvinylidene fluoride trifluoroethylene, a PVDF ter-polymer such as P(VDF-TrFE-CTFE). Preferably the ultrasound detector is wrapped around an axis of the interventional device in order to provide sensing around 360 degrees of rotation about the axis although this need not always be the case. Moreover, the ultrasound detector may include various wires or a wireless communication module that are not shown in
[0046]
[0047] The computer program product may be provided by dedicated hardware, or hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term processor or controller should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor DSP hardware, read only memory ROM for storing software, random access memory RAM, non-volatile storage, etc. Furthermore, embodiments of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable storage medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that may include, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or apparatus or device, or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory RAM, a read-only memory ROM, a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory CD-ROM, compact disk-read/write CD-R/W, Blu-Ray and DVD.
[0048] In the above first, preferred embodiment described above in relation to
[0049] In a third embodiment of the invention, which may be used in combination with either the first or the second embodiments, or as an alternative thereto, the data carrier may include a data field indicative of one or more of the following: a length of the ultrasound detector along an axis extending between the ultrasound transducer and the distal end of the interventional device; a width of the ultrasound detector perpendicular to an axis extending between the ultrasound transducer and the distal end of the interventional device. Such data may also be indicated in the reconstructed image by the image fusion unit IFU. The respective parameter may for example be indicated in the form of the thickness of the perimeter of the first circle Cop or of the second circle Cde, or by third circle having a radius that corresponds to the extent of the ultrasound transducer and which shares a common centre with the second circle Cde. In this way perimeter thickness, or the extent of the third circle is indicative of the uncertainty of the position of the interventional device arising from the ultrasound detector's finite length and width. Either of these data fields may be stored on the data carrier and thus received therefrom by the image fusion unit IFU, or associated with the interventional device Type and stored in a lookup table similar to that of