ULTRASOUND-BASED DEVICE LOCALIZATION
20220273263 · 2022-09-01
Inventors
- Sibo LI (WALTHAM, MA, US)
- Kunal VAIDYA (BOSTON, MA, US)
- Molly Lara FLEXMAN (MELROSE, MA, US)
- Alyssa Torjesen (Charlestown, MA)
- Ameet Kumar JAIN (BOSTON, MA, US)
- Alvin CHEN (CAMBRIDGE, MA, US)
- Shyam Bharat (Arlington, MA, US)
- Ramon Quido ERKAMP (SWAMPSCOTT, MA, US)
Cpc classification
A61B8/12
HUMAN NECESSITIES
A61B8/4461
HUMAN NECESSITIES
G01S15/8925
PHYSICS
A61B8/483
HUMAN NECESSITIES
A61B8/4245
HUMAN NECESSITIES
International classification
Abstract
A system for localizing a three-dimensional field of view of a beamforming ultrasound imaging probe based on a position indicator disposed within said field of view. The beamforming ultrasound imaging probe transmits and receives ultrasound signals within a three-dimensional field of view comprising a plurality of predetermined sub-volumes, each sub-volume being defined by a two dimensional array of beams. A controller causes the beamforming ultrasound imaging probe to scan the sub-volumes sequentially by transmitting and receiving ultrasound signals corresponding to each beam. A tracking system determines a position of the position indicator within the three-dimensional field of view; and determines a sub-volume in which the position indicator is located. The controller causes the beamforming ultrasound imaging probe to provide a localized field of view including the position of the position indicator by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the position indicator is located.
Claims
1. A system for localizing a three-dimensional field of view of a beamforming ultrasound imaging probe based on a position indicator disposed within said field of view, the system comprising: a beamforming ultrasound imaging probe; a controller; and a tracking system; wherein the beamforming ultrasound imaging probe is configured to transmit and receive ultrasound signals within a three-dimensional field of view comprising a plurality of predetermined sub-volumes each sub-volume being defined by a two-dimensional array of beams; wherein the controller is in communication with the tracking system and the beamforming ultrasound imaging probe and is configured to cause the beamforming ultrasound imaging probe to scan the sub-volumes sequentially by transmitting and receiving ultrasound signals corresponding to each beam; wherein the tracking system is in communication with the beamforming ultrasound imaging probe and is configured to: determine a position of the position indicator within the three-dimensional field of view; determine a sub-volume in which the position indicator is located; and wherein the controller is further configured to cause the beamforming ultrasound imaging probe to provide a localized field of view including the position of the position indicator by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the position indicator is located.
2. The system according to claim 1 wherein: the position indicator is an ultrasound sensor; and wherein localizing the three-dimensional field of view of the beamforming ultrasound imaging probe is based on ultrasound signals detected by the ultrasound sensor; and wherein the tracking system is an ultrasound tracking system; and wherein the ultrasound tracking system is further configured to: receive synchronization signals from the beamforming ultrasound imaging probe, the synchronization signals corresponding to a time of emission of the transmitted ultrasound signals for each beam; and to receive electrical signals generated by the ultrasound sensor in response to the ultrasound signals transmitted by the beamforming ultrasound imaging probe; and to determine the position of the position indicator within the three-dimensional field of view based on the received synchronization signals from the beamforming ultrasound imaging probe and the received electrical signals generated by the ultrasound sensor; determine the sub-volume in which the ultrasound sensor is located, based on the synchronization signals and the first scanned sub-volume having a maximum intensity beam for which an intensity of the generated electrical signals exceeds a predetermined threshold and is the maximum for the respective sub-volume; and wherein the controller is further configured to cause the beamforming ultrasound imaging probe to provide the localized field of view comprising the maximum intensity beam by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the ultrasound sensor is located.
3. The system according to claim 1 wherein the portion of the sub-volume is the entire sub-volume in which the sensor is located.
4. The system according to claim 2 wherein the portion of the sub-volume is a first two-dimensional plane passing through the maximum intensity beam.
5. The system according to claim 4 wherein the controller is further configured to cause the beamforming ultrasound imaging probe to provide a second field of view by further transmitting and receiving ultrasound signals corresponding to a second two-dimensional plane, wherein said second two-dimensional plane includes the maximum intensity beam and is arranged transversely with respect to the first two-dimensional plane.
6. The system according to claim 4 wherein the ultrasound tracking system is further configured to determine a three-dimensional location of the sensor respective the beamforming ultrasound imaging probe, said three-dimensional location (POS) being determined based on the maximum intensity beam and a range between the beamforming ultrasound imaging probe and the sensor for the maximum intensity beam, said range being computed based on a time difference between a time of generation of the maximum generated electrical signal and a corresponding synchronization signal; and wherein the controller is further configured to cause the beamforming ultrasound imaging probe to provide a second field of view by further transmitting and receiving ultrasound signals corresponding to a second two-dimensional plane, wherein said second two-dimensional plane passes through the three-dimensional location of the sensor and is arranged transversely with respect to the first two-dimensional plane.
7. The system according to claim 2 wherein the portion of the sub-volume comprises a predetermined selection of beams surrounding the maximum intensity beam.
8. The system according to claim 7 wherein the predetermined selection of beams is centred on the maximum intensity beam.
9. The system according to claim 1 wherein the beamforming ultrasound imaging probe comprises a transducer array, and wherein the three-dimensional field of view and the localized field of view each have a depth of field along an axis passing through the transducer array; and wherein the depth of field of the localized field of view is less than and within the depth of field of the three-dimensional field of view.
10. The system according to claim 1 wherein the three-dimensional field of view has an angular extent in each of two orthogonal planes, and wherein each sub-volume has an angular extent in one of the two orthogonal planes that is equal to the angular extent of the three-dimensional field of view in the corresponding plane.
11. The system according to claim 1 wherein the three-dimensional field of view has an angular extent in each of two orthogonal planes, and wherein each sub-volume has an angular extent in both of the two orthogonal planes that is less than the angular extent of the three-dimensional field of view in the corresponding plane.
12. The system according to claim 11 wherein the controller is further configured to record the maximum intensity of the electrical signals generated for the localized field of view; and wherein if the maximum intensity of the electrical signals generated for the localized field of view is below the predetermined threshold, the controller is further configured to scan the plurality of sub-volumes starting at the last sub-volume in which the maximum intensity of the electrical signals exceeded the predetermined threshold.
13. A method of localizing a three-dimensional field of view of a beamforming ultrasound imaging probe based on a position indicator disposed within the three-dimensional field of view, the method comprising: causing a beamforming ultrasound imaging probe to transmit and receive ultrasound signals within a three-dimensional field of view comprising a plurality of predetermined sub-volumes, each sub-volume being defined by a two-dimensional array of beams; causing the beamforming ultrasound imaging probe to scan the sub-volumes sequentially by transmitting and receiving ultrasound signals corresponding to each beam; determining a position of the position indicator within three-dimensional field of view; determining a sub-volume in which the position indicator is located; and causing the beamforming ultrasound imaging probe to provide a localized field of view by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the position indicator is located.
14. The method according to claim 13, wherein: the position indicator is an ultrasound sensor; and wherein localizing the three-dimensional field of view of the beamforming ultrasound imaging probe is based on ultrasound signals detected by the ultrasound sensor; and wherein the method further comprises the steps of: receiving synchronization signals from the beamforming ultrasound imaging probe, the synchronization signals corresponding to a time of emission of the transmitted ultrasound signals for each beam; and receiving electrical signals generated by the ultrasound sensor in response to the ultrasound signals transmitted by the beamforming ultrasound imaging probe; and wherein determining the position of the position indicator within three-dimensional field of view is based on the received synchronization signals from the beamforming ultrasound imaging probe and the received electrical signals generated by the ultrasound sensor; and wherein the step of determining the sub-volume in which the position indicator is located is based on the synchronization signals and the first scanned sub-volume having a maximum intensity beam for which an intensity of the generated electrical signals exceeds a predetermined threshold and is the maximum for the respective sub-volume; and wherein the step of using the beamforming ultrasound imaging probe to provide the localized field of view further comprises providing the localized field of view comprising the maximum intensity beam.
15. A non-transitory computer-readable storage medium having a computer program product comprising instructions which, when executed on a processor of a system for localizing a three-dimensional field of view of a beamforming ultrasound imaging probe based on ultrasound signals detected by an ultrasound sensor disposed within the three-dimensional field of view, cause the processor to carry out the method of claim 13.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
DETAILED DESCRIPTION OF THE INVENTION
[0026] In order to illustrate the principles of the present invention, a system is described in which the three-dimensional field of view of a beamforming ultrasound imaging probe is localized based on a position indicator disposed within its field of view. The system includes a beamforming ultrasound imaging probe, a controller and a tracking system. Thereto,
[0027] System SY in
[0028] Beamforming ultrasound imaging probe BUIP in
[0029]
[0030] As illustrated, controller CON in
[0031] As illustrated, tracking system UTS in
[0032] Subsequently, controller CON implements a process that includes causing beamforming ultrasound imaging probe BUIP to provide a localized field of view LFOV including the position of position indicator S by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which position indicator S is located. This is illustrated in
[0033] Thereafter, the localized field of view automatically tracks the position indicator, moving the localized field of view in response to relative movement between the ultrasound imaging probe and the position indicator. This alleviates the need for manual adjustments of the ultrasound imaging probe to provide imaging in the vicinity of the position indicator.
[0034] Constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which position indicator S is located may for example include constraining the transmitting and receiving of ultrasound signals to the entire sub-volume in which the sensor is located. Alternatively it may include constraining the transmitting and receiving of ultrasound signals to a predetermined selection of beams including the position or beam in which position indicator S is located, for example a two-dimensional plane that passes through said position or beam, or two or more two-dimensional intersecting planes that both intercept said position or beam, or providing a new beam pattern that includes the position or beam in which position indicator S is located. In some implementations the beamforming ultrasound imaging probe BUIP includes a transducer array and the three-dimensional field of view 3DFOV and the localized field of view LFOV may each have a depth of field, DOF.sub.3DFOV, DOF.sub.LFOV, along an axis passing through the transducer array TA. In these implementations the depth of field of the localized field of view DOF.sub.LFOV may be less than and within the depth of field of the three-dimensional field of view DOF.sub.3DFOV.
[0035] In some implementations the three-dimensional field of view 3DFOV may have an angular extent in each of two orthogonal planes, and each sub-volume has an angular extent in one of the two orthogonal planes that is equal to the angular extent of the three-dimensional field of view in the corresponding plane.
[0036] In some implementations the three-dimensional field of view 3DFOV has an angular extent in each of two orthogonal planes, and each sub-volume SV.sub.1 . . . n has an angular extent in both of the two orthogonal planes that is less than the angular extent of the three-dimensional field of view 3DFOV in the corresponding plane.
[0037] In some implementations controller CON may implement a process that includes recording the last position of position indicator S and if the position becomes lost or unreliable, for example a signal indicative of the position falls below a predetermined threshold, controller CON may implement a process that also includes scanning the plurality of sub-volumes SV.sub.1 . . . n starting at the last sub-volume at which the position was known or reliable, for example the sub-volume in which the maximum intensity of the electrical signals exceeded the predetermined threshold. Adjacent sub-volumes to this sub-volume may be scanned subsequently. In other implementations, the sub-volumes may be scanned subsequently in a sequential, or in a random, or quasi-random manner.
[0038] As mentioned above, the use of various tracking systems in determining the position of position indicator S within three-dimensional field of view 3DFOV are contemplated. The tracking system may for example be an ultrasound, an (electro)magnetic, or an optical tracking system. The use of both active and passive tracking systems are contemplated, active tracking systems including an energy sensor or emitter as position indicator S, and passive tracking systems including a passive element such as a passive ultrasound reflector or fiducial or a magnet as position indicator S.
[0039] In one specific implementation described in particular detail below the tracking system is an ultrasound tracking system, position indicator S is an ultrasound sensor, and localizing the three-dimensional field of view 3DFOV of beamforming ultrasound imaging probe BUIP is based on ultrasound signals detected by the ultrasound sensor S. In an alternative ultrasound tracking system position indicator S is an ultrasound emitter, and localizing the three-dimensional field of view 3DFOV of beamforming ultrasound imaging probe BUIP is based on ultrasound tracking signals emitted by the ultrasound emitter S that are received by beamforming ultrasound imaging probe BUIP. The ultrasound tracking signals are processed by the beamforming ultrasound imaging probe BUIP and the ultrasound tracking system and a position of ultrasound emitter S within three-dimensional field of view 3DFOV is determined based on the time of flight of the tracking signals between ultrasound emitter S and beamforming ultrasound imaging probe BUIP and a beam selected from beams B.sub.1 . . . k within which the tracking signals are received. Thus, the tracking signals are received and processed by beamforming ultrasound imaging probe as if they were an ultrasound echo received from within the three dimensional field of view 3DFOV. In yet another alternative ultrasound tracking system, a plurality of discrete ultrasound emitters or sensors are disposed on beamforming ultrasound imaging probe BUIP and triangulation is performed on the times of flight of ultrasound tracking signals respectively received by or emitted by an ultrasound sensor or emitter disposed within three dimensional field of view 3DFOV in order to determine a position of the ultrasound sensor or emitter disposed within three dimensional field of view 3DFOV.
[0040] When the tracking system is an ultrasound tracking system and position indicator S is an ultrasound sensor; ultrasound tracking system UTS may implement a process that includes receiving synchronization signals from beamforming ultrasound imaging probe BUIP, the synchronization signals corresponding to a time of emission of the transmitted ultrasound signals for each beam B.sub.1 . . . k; receiving electrical signals generated by ultrasound sensor S in response to the ultrasound signals transmitted by the beamforming ultrasound imaging probe BUIP; determining the position of the position indicator S within the three-dimensional field of view 3DFOV based on the received synchronization signals from the beamforming ultrasound imaging probe BUIP and the received electrical signals generated by the ultrasound sensor S; and determining the sub-volume SV.sub.1 . . . n in which ultrasound sensor S is located, based on the synchronization signals and the first scanned sub-volume having a maximum intensity beam B.sub.max for which an intensity of the generated electrical signals exceeds a predetermined threshold and is the maximum for the respective sub-volume.
[0041] Thus, the synchronization signals identify the beam transmitted by beamforming ultrasound imaging probe BUIP, and by recording the corresponding intensity of each electrical signal generated by ultrasound sensor S, the beam B.sub.max that is closest to the ultrasound sensor position may be determined. Generated electrical signals that are below a predetermined threshold may be ignored, since these could be noise signals that would otherwise erroneously identify the beam closest to which the sensor is located. A maximum intensity beam B.sub.max is ultimately identified, this being the beam for which an intensity of the generated electrical signals exceeds a predetermined threshold and is the maximum for the respective sub-volume. The maximum intensity beam B.sub.max may thus be considered to represent the closest beam to ultrasound sensor S. Moreover, controller CON implements a process that includes causing beamforming ultrasound imaging probe BUIP to provide the localized field of view LFOV comprising the maximum intensity beam B.sub.max by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the ultrasound sensor S is located.
[0042] Thereafter, automatic adjustments of the localized field of view such that that it includes the maximum intensity beam ensure that the localized field moves in response to movements of the ultrasound imaging probe and the sensor. This alleviates the need to manually adjust the position of the ultrasound imaging probe in order to ensure that it remains within the localized field of view.
[0043] The above-described ultrasound tracking system in which the tracking system and the beamforming ultrasound imaging probe BUIP share the same coordinate frame advantageously alleviates the need to register their respective coordinate frames. This removes the need for calibration and may be considered to provide more accurate position determination.
[0044] Sensor S that is used in the ultrasound tracking system described above may be any sensor that is capable of detecting ultrasound signals. The use of piezoelectric and Capacitive Micromachined Ultrasound Transducers, i.e. CMUT, sensors is contemplated in particular. A variety of piezoelectric materials may be used, including both hard and soft piezoelectric materials. Polyvinylidene fluoride, otherwise known as PVDF whose mechanical properties and manufacturing processes lend themselves to attachment to curved surfaces such as medical needles may in particular be used. Alternative materials include a PVDF co-polymer such as polyvinylidene fluoride trifluoroethylene, a PVDF ter-polymer such as P(VDF-TrFE-CTFE). Preferably the ultrasound transducer is wrapped around an axis of the interventional device in order to provide sensing around 360 degrees of rotation about the axis although this need not always be the case. Implementations that use an ultrasound emitter as position indicator S, may likewise employ various materials including piezoelectric materials, or employ a CMUT emitter.
[0045] In implementations using the above-described ultrasound tracking system, the constraining the transmitting and receiving of ultrasound signals to various portions of the sub-volume are contemplated.
[0046] In some implementations that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor the localized field of view LFOV may correspond to the entire sub-volume in which the sensor is located. In another implementations, as illustrated in
[0047] In another implementation that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor, a second two-dimensional plane PL2 may additionally be provided. This is illustrated with reference to
[0048]
[0049]
[0050] In some implementations that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor, a depth of field of the localized field of view may be less than and within the depth of field of the three-dimensional field of view. An ultrasound image with the reduced depth of field may subsequently be displayed by display DISP in
[0051] In some implementations that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor, the three-dimensional field of view 3DFOV may have an angular extent in each of two orthogonal planes, and each sub-volume may have an angular extent in one of the two orthogonal planes that is equal to the angular extent of the three-dimensional field of view in the corresponding plane.
[0052] In some implementations that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor, the three-dimensional field of view 3DFOV has an angular extent in each of two orthogonal planes, and each sub-volume SV.sub.1 . . . n has an angular extent in both of the two orthogonal planes that is less than the angular extent of the three-dimensional field of view 3DFOV in the corresponding plane.
[0053] In some implementations that include an ultrasound tracking system and a position indicator S in the form of an ultrasound sensor, controller CON may implement a process that includes recording the position of position indicator S, and if the position becomes lost or unreliable, for example the electrical signal corresponding to position POS falls below a predetermined threshold, controller CON may implement a process that also includes scanning the plurality of sub-volumes SV.sub.1 . . . n starting at the last sub-volume at which the position was known or reliable, for example the sub-volume in which the maximum intensity of the electrical signals exceeded the predetermined threshold. Adjacent sub-volumes to this sub-volume may be scanned subsequently. In other implementations, the sub-volumes may be scanned subsequently in a sequential, or in a random, or quasi-random manner.
[0054]
[0060] In accordance with one specific implementation of method MET, and in which position indicator S is an ultrasound sensor; and in which localizing the three-dimensional field of view 3DFOV of the beamforming ultrasound imaging probe BUIP is based on ultrasound signals detected by the ultrasound sensor; method MET may further include the steps of: [0061] receiving S3 synchronization signals from the beamforming ultrasound imaging probe BUIP, the synchronization signals corresponding to a time of emission of the transmitted ultrasound signals for each beam B.sub.1 . . . k; and [0062] receiving S4 electrical signals generated by the ultrasound sensor S in response to the ultrasound signals transmitted by the beamforming ultrasound imaging probe BUIP; [0063] and wherein determining S5 the position of the position indicator S within three-dimensional field of view 3DFOV is based on the received synchronization signals from the beamforming ultrasound imaging probe BUIP and the received electrical signals generated by the ultrasound sensor S; and [0064] wherein the step of determining S6 the sub-volume SV1 . . . n in which the position indicator S is located is based on the synchronization signals and the first scanned sub-volume having a maximum intensity beam Bmax for which an intensity of the generated electrical signals exceeds a predetermined threshold and is the maximum for the respective sub-volume; and wherein [0065] the step of causing S7 the beamforming ultrasound imaging probe BUIP to provide the localized field of view LFOV further comprises providing the localized field of view LFOV comprising the maximum intensity beam Bmax.
[0066] One or more of the method steps disclosed herein, particularly those described in relation to the method of
[0067] In summary a system has been described for localizing a three-dimensional field of view of a beamforming ultrasound imaging probe based on a position indicator disposed within said field of view. The system includes a beamforming ultrasound imaging probe, a controller, and a tracking system. The beamforming ultrasound imaging probe transmits and receives ultrasound signals within a three-dimensional field of view comprising a plurality of predetermined sub-volumes, each sub-volume being defined by a plurality of beams. The controller causes the beamforming ultrasound imaging probe to scan the sub-volumes sequentially by transmitting and receiving ultrasound signals corresponding to each beam. The tracking system determines a position of the position indicator within the three-dimensional field of view; determines a sub-volume in which the position indicator is located; and the controller causes the beamforming ultrasound imaging probe to provide a localized field of view including the position of the position indicator by constraining the transmitting and receiving of ultrasound signals to a portion of the sub-volume in which the position indicator is located.
[0068] Various implementations and options have been described in relation to the system, and it is noted that these may be combined to achieve further advantageous effects. Any reference signs in the claims should not be construed as limiting the scope of the invention.