SYSTEMS AND METHODS FOR BEAMFORNING ULTRASOUND SIGNALS USING ELASTIC INTERPOLATION
20200191928 ยท 2020-06-18
Inventors
- David Hope Simpson (Bothell, WA)
- FRANCOIS GUY GERARD MARIE VIGNON (ANDOVER, MA, US)
- Andrew Hancock (Sacramento, CA)
- Jun Seob Shin (Medford, MA, US)
Cpc classification
A61B8/12
HUMAN NECESSITIES
A61B8/463
HUMAN NECESSITIES
A61B8/485
HUMAN NECESSITIES
G01S7/5208
PHYSICS
G10K11/34
PHYSICS
G01S7/52046
PHYSICS
International classification
Abstract
A method in accordance with the present disclosure may include transmitting an ultrasound pulse toward a medium from a transducer array (305), detecting a plurality of echo signals (313a, 313c, 313e) responsive to the ultrasound pulse using one or more elements of the transducer array (305), generating an interpolated signal (313b, 313d) by interpolating a signal characteristic of at least two existing echo signals after temporally aligning the existing echo signals, and generating ultrasound image data based on one or more existing echo signals and the interpolated signal.
Claims
1. A method of ultrasound imaging, the method comprising: transmitting one or more ultrasound pulses toward a medium from a transducer array; detecting a plurality of received echo signals responsive to the one or more ultrasound pulses using one or more elements of the transducer array; generating an interpolated signal by interpolating a signal characteristic of at least two existing echo signals, wherein the at least two existing echo signals are selected from the group consisting of the plurality of received echo signals and previously interpolated echo signals, and wherein the interpolating is performed concurrently with or following temporal alignment of the at least two existing echo signals; and generating ultrasound image data based on one or more received echo signals and the interpolated signal.
2. The method of claim 1, wherein the interpolating a signal characteristic of at least two existing echo signals comprises: calculating a respective envelope for each of the at least two echo existing echo signals; and estimating an envelope of the interpolated signal by interpolating between the envelopes of the at least two existing echo signals.
3. The method of claim 2 wherein the temporal alignment comprises estimating a temporal characteristic of the interpolated signal and aligning the interpolated signal relative to the at least two echo signals based on the temporal characteristic.
4. The method of claim 3, wherein the temporally aligning the interpolated signal comprises: calculating a displacement vector for a respective envelope of each of the at least two echo signals; weighting the displacement vectors according to an interpolation factor; and averaging the weighted displacement vectors to generate the temporal characteristic of the interpolated signal.
5. The method of claim 2, wherein the calculating a respective envelope for the at least two echo signals comprises using a Hilbert transform to calculate the envelope of each of the at least two echo signals.
6. The method of claim 2, wherein the temporal alignment is responsive to one or more features different from the signal characteristic being interpolated.
7. The method of claim 6, wherein the temporal alignment is responsive to estimated envelopes of the existing echo signals.
8. The method of claim 1, wherein the generating an interpolated signal by interpolating a signal characteristic of at least two existing echo signals includes interpolating between existing signals from more than one transmit pulse.
9. The method of claim 1, wherein the signal characteristic of at least two of the plurality of echo signals corresponds to at least one of an amplitude, a phase, or both the amplitude and the phase of the at least two echo signals.
10. The method of claim 1, further comprising identifying auxiliary information regarding the transducer array and configuring the interpolating of the signal characteristic based in part on the auxiliary information.
11. The method of claim 10, wherein the auxiliary information corresponds to a spacing between elements of the transducer array, and wherein the configuring the interpolating comprises selecting a number of signals to be interpolated between received echo signals based on the spacing between elements.
12. The method of claim 1, further comprising: coherently combining the at least two echo signals and the interpolated signal to generate a beamformed signal.
13. The method of claim 12, wherein the generating ultrasound image data includes coupling the beamformed signal to a Doppler processor, a B-mode processor, or both, to generate Doppler image data, a B-mode image data, or both.
14. A non-transitory computer-readable medium comprising executable instructions, which when executed cause a processor of an ultrasound imaging system to perform the method of claim 1.
15. An ultrasound imaging system comprising: a transducer array configured to transmit an ultrasound pulse toward a medium and receive ultrasound echoes responsive to the ultrasound pulse; a beamformer configured to receive a plurality of echo signals corresponding to the ultrasound echoes and generate an interpolated signal by interpolating a signal characteristic of at least two existing echo signals, wherein the at least two existing echo signals are selected from of the plurality of received echo signals and previously interpolated echo signals, and wherein the beamformer is configured to perform the interpolating concurrently with or following temporal alignment of the at least two existing echo signals; and a processor configured to generate ultrasound image data based on one or more received echo signals and the interpolated signal.
16. The ultrasound imaging system of claim 15, wherein the beamformer is configured to calculate an envelope of each of the at least two existing echo signals and temporally align the at least two existing signals based on the envelopes of the at least two existing echo signals.
17. The ultrasound imaging system of claim 16, wherein the beamformer is configured to generate the interpolated signal by interpolating a signal characteristic of at least two existing echo signals includes interpolating between existing signals from more than one transmit pulse.
18. The ultrasound imaging system of claim 15, wherein the beamformer is configured to temporally align the at least two existing echo signals responsive to one or more signal properties different from the signal characteristic being interpolated.
19. The ultrasound imaging system of claim 18, wherein the beamformer is configured to: calculate a displacement vector for a respective envelope of each of the at least two echo signals; weight the displacement vectors according to an interpolation factor; and average the weighted displacement vectors to generate the temporal characteristic of the interpolated signal.
20. The ultrasound imaging system of claim 15, further comprising: a controller configured to control the beamformer, wherein the beamformer is configured to receive auxiliary information regarding the transducer array from the controller.
21. The ultrasound imaging system of claim 20, wherein the auxiliary information includes information about spacing of elements of the transducer array and wherein the beamformer is configured to interpolate signals in accordance with an interpolation sequence selected based in part on the auxiliary information.
22. The ultrasound imaging system of claim 21, wherein the beamformer is configured to interpolate a number of signal lines between received echo signals and wherein the number is selected based on the spacing of elements of the transducer array.
23. The ultrasound imaging system of claim 15, further comprising: an ultrasound probe including the transducer array and a microbeamformer, and wherein the beamformer corresponds to the microbeamformer.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
DETAILED DESCRIPTION
[0017] Certain details are set forth below to provide a sufficient understanding of embodiments of the disclosure. However, it will be clear to one skilled in the art that embodiments of the disclosure may be practiced without these particular details. Moreover, the particular embodiments of the present disclosure described herein are provided by way of example and should not be used to limit the scope of the disclosure to these particular embodiments.
[0018] Generally described, in delay and sum ultrasonic beamforming systems, ultrasound pulses are transmitted using one or more elements of an ultrasound array and resulting echoes from one or more elements of the array are acquired and digitized by the receive electronics. To form a scan-line representing a single line-of-sight within the image, received echoes from one or more transmit firings are delayed appropriately to compensate for time of flight differences to each location on the line of sight and back again and then summed together with appropriate weights. If the transmit and/or receive apertures are inadequately sampled, then the delay and sum process may cause constructive interference not just at the expected location (the main lobe) but also at other steering angles, forming so-called grating lobes and introducing artifacts into the resulting image. Such constructive interference is a form of aliasing. To minimize grating lobes, phased array transducers may be manufactured with closely spaced elements at a pitch on the order of wavelength and transmission and reception involves most or all elements within the aperture. In many applications, for instance phased array catheters for intravascular ultrasound (IVUS) imaging, the design of adequately sampled arrays may be technically challenging or costly, and the need to pulse and receive on every element may cause similar issues with system design and frame rates. Therefore, systems and methods for forming an adequate image using more sparsely separated elements and/or fewer transmit/receive may be desirable in the field of ultrasound imaging.
[0019] As described herein, interpolation, and more specifically elastic interpolation, may be performed on the received signals (e.g., per channel signal data) to estimate signals for missing elements in the array, such as elements that are not configured to fire in a given transmit or to estimate signals that could have been obtained with a more densely packed array. This approach can be used to increase frame rates and use fewer elements while still generating similar image quality to using all the elements of the array. Additionally or alternatively, by using information about the axial and, optionally, lateral correlation of the echo signals, nominal Nyquist limitations can be overcome and grating lobes commonly associated with under-sampled elements can be suppressed. Such a method may be applied to 1, 1.x and 2-dimensional array transducers and/or beamformers and microbeamformers with under-sampled or sparse apertures. In some embodiments, for example in synthetic aperture systems, elastic interpolation may also, advantageously, be employed to reduce the number of transmit/receive sequences necessary to form an ultrasound image.
[0020] Generally speaking, the process of elastic interpolation involves calculating a new signal (e.g., an interpolated echo signal) from two or more existing (measured or calculated) signals by 1) time-aligning the existing signals, and then 2) combining the time aligned signals to form the interpolated signal. The time-alignment step may be responsive to features of the existing signals (e.g., a feature of an existing echo signal such as the amplitude, phase, and/or respective envelopes of the existing signal) and may vary from sample to sample along the signal. Additionally, in the context of the present application, the term existing signals may be used to refer to signals arising from a single transmit pulse, or they may be signals arising from different transmitted pulses. They may also be interpolated signals (e.g., interpolated echo signals). For example, it may sometimes be desirable to interpolated previously interpolated echo signals and the techniques described herein can be equally applied to such a scenario.
[0021]
[0022]
[0023] In accordance with principles of the present invention, beamforming (e.g., on transmit or receive) may involve elastic interpolation which involves the adaptive local temporal alignment of signals responsive to the signal properties of the detected signal as part of the interpolation process. In some embodiments, the signal processing steps may include the steps of calculating an envelope for each received echo signal, aligning envelopes of the echo signals for example using an optical-flow based technique, and elastically aligning the signals to the missing line signal. In some examples, calculating the envelopes of each echo may be performed using a Hilbert transform. Alignment of the envelopes may be performed, for example using forward and backward displacement vectors, u(k) and v(k), respectively. The vectors u(k) and v(k) may be calculated to map each sample k from the first signal line to the second signal line and vice versa. Signals from the first and second lines may then be elastically aligned to the missing line location, for example by mapping it to of the forward vector u(k) associated with the first line and of the backward vector v(k) associated with the second line, and then averaging the signals together to form an estimate of the missing line signal.
[0024]
[0025] Once the forward and backward vectors between two neighboring received signals have been defined, a missing signal can be interpolated and elastically aligned using the forward and backward vectors u(k) and v(k). Signal characteristics (e.g., signal envelope) for the missing signals may be estimated from the envelopes of the neighboring received signals and temporal characteristics (e.g., the time delay) of the missing signals may be estimated at least in part from the forward and backward vectors u(k) and v(k). The missing signals are thus interchangeably referred to herein as interpolated signals to reflect that they are not received signals but are instead computationally derived. For example, a missing signal (e.g., interpolated signal 313b) may be estimated based, at least in part, on the calculated envelopes of the neighboring received signals 313a and 313c and the forward and backward vectors u(k) and v(k), for example by mapping the maximum of the envelope for the missing signal to a location equal to the average of of the forward vector v(u), labeled as 317 in
[0026] Thus, as described, the process of time-alignment may involve, for example with reference to
[0027] As will be appreciated, elastic interpolation may be performed in this manner to estimate signals that are missing for any number of reasons, such as due to the use of a sparse array (e.g., where the transducer elements may be spaced farther apart than may be computationally desirable) or due to the use of fewer number of elements for a given firing sequence. It is common to use fewer than all elements in an array in a given firing sequence as it is typical to have a greater number of transducer elements than available signal lines within the receiving electronics (e.g., the beamformer). Thus, the techniques described herein may compensate for loss missing signals regardless of the underlying cause for the missing signals. The signal processing steps described herein may be incorporated within the beamformer, which is typically implemented using one or more application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or a high end digital signal processor (DSP) or multiple DSPs. The beamformer processing may be implemented using any combination of hardware and software components as may be suitable for a given application. As will be further appreciated, signals may be elastically interpolated in accordance with the examples herein to include signals for receive beamforming or transmit beamforming. Additionally, interpolation may be performed between signals from more than one transmit pulse. In this manner, interpolated signals for a variety of scenarios may be obtain, including but not limited to interpolate signals from additional (virtual) elements not present in the transducer, interpolate signals from missing, inactive or omitted receive elements, interpolate signals to replace echoes from defective elements, interpolate signals to replace echoes from missing or omitted transmitted pulses.
[0028] In some embodiments, auxiliary information may be utilized to enhance the elastic interpolation. For example, auxiliary information regarding the transducer array such as a distance of the spacing between elements of the array may be used to determine how many interpolation steps should be performed to obtain a sufficient quality image and/or determine the factor applied to the vectors, e.g., to both the forward and backward vectors in the illustrated example, but different factors may be used in other embodiments. In some embodiments, multiple missing lines may be interpolated between two neighboring received lines, and a factor other than may be used for the forward and backward vectors at each interpolated line. The factor may depend upon the number of signal lines being interpolated. For example, in a scenario where two missing lines are interpolated, factors of and (or some other values) of the forward and backward vectors, respectively, may be used for elastically aligning a missing line closest to the first received line and factors of and (or some other values) of the forward and backward vectors, respectively, may be used for elastically aligning a missing line closest to the second received line. In other examples, the auxiliary information may also include information about the timing and/or sequencing of the transmitted pulses. The elastic interpolation process may be repeated for each pair of neighboring received lines to obtain a signal data set including the original received signals and the interpolated signals. The signals in the signal data set may then be further processed, e.g., temporally adjusted by time delays 214, weighted by weights 215, and summed to obtain an enhanced beamformed signal.
[0029]
[0030] The ultrasound imaging system 400 in the embodiment in
[0031] In some embodiments, the microbeamformer 416 may be coupled by a probe cable to a transmit/receive (T/R) switch 418, which switches between transmission and reception and protects the main beamformer 422 from high energy transmit signals. In some embodiments, for example in portable ultrasound systems, the T/R switch 418 and other elements in the system can be included in the ultrasound probe 412 rather than in a separate ultrasound system base. The ultrasound system base typically includes software and hardware components including circuitry for signal processing and image data generation as well as executable instructions for providing a user interface.
[0032] The transmission of ultrasonic pulses from the transducer array 414 may be controlled by the microbeamformer 416, which may be controlled by the transmit controller 420. The transmit controller 420 may be coupled to the T/R switch 418 and the beamformer 422. In some embodiments, the transmit controller 420 may be coupled to the beamformer 422 using a parallel data transfer link which is configured to transmit simultaneously data for multiple or all image lines in a field of view or from multiple or all points within the field of view of the array. The transmit controller 420 may also be coupled to the user interface 424 and receive input from the user's operation of a user controls. The user interface 424 may include one or more input devices such as a control panel, which may include one or more mechanical controls (e.g., buttons, encoders, etc.), touch sensitive controls (e.g., a trackpad, a touchscreen, or the like), and other known input devices.
[0033] Another function which may be controlled by the transmit controller 420 is the direction in which beams are steered. Beams may be steered straight ahead from (orthogonal to) the transducer array 414, or at different angles for a wider field of view. In some embodiments, the partially beamformed signals produced by the microbeamformer 416 may be coupled to the beamformer 422 where partially beamformed signals from individual patches of transducer elements may be combined into a fully beamformed signal. Beamforming with elastic interpolation of intermediate signals as described herein may be performed by the microbeamformer, the beamformer, or both. The beamformed signals are coupled to processing circuitry 450, which may include a signal processor 426, a B-mode processor 428, a Doppler processor 460, or combinations thereof.
[0034] In embodiments of the present invention, the beamformer 422 (or in some cases, the microbeamformer) may include an interpolator 423 which performs elastic interpolation in accordance with the present examples, e.g., in accordance with the process described with reference to
[0035] In some embodiments, the user interface 424 may be configured to display an interface e.g., for receiving instructions for the interpolator 423 or beamformer 422 or microbeamformer 416. The user interface 424 may also be coupled to the beamformer 422 and, thus, coupled to the interpolator 423. The user interface 424 may be configured to provide instructions that control the beamformer, for example to configure the beamformer to receive auxiliary information regarding the transducer array. For example, the auxillary information may include a distance (or spacing) between elements of the transducer array. The user interface 424 may be configured to provide instructions to the interpolator 423 to calculate a time of flight adjustment based on the distance between elements of the transducer array. For example, a user may execute a program at the user interface 424 that provides such instructions to the interpolator 423.
[0036] The signal processor 426 can process the received echo signals in various ways, such as bandpass filtering, decimation, I and Q component separation, and harmonic signal separation. The signal processor 426 may also perform additional signal enhancement such as speckle reduction, signal compounding, and noise elimination. The processed signals may be coupled to a B-mode processor 428 for producing B-mode image data. The B-mode processor can employ amplitude detection for the imaging of structures in the body. The signals produced by the B-mode processor 428 may be coupled to a scan converter 430 and a multiplanar reformatter 432. The scan converter 430 is configured to arrange the echo signals in the spatial relationship from which they were received in a desired image format. For instance, the scan converter 430 may arrange the echo signal into a two dimensional (2D) sector-shaped format, or a pyramidal or otherwise shaped three dimensional (3D) format. The multiplanar reformatter 432 can convert echoes which are received from points in a common plane in a volumetric region of the body into an ultrasonic image (e.g., a B-mode image) of that plane, for example as described in U.S. Pat. No. 6,443,896 (Detmer). A volume renderer 434 may generate an image of the 3D dataset as viewed from a given reference point, e.g., as described in U.S. Pat. No. 6,530,885 (Entrekin et al.).
[0037] In some embodiments, the signals from the signal processor 426 may also be coupled to a Doppler processor 460, which may be configured to estimate the Doppler shift and generate Doppler image data. The Doppler image data may include color data which is then overlaid with B-mode (i.e. grayscale) image data for display. The Doppler processor 460 may be configured to filter out unwanted signals (i.e., noise or clutter associated with non-moving tissue), for example using a wall filter. The Doppler processor 460 may be further configured to estimate velocity and power in accordance with known techniques. For example, the Doppler processor may include a Doppler estimator such as an auto-correlator, in which velocity (Doppler frequency) estimation is based on the argument of the lag-one autocorrelation function and Doppler power estimation is based on the magnitude of the lag-zero autocorrelation function. Motion can also be estimated by known phase-domain (for example, parametric frequency estimators such as MUSIC, ESPRIT, etc.) or time-domain (for example, cross-correlation) signal processing techniques. Other estimators related to the temporal or spatial distributions of velocity such as estimators of acceleration or temporal and/or spatial velocity derivatives can be used instead of or in addition to velocity estimators.
[0038] In some examples, the velocity and power estimates may undergo further threshold detection to further reduce noise, as well as segmentation and post-processing such as filling and smoothing. The velocity and power estimates are then mapped to a desired range of display colors in accordance with a color map. The color data, also referred to as Doppler image data, is then coupled the scan converter 430 where the Doppler image data is converted to the desired image format and overlaid on the B-mode image of the tissue structure containing the blood flow to form a color Doppler overlay image.
[0039] Output (e.g., B-mode images, Doppler images) from the scan converter 430, the multiplanar reformatter 432, and/or the volume renderer 434 may be coupled to an image processor 436 for further enhancement, buffering and temporary storage before being displayed on an image display 438. A graphics processor 440 may generate graphic overlays for display with the images. These graphic overlays can contain, e.g., standard identifying information such as patient name, date and time of the image, imaging parameters, and the like. For these purposes the graphics processor may be configured to receive input from the user interface 424, such as a typed patient name or other annotations. In some embodiments, one or more functions of at least one of the graphics processor, image processor, volume renderer, and multiplanar reformatter may be combined into an integrated image processing circuitry (the operations of which may be divided among multiple processor operating in parallel) rather than the specific functions described with reference to each of these components being performed by a discrete processing unit. Furthermore, while processing of the echo signals, e.g., for purposes of generating B-mode images or Doppler images are discussed with reference to a B-mode processor and a Doppler processor, it will be understood that the functions of these processors may be integrated into a single processor.
[0040]
[0041] During experimental testing of embodiments of the present disclosure, images showing fully sampled and sparsely sampled conventional arrangements were compared against embodiments in which interpolation was performed on transmit and/or receive in accordance with the present disclosure.
[0042]
[0043]
[0044] The method may further include detecting echoes responsive to the transmitted pulses, as shown in block 608. Echoes may be detected using one or more elements of the array. In some embodiments fewer number of elements may be used during a transmit and a receive (also referred to as active elements) than may be physically present in the array. That is some elements may be inactive during any given firing sequence (e.g., transmit/receive cycle). Signals generated by the probe responsive to detected echoes may be referred to herein as received or measured echo signals, while signals generated by the electronics of the probe or ultrasound system (e.g., using interpolation as described herein) may be referred to as calculated echo signals. The received or measured echo signals and the calculated echo signals may collectively be referred to as existing echo signals (that is, existing before a given interpolation step). It will be understood that interpolation according to the present examples may be performed on any two or more existing echo signals, whether measured or calculated.
[0045] Referring back to
[0046] In some examples, the method may optionally utilize auxiliary information (as shown in block 612), such as information about the distance or spacing of elements in the array. In other embodiments, the auxiliary information may include information about the timing and sequencing of the transmitted pulses. The interpolation may be configurable based on the auxiliary information. For example a different number of signal lines may be interpolated between neighboring received lines if the spacing is greater (e.g., in the case of a sparser array) than when using a more densely packed array and/or when utilizing/activating more elements in a given transmit/receive sequence. Optionally, the interpolation factors (e.g., for weighing of the displacement vectors) may depend upon the auxiliary information. As described, to produce imaging data, the beamforming process may also include coherently combining the signal data set that includes at least two existing echo signals and the interpolated signal to generate a beamformed signal. The beamformed signals may then be coupled to a processor (e.g., a signal processor and subsequently to a B-mode processor and/or Doppler processor) to generate the image data and hence images for display.
[0047]
[0048] Referring to the example in
[0049] In various embodiments where components, systems and/or methods are implemented using a programmable device, such as a computer-based system or programmable logic, it should be appreciated that the above-described systems and methods can be implemented using any of various known or later developed programming languages, such as C, C++, FORTRAN, Pascal, VHDL and the like. Accordingly, various storage media, such as magnetic computer disks, optical disks, electronic memories and the like, can be prepared that can contain information that can direct a device, such as a computer, to implement the above-described systems and/or methods. Once an appropriate device has access to the information and programs contained on the storage media, the storage media can provide the information and programs to the device, thus enabling the device to perform functions of the systems and/or methods described herein. For example, if a computer disk containing appropriate materials, such as a source file, an object file, an executable file or the like, were provided to a computer, the computer could receive the information, appropriately configure itself and perform the functions of the various systems and methods outlined in the diagrams and flowcharts above to implement the various functions. That is, the computer could receive various portions of information from the disk relating to different elements of the above-described systems and/or methods, implement the individual systems and/or methods and coordinate the functions of the individual systems and/or methods described above.
[0050] In view of this disclosure it is noted that the various methods and devices described herein can be implemented in hardware, software and firmware. Further, the various methods and parameters are included by way of example only and not in any limiting sense. In view of this disclosure, those of ordinary skill in the art can implement the present teachings in determining their own techniques and needed equipment to affect these techniques, while remaining within the scope of the disclosure. The functionality of one or more of the processors described herein may be incorporated into a fewer number or a single processing unit (e.g., a CPU) and may be implemented using application specific integrated circuits (ASICs) or general purpose processing circuits which are programmed responsive to executable instruction to perform the functions described herein.
[0051] Further, the present system may also include one or more programs which may be used with conventional imaging systems so that they may provide features and advantages of the present system. Certain additional advantages and features of this disclosure may be apparent to those skilled in the art upon studying the disclosure, or may be experienced by persons employing the novel system and method of the present disclosure. Another advantage of the present systems and method may be that conventional medical image systems can be easily upgraded to incorporate the features and advantages of the present systems, devices, and methods.
[0052] Of course, it is to be appreciated that any one of the examples, embodiments or processes described herein may be combined with one or more other examples, embodiments and/or processes or be separated and/or performed amongst separate devices or device portions in accordance with the present systems, devices and methods.
[0053] Finally, the above-discussion is intended to be merely illustrative of the present system and should not be construed as limiting the appended claims to any particular embodiment or group of embodiments. Thus, while the present system has been described in particular detail with reference to exemplary embodiments, it should also be appreciated that numerous modifications and alternative embodiments may be devised by those having ordinary skill in the art without departing from the broader and intended spirit and scope of the present system as set forth in the claims that follow. Accordingly, the specification and drawings are to be regarded in an illustrative manner and are not intended to limit the scope of the appended claims.