METHOD AND APPARATUS TO PRODUCE ULTRASONIC IMAGES USING MULTIPLE APERTURES
20210378633 · 2021-12-09
Inventors
Cpc classification
A61B8/543
HUMAN NECESSITIES
A61B8/4494
HUMAN NECESSITIES
G01S7/52046
PHYSICS
A61B8/4455
HUMAN NECESSITIES
A61B8/4483
HUMAN NECESSITIES
A61B8/085
HUMAN NECESSITIES
A61B8/42
HUMAN NECESSITIES
G01S15/8977
PHYSICS
A61B8/483
HUMAN NECESSITIES
A61B8/4281
HUMAN NECESSITIES
A61B8/4245
HUMAN NECESSITIES
A61B8/5207
HUMAN NECESSITIES
A61B5/725
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B8/00
HUMAN NECESSITIES
Abstract
A combination of an ultrasonic scanner and an omnidirectional receive transducer for producing a two-dimensional image from received echoes is described. Two-dimensional images with different noise components can be constructed from the echoes received by additional transducers. These can be combined to produce images with better signal to noise ratios and lateral resolution. Also disclosed is a method based on information content to compensate for the different delays for different paths through intervening tissue is described. The disclosed techniques have broad application in medical imaging but are ideally suited to multi-aperture cardiac imaging using two or more intercostal spaces. Since lateral resolution is determined primarily by the aperture defined by the end elements, it is not necessary to fill the entire aperture with equally spaced elements. Multiple slices using these methods can be combined to form three-dimensional images.
Claims
1. An ultrasound imaging method, comprising the steps of: transmitting an ultrasonic pulse into a target tissue with a first ultrasound transducer array; receiving echoes from the ultrasonic pulse with the first ultrasound transducer array and with a second ultrasound transducer array; digitizing and storing the echoes received by the first ultrasound transducer array and by the second ultrasound transducer array; forming a first image with the echoes received by the first ultrasound transducer array; forming a second image with the echoes received by the second ultrasound transducer array; adjusting one or more variables of the second image to cause the first image and the second image to coincide; and combining the first image with the second image.
2. The method of claim 1, wherein adjusting one or more variables comprises adjusting one or more of a position (x.sub.0, y.sub.0, z.sub.0) of the second ultrasound transducer array relative to the first ultrasound transducer array.
3. The method of claim 1, wherein adjusting one or more variables comprises adjusting an average difference in time (D) for the ultrasound pulse and/or echoes to travel through the target tissue.
4. The method of claim 1, wherein the first ultrasound transducer array is separated from the second ultrasound transducer array by a gap.
5. The method of claim 1, wherein the first ultrasound transducer array and the second ultrasound transducer array are mounted in a rigid probe.
6. The method of claim 1, wherein the first ultrasound transducer array and the second ultrasound transducer array are mounted in an adjustable, extendable, hand-held probe.
7. The method of claim 1, wherein the first ultrasound transducer array and the second ultrasound transducer array are mounted using an adhesive mesh.
8. The method of claim 1, wherein the first transducer array and the second transducer array are mounted in a fixture with articulated joints and sensors configured to measure relative positions of the first transducer array and the second transducer array.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
DETAILED DESCRIPTION OF THE INVENTION
[0039] A key element of the present invention is that returned echoes in ultrasonography can be detected by a separate relatively non-directional receive transducer located away from the insonifying probe (transmit transducer), and the non-directional receive transducer can be placed in a different acoustic window from the insonifying probe. This probe will be called an omni-directional probe because it can be designed to be sensitive to a wide field of view.
[0040] If the echoes detected at the omni probe are stored separately for every pulse from the insonifying transducer, it is surprising to note that the entire two-dimensional image can be formed from the information received by the one omni. Additional copies of the image can be formed by additional omni-directional probes collecting data from the same set of insonifying pulses.
[0041] A large amount of straightforward computation is required to plot the amplitude of echoes received from the omni. Referring now to
[0042] This procedure will produce a sector scan image similar to that using the conventional technique except that the point spread function will be rotated.
[0043]
[0044]
[0045] Specular reflection is reduced using the omni probe compared to using the main probe for both insonification and detection. This is because all parts of a surface normal to the main beam are insonified with the same phase. When the phase is such that maximum echo is returned, all the echoes add to produce a specular echo. When the signals are normalized to accommodate the dynamic response of a particular display device, non-specular echoes will tend to drop out.
[0046] In contrast to this, and referring now to
[0047] An algorithm to plot this data on a rectangular grid is: (a) for each point on the x,y grid, convert x,y to depth and angle; (b) then find closest angle k scanned by the insonifying beam; (c) if it is sufficiently close, then convert x,y to distance to the omni; (d) compute time t=(distance to insonifying beam+distance to omni)/v; and (e) plot amplitude recorded by the omni for the k scan at x,y.
[0048] However, more information is available and should be used. It is possible to use the same technique to plot additional scan lines which were not explicitly insonified by the insonifying probe. Because of the inherently wide beam width of medical ultrasonic probes, much tissue between intentional scan lines is also insonified and returns echoes. Making use of this information is particularly important when capturing motion (especially in echocardiography) because the number of pulses that can be generated is strictly limited by the speed of ultrasound in tissue and the scan repetition rate desired.
[0049] The reconstructed image will get better as the angle between the main beam and the omni gets larger. However it is not necessary to focus a narrow beam on every element of tissue to be imaged as is true if the data is not stored and then processed before display. The lateral resolution can be reconstructed using a Wiener filter to be much better than the beam width if the noise spectrum is low enough. In one simulation of 2 circles of diameter 2.2 mm and 4.0 mm, both imaged well enough that the center was clear even though the beam width was 4.4 mm tapered from 1 to 0 by a cosine function. The Wiener filter is described in the next section.
[0050] There are four main sources of noise in ultrasonic imaging: (1) blur due to array size not wide enough; (2) shot noise; (3) reverberation from big interfaces; and (4) speckle.
[0051] Multiple probes give independent measures of shot noise, but using closely spaced elements in the main probe (if it is a phased array) will not give independent noise for the other three sources. Adding one or more omni probes will change the look angle, which will thereby change the speckle pattern and the reverberation pattern. These can be averaged out to lower the noise power spectrum. The Wiener filter can then be employed to cancel the blur.
[0052] Another way to eliminate speckle is to obtain a good sample of it for estimates of the noise spectrum to then be used in the Wiener filter.
[0053] De-blurring and de-noising by these techniques using only an external omni probe or probes will make it possible to visualize small and moving objects such as the coronary arteries. In such a case medical personnel could assess the degree of opening in the lumen or patency of bypass grafts without resort to invasive catheterization techniques.
[0054] When combining more than one image such as one from the main probe and another from one or more omni probes for the purpose of averaging out the various sources of noise, it is necessary to compensate for the variation in ultrasound velocity through different paths. Experiments have shown that small unaccounted errors in path velocity will displace the reconstructed image in both horizontal and vertical positions. Cross correlation techniques should be used to find the displacement with one image taken as reference before addition or other combination of images.
[0055] Two possibilities exist with regard to the Wiener filter. In one, a Wiener filter can be used separately on each image and then combine them. Alternatively, one can first combine the images (yielding a more complex point spread function) and then employ Wiener filtering.
[0056] In order to perform the indicated computations, it is necessary to either measure or estimate the position (x.sub.0, y.sub.0, z.sub.0) of the omni relative to the main probe. Exact knowledge of these positions is not required because, as we have seen, the displacement of the image from the omni probe is also affected by the variation of the velocity of ultrasound in different types of tissue. For this reason it is necessary to use cross correlation or some other matching criterion to make a final correction of the position of the omni-generated image before combining with the reference image or images.
[0057] Determining the Position of the Omni Probe(s): There are many ways to determine the position of the omni probe. Referring now to
[0058] Another method is to have no mechanical connection between the omni probe and the main probe (except wires for signals and power). Instead, the omni probe can transmit a signal using radio frequencies, light, or a different frequency ultrasound to triangulation receivers mounted on the main probe or a separate platform.
[0059] A third method again has no mechanical connection between the omni probe and main probe. For this method the omni probe (or probes) can be attached to the patient with tape, and the ultrasonographer can manipulate the main probe to find the best image without regard to positioning the omni probe(s). As indicated in
[0060] When the application requires the highest resolution compatible with capturing motion at a high frame rate, the four variables can be estimated over several frames of information. When the ultrasonographer has selected a good view angle, the frames can be combined at high rate holding x.sub.0, y.sub.0, z.sub.0 and D constant.
[0061] When the application requires the highest possible resolution, data can be captured (perhaps with EKG gating to capture separate images at systole and diastole) and the multi-dimensional search to optimize matching can be done more accurately although not in real time. Two advantages of this approach is that different values of D can be found for systole and diastole, and that different psf s can be used for deconvolution at different depths in the image.
[0062] Determining the Position of the Omni Probe(s) Using Correlation of the Scan Line Data Rather than Complete 2D Sectors: A fourth method for determining the position of the omni probe(s) entails replacing the omni probe or probes with a “semi-omni probe” or probes. The reason for this is to increase the signal to noise ratio by restricting the sensitive region of the receive transducer to a plane rather than a hemisphere. Because of this restriction it is necessary to have a mechanical linkage to ensure that both the transmit and receive transducers are focused on the same plane.
[0063] Two probes could be placed in any two acoustic windows. In the case of echocardiography, one would likely be in the normal parasternal window which typically gives the clearest view of the whole heart. A second window available in most patients is the apical view. Another window usually available is the subcostal. The two probes could even be placed on either side of the sternum or in parasternal windows in two intercostal spaces.
[0064] One probe could be the standard phased array cardiac probe. The second (and third, etc.) would be used as receive only. Theoretically it could be omnidirectional, but that would necessarily provide lower signals and therefore low signal to noise ratios (S/N). A better alternative is to use a probe which is ground to be sensitive to a plane of scan but omnidirectional within that plane. A single piece of PZT would work well, but to minimize the amount of new design required it is also possible to use a second probe head similar to the main probe and then use individual elements or small groups combined to act as single elements. The design goal is to use as many elements as possible to maximize signal to noise ratio while using few enough to minimize angle sensitivity.
[0065] In this embodiment 600 (see
[0066] The procedure is to aim the main probe 620 at the target 630 (e.g., heart) and position the secondary probe 610 at a second window with maximum received signal strength. One possibility is that the main probe be positioned for a long axis view with the secondary probe over the apex of the heart. Some slight deviation of the long axis view may be necessary in order to maintain the secondary probe in its most sensitive spot.
[0067] The secondary probe would now be held on the patient with a mechanical housing which allows a fan or rocking motion. The disadvantage of having two probes in fixed positions on the body is that the plane of scan must include these two points. The only degree of freedom is the angle at which the scan plane enters the patient's body. For a conventional 2D examination this is a severe limitation, but if the goal is to gather three-dimensional information, this is not a limitation. The 3D information is obtained by rocking the main probe back and forth through a sufficient angle so that the entire heart is insonified. The secondary probe also rocks back and forth by virtue of the mechanical linage between the probes. The instantaneous angle of rocking must be monitored—perhaps by reference to a gyroscope mounted with the main probe. The rocking could be actuated by the hand motion of the ultrasound technician, or it could be motorized for a more-uniform angle rate. In an alternative preferred embodiment (for echocardiography), the main probe and an array of omni probes are placed in adjacent intercostal spaces using a mechanism as shown in
[0068] Computer software could be provided such that the 2D slices would fill a 3D volume of voxels. After adjacent voxels are filled through interpolation, 3D information can be displayed as projections or as slices through the volume at arbitrary orientations.
[0069] The need for and one important use of the 3D information is covered in U.S. patent application Ser. No. 11/532,013, now U.S. Pat. No. 8,105,239, also by the present inventor, and which application is incorporated in its entirety by reference herein.
[0070] Yet another variation on this theme is to have the secondary transducer mechanically linked to the primary so that each plane of scan contains the other transducer (as above), but allow rotation of the main probe about its own axis. In this case the secondary probe would be allowed to move on the patient's body (properly prepared with ultrasound gel). It would have many elements, and an attached computer would scan them all to find those elements which have the strongest return signal.
[0071] Estimating Relative Probe Positions from Reflected Signals: For image reconstruction it is essential to know the position of the secondary probe (x, y) relative to the main probe. This has to be evaluated separately for each frame of data because of the motion of the patient, technician, and/or motorized angle actuator. Since the linkage will prevent any difference in position (z) perpendicular to the scan plane, only x and y need be assessed.
[0072] Note that any tilt of the main probe will change the reference axes so that x and particularly y will change too.
[0073] When a pulse is transmitted from the main probe it insonifies a sequence of tissues in the path of the beam. The returns from the tissues will be received by both the main probe and the secondary, digitized and stored in the computer. Echoes from relatively proximate tissues will be different for the two probes, but echoes from mid- to far range will be similar. It is possible to use cross correlation to find similar small patches in the two stored returns. They will be similar except for the time delay relative to the launching of the pulse from the main probe. The time delay will be related to the offsets x and y. Values for x and y cannot be determined from one set of time delays, but can be determined by solving a set of simultaneous equations from two detected similar returns. These could be different patches of the same pulse return or from returns from differently directed main pulses.
[0074] Referring now to
[0075] tissue packet at (x.sub.1 y.sub.1) is received at time t.sub.1m, and distance m.sub.1=sqrt(x.sub.1.sup.2+y.sub.1.sup.2)
[0076] tissue packet at (x.sub.2, y.sub.2) is received at time t.sub.2m, and distance m.sub.2=sqrt(x.sub.2.sup.2+y.sub.2.sup.2)
[0077] t.sub.1m corresponds to time of two trips of distance m.sub.1
[0078] t.sub.1ms=2 m.sub.1, where s=speed of ultrasound in same units as m=approx. 1.54×10.sup.6 mm/sec
t.sub.1ss=m.sub.1+sqrt((x.sub.1−x).sup.2+(y.sub.1−y).sup.2).
Similarly, t.sub.2ms=2m.sub.2
t.sub.2ss=m.sub.2+sqrt((x.sub.2−x).sup.2+(y.sub.2−y).sup.2)
(t.sub.1ss−0.5t.sub.1m)=(x.sub.1−x).sup.2+(y.sub.1−y).sup.2
(t.sub.2ss−0.5t.sub.2ms).sup.2=(x.sub.2−x).sup.2+(y.sub.2−y).sup.2 (1)
[0079] Since Xj, y.sub.15 x.sub.2, y.sub.2 and the times are known, one can solve the last two simultaneous equations for x and y. Similarly, if a z offset between the two probes is allowed, x, y, and z can be calculated by solving three simultaneous equations.
[0080] Many more measurements from packet pairs are available. One could make a measurement on several or every scan line (angle) as measured from the main probe. Then we would have many equations in 2 unknowns which can be used to make more-accurate estimations of the 2 unknowns. Since these are nonlinear equations, a search technique can be utilized. One way to accomplish this is to compute error squared over a grid of (x, y) points using the equation:
[0081] The minimum E.sup.2 will indicate the minimum squared error estimate of (x, y). The search should be conducted over the expected range of x and y to save time and to avoid spurious ambiguous minima.
[0082] When the z component of the relative position is not constrained to be zero, the comparable error squared equation is:
[0083] The minimum E.sup.2 will indicate the minimum squared error estimate of (x, y, z).
[0084] If the speed of sound on the return path to the secondary (omni) transducer is different from s due to different types of tissues being traversed, the values of x and y (and z if used) will be different from the geometric values. However, use of these values in the image reconstruction algorithm will automatically compensate for the different speeds.
[0085] Obviously, the probes that have been described for imaging the heart would work equally well for imaging abdominal organs and other parts of the body such as legs, arms, and neck. In fact, use of receive-only transducers in conjunction with a transmit/receive probe would work better for abdominal organs because the orientation of the probe set is not limited by the intercostal spaces formed by the ribs. Whereas the locations of the acoustic windows to the heart limit the orientation of the probe to only a few orientations and it is necessary to rock the probe to gather three dimensional data, the probes can be used on the abdomen in any orientation presently used. Therefore the probes can be used for real-time 2D scans to duplicate presently accepted procedures except with much higher lateral resolution. In fact, this application of the technology may be as important as the application to cardiology (which was our original motivation).
[0086] For abdominal scanning it is not necessary to have an elaborate spacing adjustment between the active transmit/receive elements and the receive-only elements. In fact they could all be mounted together in one rigid probe, either as a linear array or an array with known curvature. Some prior art wide linear arrays exist which insonify tissue by using a small subset of the total number of elements to transmit and receive a beam perpendicular to the array. Then another partially overlapping subset of elements is used to transmit and receive another line parallel to the first one, and so on until an entire scan is completed.
[0087] However, the same array could be partitioned into an active section plus one or more passive sections where all sections would be used for each pulse. The active section of elements would be used in transmit as a sector scanner sending out beams in a sequence of angular paths. On receive, all elements would be treated as independent relatively nondirectional receivers and their outputs would be combined to form a high resolution image by the methods taught in this patent. Cross-correlation image matching to account for the variations in ultrasound speeds could be done separately for each receive element or for groups of elements for which the speed corrections would be nearly the same.
[0088] The concept of mounting the active and receive-only elements on a rigid structure eliminates the necessity for articulating and instrumenting the spacing between elements thus making practical combined probes to be used for trans-esophageal (TEE), trans-vaginal, and trans-rectal imaging.
[0089] A final class of probes would involve putting a receive-only transducer or transducers on the end of a catheter to be inserted in an artery, vein, or urethra while a separated transmit transducer array is applied to the surface of the skin. The advantage of this approach is that the catheter could be positioned close to an organ of interest thereby reducing the total transit distance from the transmit transducer to the receive element and thus higher frequencies could be used for better resolution. The receive element(s) on the catheter would not have to be steered as it (they) would be relatively omnidirectional.
[0090] The Wiener Filter: The Wiener filter itself is not new, but since it is important for the de-convolution step it will be described briefly here in the context of the present invention. The Wiener filter is the mean squared error optimal stationary linear filter for images degraded by additive noise and blurring. Wiener filters are usually applied in the frequency domain. Given a degraded image I(n.m.), one takes the discrete Fourier Transform (DFT) or the Fast Fourier Transform (FFT) to obtain I(u,v). The true image spectrum is estimated by taking the product of I(u,v) with the Wiener filter G(u,v):
Ŝ=G(u,v)I(u,v)
[0091] The inverse DFT or FFT is then used to obtain the image estimate s(n,m) from its spectrum. The Wiener filter is defined in terms of the following spectra:
[0092] (a) H(u,v)—Fourier transform of the point spread function (psf);
[0093] (b) P.sub.s(u,v)—Power spectrum of the signal process, obtained by taking the Fourier transform of the signal autocorrelation;
[0094] (c) P.sub.n(u,v)—Power spectrum of the noise process, obtained by taking the Fourier transform of the noise autocorrelation;
[0095] The Wiener filter is:
[0096] The ratio P.sub.s/P.sub.n can be interpreted as signal-to-noise ratio. At frequencies with high signal to noise ratio, the Wiener filter becomes H.sup.−1(u,v), the inverse filter for the psf. At frequencies for which the signal to noise ratio is low, the Wiener filter tends to 0 and blocks them out.
[0097] P.sub.s(u,v)+P.sub.n(u,v)=|I(u,v)|.sup.2. The right hand function is easy to compute from the Fourier transform of the observed data. P.sub.n(u,v) is often assumed to be constant over (u,v). It is then subtracted from the total to yield P.sub.s(u,v).
[0098] The psf can be measured by observing a wire phantom in a tank using the ultrasound instrument. The Fourier transform of the psf can then be stored for later use in the Wiener filter when examining patients.
[0099] Because the psf is not constant as a function of range, the Wiener filter will have to be applied separately for several range zones and the resulting images will have to be pieced together to form one image for display. A useful compromise might be to optimize the Wiener filter just for the range of the object of interest such as a coronary artery or valve. It will be necessary to store separate Wiener filters for each omni-directional probe and for the main probe when it is used as a receive transducer.
[0100] An alternative to the Wiener Filter for deconvolution is the least mean square (LMS) adaptive filter described in U.S. patent application Ser. No. 11/532,013, now U.S. Pat. No. 8,105,239. LMS Filtering is used in the spatial domain rather than the frequency domain, and can be applied to the radial scan line data, the lateral data at each depth, or both together.
[0101] Image sharpening can be accomplished by the use of unsharp masking. Because aperture blur is much more pronounced in the lateral dimension perpendicular to the insonifying beam) than in the radial dimension, it is necessary to perform unsharp masking in only one dimension. When using a sector scanner, this masking should be performed before scan conversion. When using a linear phased array, the unsharp masking should be performed on each data set of constant range. Unsharp masking consists of intentionally blurring an image, subtracting the result from the original image, multiplying the difference by an arbitrary factor, and adding this to the original image. In one dimension this is the same as blurring a line of data, subtracting it from the original line, and adding a multiple of the difference to the original line.
[0102] Multiple Active Transducers—Two Alternative Approaches: It is possible to use more than one active transducer placed at multiple acoustic windows in order to achieve the same goals of increased lateral resolution and noise suppression. A practical method of providing multiple omni probes is to use a second phased array head in a second acoustic window and then treating each element or group of elements of the second phased array as a separate omni. With this configuration of probes it would be possible to switch the functions of the two probe heads on alternate scans thereby generating images with different speckle patterns which can be averaged out.
[0103] Multiple phased array heads can also be used together so that both are active on the same scan. When two (or more) phased array transducers are placed in the same scan plane, they can be programmed with delays such that they act as a single array with a gap in the array of transducer elements. The advantages of having a gap in the array include a) achieving the lateral resolution of a wide aperture without the expense of filling in acoustic elements through the gap, and b) the gap in the probe or between probes can be fitted over ribs or the sternum. The first advantage applies equally to applications other than cardiac. The disadvantages of multiple active probes is that both the transmit and receive delays have to be recomputed for each new gap dimension and/or angular orientation of one probe relative to the others.
[0104] An active probe with a gap has been demonstrated to produce lateral resolution as good as the probe without the gap. This implies that larger gaps will achieve higher resolution since lateral resolution is determined primarily by the overall aperture. Referring now to
[0105]
[0106]
[0107]
[0108] Having fully described several embodiments of the present invention, many other equivalents and alternative embodiments will be apparent to those skilled in the art. These and other equivalents and alternatives are intended to be included within the scope of the present invention.