Apparatus and process for electromagnetic imaging
20230355097 · 2023-11-09
Inventors
Cpc classification
A61B5/055
HUMAN NECESSITIES
G06T11/005
PHYSICS
G01N22/00
PHYSICS
G06F17/18
PHYSICS
A61B5/7264
HUMAN NECESSITIES
G06T2211/452
PHYSICS
International classification
Abstract
A computer-implemented process for electromagnetic imaging, the process including the steps of: accessing scattering data representing at least a two-dimensional array of measurements of electromagnetic wave scattering by internal features of an object, wherein the object is generally symmetrical with respect to a plane of symmetry through the object, and each said measurement represents scattering of electromagnetic waves emitted by a corresponding antenna of an array of antennas disposed about the object as measured by a corresponding antenna of the array of antennas; and processing the scattering data to generate image data representing a spatial distribution of at least one internal feature of the object, wherein the generation of the image data does not involve tomographic reconstruction but is in accordance with statistical metrics of similarity between pairs of corresponding regions within the object on either side of the plane of symmetry.
Claims
1. A computer-implemented process for electromagnetic imaging, the process including the steps of: accessing scattering data representing at least a two-dimensional array of measurements of electromagnetic wave scattering by internal features of an object, wherein the object is generally symmetrical with respect to a plane of symmetry through the object, and each said measurement represents scattering of electromagnetic waves emitted by a corresponding antenna of an array of antennas disposed about the object as measured by a corresponding antenna of the array of antennas; and processing the scattering data to generate image data representing a spatial distribution of at least one internal feature of the object, wherein the generation of the image data does not involve tomographic reconstruction but is in accordance with statistical metrics of similarity between pairs of corresponding regions within the object on either side of the plane of symmetry.
2. The computer-implemented process of claim 1, wherein the regions within the object are polygons whose vertices correspond to respective locations of three or more antennas of the array of antennas.
3. The computer-implemented process of claim 1, wherein the step of processing the scattering data includes generating a visibility graph of a time series representation of the scattering data.
4. The computer-implemented process of claim 3, wherein the accessed scattering data is in the frequency domain, and the step of processing the scattering data includes applying an inverse Fourier transform to the accessed the accessed scattering data to generate the time series scattering data.
5. The computer-implemented process of claim 1, wherein the step of processing the scattering data includes selecting a corresponding side of the plane of symmetry with which to associate each statistical metric of similarity.
6. The computer-implemented process of claim 5, wherein the regions of a pair of regions are contained within respective sides of the object with respect to the plane of symmetry, and the selecting is on the basis of similarity metrics between the respective regions and a corresponding region of a reference.
7. The computer-implemented process of claim 5, wherein each of the regions of a pair of regions crosses the plane of symmetry, and the selecting is on the basis of a similarity metric between an upper (and/or lower) portion of each region and a corresponding upper (and/or lower) portion of the other region of the pair of regions, the similarity metrics being computed from scattering parameters representing reflection (e.g., Sii parameters).
8. The computer-implemented process of claim 5, wherein the statistical metrics of similarity are associated with one side of the plane of symmetry selected on the basis of a priori information on the side of the object containing a region of interest having contrasting dielectric properties.
9. The computer-implemented process of claim 1, wherein the step of processing the scattering data includes, for each of a plurality of mesh locations, fusing the statistical metrics of similarity for the mesh location.
10. The computer-implemented process of claim 9, wherein the step of fusing the statistical metrics of similarity includes generating a corresponding expectation value for the statistical metric.
11. The computer-implemented process of claim 1, wherein the object is a human brain, and the at least one internal feature of the object includes a stroke region.
12. The computer-implemented process of claim 11, including classifying the stroke region as being of haemorrhagic or ischemic stroke type in dependence on a comparison of a measure of electromagnetic phase change rate for the stroke region with a corresponding threshold value.
13. At least one computer-readable storage medium having stored thereon at least one of: (i) processor executable instructions and (ii) gate configuration data, which, when executed by at least one processor and/or used to configure gates of a field-programmable gate array, cause the processor and/or the configured gates to execute the process of claim 1.
14. An apparatus for electromagnetic imaging, including: a memory; and at least one processor and/or logic components configured to execute the process of claim 1.
15. An apparatus for electromagnetic imaging, including: an input to receive scattering data representing at least a two-dimensional array of measurements of electromagnetic wave scattering by internal features of an object, wherein the object is generally symmetrical with respect to a plane of symmetry through the object, and each said measurement represents scattering of electromagnetic waves emitted by a corresponding antenna of an array of antennas disposed about the object as measured by a corresponding antenna of the array of antennas; and an imaging component configured to process the scattering data to generate image data representing a spatial distribution of at least one internal feature of the object, wherein the generation of the image data does not involve tomographic reconstruction but is in accordance with statistical metrics of similarity between pairs of corresponding regions within the object on either side of the plane of symmetry.
16. The apparatus of claim 15, wherein the regions within the object are polygons whose vertices correspond to respective locations of three or more antennas of the array of antennas.
17. The apparatus of claim 15, wherein the generation of the image data includes generating a visibility graph of a time series representation of the scattering data.
18. The apparatus of claims 15, wherein the generation of the image data includes selecting one corresponding side of the object, with respect to the plane of symmetry, with which to associate each statistical metric of similarity.
19. The apparatus of claim 15, wherein the generation of the image data includes, for each of a plurality of mesh locations, fusing the statistical metrics of similarity for the mesh location.
20. The apparatus of claim 15, wherein the object is a human brain, the at least one internal feature of the object includes a stroke region, and the imaging component is configured to classify the stroke region as being of haemorrhagic or ischemic stroke type in dependence on a comparison of a measure of electromagnetic phase change rate for the stroke region with a corresponding threshold value.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Some embodiments of the present invention are hereinafter described, by way of example only, with reference to the accompanying drawings, wherein:
[0044]
[0045]
[0046]
[0047]
[0048]
[0049] each of
[0050]
[0051]
DETAILED DESCRIPTION
[0052] Embodiments of the present invention include an apparatus and computer-implemented process for efficient and rapid electromagnetic imaging of one or more internal features of an object and avoiding any form of tomographic reconstruction. The process is generally applicable to any object that is generally symmetrical with respect to an axis of symmetry through the object, and to image one or more internal features that are not themselves symmetrically located or distributed with respect to the axis of symmetry.
[0053] Accordingly, the process described herein includes the steps of generating or otherwise accessing scattering data representing at least a two-dimensional array of measurements of electromagnetic wave scattering by internal features of the object. Each such measurement represents the scattering of electromagnetic waves emitted by a corresponding antenna of an array of antennas disposed about the object, as measured by a corresponding antenna of the array of antennas. The scattering data is processed to generate data (referred to herein for convenience of reference as “image data”, notwithstanding that it is not essential that an “image” as such is ever generated or displayed) representing a spatial distribution of at least one internal feature of the object. As indicated above, the generation of the image data does not require or involve tomographic reconstruction. Rather, it is generated in accordance with statistical metrics of similarity between corresponding regions within the object on either side of the axis of symmetry.
[0054] Although embodiments of the present invention are described below in the context of imaging anomalies such as stroke in the human brain, it should be understood that the described apparatus and process can equally be applied to image internal features of any object (whether biological or otherwise), provided that the object is generally or at least approximately symmetrical with respect to an axis of symmetry through the object, and that the internal features themselves are not symmetrically located with respect to the axis of symmetry.
[0055] In the context of detecting anomalies in the human brain, the process generally relies on the assumption that the two halves of the brain are highly similar in structure and composition, such that any significant asymmetry in electromagnetic interactions with respect to the brain's axis of symmetry is indicative of an anomaly. The process not only identifies such anomalies, but is also able to indicate their specific location and severity within the brain. The ability to do this essentially in real-time is extremely important for the time-critical detection and assessment of strokes and injuries in the brain, where permanent brain injury, disability and death can result if treatment is not performed in a timely manner.
[0056] More specifically, the apparatus and process of the described embodiments exploit multivariate statistics to compute measures of statistical difference between nominally symmetrical regions of the brain. In the described embodiments, these symmetrical regions are in the form of polygons whose vertices correspond to the locations of at least 3 antennas on each side of the axis of symmetry. After all of the statistical measures, also referred to herein as “statistical fields”, have been constructed and computed, their values are fused to generate corresponding probability values.
[0057] As shown in
[0058] The array of microwave antennas 102 is arranged to receive the head 108 of a patient whose brain is to be imaged, as shown, so that each antenna of the array can be selectively energised to radiate electromagnetic waves or signals of microwave frequency into and through the subject's head 108 to be scattered, and the corresponding scattered signals detected by all of the antennas 102 of the array, including the antenna that transmitted the corresponding signal.
[0059] As will be apparent to those skilled in the art, the vector network analyser (VNA) 106 energises the antennas as described above, and records the corresponding signals from the antennas as data (referred to herein as ‘scattering’ data) representing the amplitudes and phases of the scattered microwaves in a form that is known in the art as “scattering parameters” or “S-parameters”. The VNA 106 sends this data to the data processing component 104, which executes an electromagnetic imaging process, as shown in
[0060] Although the data processing component 104 of the described embodiments is in the form of a computer, this need not be the case in other embodiments. As shown in
[0061] The stroke monitoring apparatus includes random access memory (RAM) 114, at least one processor 116, and external interfaces 118, 120, 122, 124, all interconnected by a bus 126. The external interfaces include a network interface connector (NIC) 120 which connects the electromagnetic imaging apparatus to a communications network such as the Internet 126, and universal serial bus (USB) interfaces 118, 122, at least one of which may be connected to a keyboard 128 and a pointing device such as a mouse 130, and a display adapter 124, which may be connected to a display device such as an LCD panel display 134.
[0062] The electromagnetic imaging apparatus also includes an operating system 136 such as Linux or Microsoft Windows, and in some embodiments includes additional software components 138 to 144, including web server software 138 such as Apache, available at http://www.apache.org, scripting language support 140 such as PHP, available at http://www.php.net, or Microsoft ASP, and structured query language (SQL) support 142 such as MySQL, available from http://www.mysql.com, which allows data to be stored in and retrieved from an SQL database 144.
[0063] Together, the web server 130, scripting language module 132, and SQL module 134, in combination with the electromagnetic imaging software components 110 and support files 146 (typically including html, php and/or CGI scripts and associated image files), provide the electromagnetic imaging apparatus with the general ability to allow remote users with standard computing devices equipped with standard web browser software to access the electromagnetic imaging apparatus and in particular to determine (and typically view a visual representation of) the location(s) of a stroke or other form of brain injury, and optionally to monitor its progress over time. For the sake of simplicity, the electromagnetic imaging apparatus and process are described herein in the context of a single array of antennas lying in a transverse plane that passes through the subject's brain and stroke region (i.e., to provide 2D localisation of the stroke in the transverse plane), although the same steps apply to “3D” cases in which there are two or more layers of antennas available to provide three-dimensional localization.
[0064] As shown in
[0065] At step 204, a test is performed to determine whether the S-parameters are in the frequency domain, and, if so, then at step 206 an inverse fast Fourier transform (“IFFT”) is applied to the S-parameters individually to convert them to the time domain. Although other embodiments may directly process the time domain signals, the inventors have found that noise can be reduced if the time domain measurements are converted to network form. Accordingly, at step 208, a network (i.e., graph) representation of the time domain measurements is generated in a form referred to as a ‘visibility graph’ using the method described in Lacasa, Lucas, et al., “From time series to complex networks: The visibility graph”, Proceedings of the National Academy of Sciences 105.13 (2008): 4972-4975.
[0066] The human brain is of course generally symmetrical with respect to the median plane, characterized (in the two-dimensional transverse plane of the antenna array) by an axis of symmetry between the left and right halves of the brain, and each measurement represents scattering of electromagnetic waves emitted by a corresponding antenna of the array of antennas disposed about the object as measured by a corresponding antenna of the array of antennas.
[0067] Consequently, in the absence of any anomalies in the subject's brain, the signals transmitted and received by an arbitrary pair of the antennas 102 on one side of the subject's head should be equal to the signals of the corresponding pair of the antennas 102 on the symmetrically opposite side of the subject's head. The actual level of similarity between a pair of such symmetrical measurements can be quantified using a statistical index. In the described embodiments, a multivariate statistical index is used to statistically compare two mutually symmetrical (and symmetrically located with respect to the brain's axis of symmetry) regions of the brain, where each region is a simple polygon or n-gon defined by at least three (n>3) vertices corresponding to respective antenna locations. Each such region and its associated similarity index are collectively referred to herein as a ‘statistical field’, noting that in the present context this term has a different meaning to its meaning in the fields of polymer physics and biophysics. However, for convenience of description, sometimes each component of a statistical field may also be referred to herein as a statistical field, notwithstanding that formally a statistical field is defined by both components.
[0068] At step 210, the statistical fields are generated. In any one embodiment, the statistical fields may have the same shape or different shapes. The simplest statistical field is one bounded by only three antennas, and consequently has a triangular shape, which can be of any type (i.e., equilateral, right, isosceles, acute, obtuse or scalene). Examples of statistical fields defined by the locations of 4 and 5 antennas (i.e., tetragons 302 and pentagons 304, respectively) are shown in
[0069] Any pair of mutually symmetrical and symmetrically located regions of the brain can be compared (in the sense of differences of electromagnetic signal propagation and scattering within them) by means of a multivariate statistical index, and to this end the apparatus and processes of the described embodiments use the distance correlation (“dCorr”) index described in Székely, Gábor J., Maria L. Rizzo, and Nail K. Bakirov, “Measuring and testing dependence by correlation of distances”, The annals of statistics 35.6 (2007): 2769-2794 (“Székely”). However, it will be apparent to those skilled in the art that other statistical measures of similarity (e.g., Mutual Information or Person coefficients) may be used in other embodiments.
[0070] Distance correlation statistics is a class of energy statistics based on distances which measures the dependencies of random variables of arbitrary size and distributions, and as such can be also employed as an index of dependence.
[0071] As described in Székely:
[0072] Let X=[x.sub.1, . . . , x.sub.p].sup.T and Y=[y.sub.1, . . . , y.sub.q].sup.T be two random vectors with finite first moments, i.e. E(∥X∥+∥Y∥)<∞. Let also X.sup.1, . . . , X.sup.N be N independent and identically distributed (“i.i.d.”) realizations of X, and Y.sup.1, . . . , Y.sup.N the corresponding i.i.d. realizations of Y. Then dCorr is defined as:
[0073] One of the properties of the dCorr index (R.sub.N*) (see Theorem 3 of Székely) is that R.sub.N*(X, Y)=1 if there exists a vector b, and a nonzero real number k and an orthogonal matrix C such that:
Y=kXC+b, (3.2).
[0074] Accordingly, if signals comprising a statistical field on the left side of the brain are denoted by X, and signals comprising the symmetrically equivalent statistical field on the right side are denoted by Y, then assuming the electromagnetic signals measured on one side of the head are equal to their symmetrical counterparts, then equation 3.2 becomes Y=X for k=1 and b=0. This implies that in case of abnormality (e.g., a stroke region in one of the statistical fields) this property will not hold, and consequently the dCorr index will have a value less than 1. The larger the stroke region, the lower will be the statistical similarity between the signals passing through the stroke region and its symmetrical counterpart, and consequently the lower the dCorr index value. It should be noted that the transmission signals (S.sub.ij) from sensors that are far from each other provide more information about the deep targets inside the brain, while the signals from immediately adjacent antennas mainly carry information from shallow brain areas and outer layer tissues such as skin and skull. For this reason, when computing the statistical fields, signals of immediately adjacent antennas are not included in the calculations.
[0075] However, because the intensity of a statistical field is a metric of its similarity to its corresponding (i.e., mirror-image counterpart) statistical field on the other side of the brain, in the described context of anomaly detection a decision needs to be made at step 212 as to which side of the brain contains the anomaly. The statistical field containing the anomaly is said to be ‘active’, and only the active statistical fields are used to compute an overall field intensity for the corresponding mesh point or coordinates (or “pixel” where the overall field intensity is considered to constitute an image of a brain anomaly).
[0076] Where prior information indicating which side of the brain contains the stroke (or other anomaly) is not available, the process computes the similarity of each statistical field (e.g., the field on the left side of the brain) to the same region of a reference (e.g., a reference medium having the average electromagnetic properties of the human brain), as illustrated in
[0077] If, however, stroke side information can be provided by doctors, then it can serve as a priori information for the process to decide which side of the brain contains the anomaly, without requiring reference signals. In particular, for statistical fields for which the right and left counterparts are each completely contained within the corresponding half of the brain, prior information on stroke side is sufficient to activate the correct side. However, in cases where the statistical fields extend over both halves of the brain, for example as illustrated in
[0078] Multiple overlapping statistical fields covering different regions of the brain are generated so that any given location within the brain is contained within multiple statistical fields. To compute the value or ‘intensity’ of the overall statistical field at a given point inside the subject's brain resulting from that point being included within multiple overlapping statistical fields, the imaging domain surrounded by the antenna array is represented as a mesh. Each point of the mesh can be treated individually, and the integral intensity of all statistical fields encompassing that point (or pixel) can be computed by combining or ‘fusing’ their values, as described below.
[0079] After the process decides which side of the brain to activate for all generated pairs of statistical fields, a mesh covering the brain region within the antenna array is generated at step 214, and at step 216, the similarity values of each mesh coordinate are combined or ‘fused’. The simplest way to fuse the information is to sum all of the values of the statistical fields encompassing the mesh coordinate (or pixel), as follows:
dCorr(g)=Σ.sub.i=1.sup.N.sup.
where N.sub.p denotes the total number of generated statistical fields encompassing pixel g, g=1, . . . , N.sub.G. Although it is the simplest method of combining values, it is not the most useful because it does not allow mathematical interpretation of the results.
[0080] Accordingly, in the described embodiments the process fuses the information by computing the expected value of the similarity metric for each pixel individually. Assuming that the dCorr index values for the statistical fields encompassing a given mesh coordinate are drawn from some (but the same) probability distribution, then the expected value of the probability distribution for a given pixel can be estimated by the mean, according to:
[0081] Considering that the size of the population of statistical fields N.sub.p is a design parameter and thus can take any value, it is helpful to recall The Central Limit Theorem, which states that, given a sufficiently large sample size from a population with a finite variance, the mean of all samples from the same population will be approximately equal to the mean of the population.
[0082] After the field intensities are computed for all pixels individually at step 216, a matrix of the computed expected values is generated at step 218. In the final step, before pixel probability values are assigned to a colour scale to visualize the results (i.e., stroke localization), a smoothing filter is applied along the x-axis and the y-axis at step 220. This improves visualization of the results by compensating for noise in some pixels. In the described embodiments, the smoothing filter calculates average values in a sliding window of width W pixels. To increase visual contrast, exponentiation of a desired degree can optionally be applied to the matrix of expected values.
EXAMPLES
[0083]
[0087] The results were obtained for an initial domain discretization of 2 mm, the first 100 points of the network signals of a statistical field, a sliding window of width W=4, and exponentiation of 5.sup.th degree in the final step. To obtain a finer image representation, the generated image matrix values were interpolated linearly with a step size of 10-3.
[0088] The results in
[0089] It is important to note that the spatial resolution of the described apparatus and process strongly depends on the number of antennas in the array arranged around the subject's head. However, the number of antennas is limited by the available space around the head, the size of each antenna and their mutual coupling. Consequently, strokes with dimensions less than the distance between two neighbouring antennas might be captured in a statistical sense but the spatial dimensions might possibly not be visualized accurately.
[0090] When implemented as Matlab modules on a 3.7 GHz Intel Xeon W-2145 workstation with 64 GB of RAM, the average execution time of the process was 7 s, including generating 70 statistical fields, fusing similarity values and estimating the probability for each pixel, deciding the stroke side, and visualizing the results. If the stroke side is known a priori, then the execution time is halved. In addition, recoding the process in a low-level language such as C could reduce the execution time by an order of magnitude.
Stroke Classification
[0091] Stroke classification relies on changes in phase due to changes in the dielectric properties of the imaging domain. The phase signal of each S.sub.ij is obtained by determining its imaginary and real parts over the considered frequency band.
[0096] Once these steps have been applied to all transmission signals, the average value of the standard deviations obtained in Step 4 is calculated.
[0097] Determining whether the resulting average value is above or below a threshold T discriminates haemorrhagic (bleeding) from ischemic (clot) stroke; i.e., determines the stroke type. Given a large number of patients (e.g., 100 patents, where at least 30-40% of them have one stroke type and the remaining have the other stroke type) would enable the classification result to be given with a high level of confidence. For example, the process can display to a user an output message such as: ‘The case X is stroke type Y with a confidence level of 95%’.
[0098] In addition, having more samples enables the use of Machine Learning clustering to learn cluster centroids and cluster ranges for subsequent stroke classification. Another alternative is to employ any ML classification method (e.g., Support Vector Machine (SVM), Nearest neighbours (NN), Logistic Regression, (Deep) Neural Networks (DNN), Naïve Bayes) to learn the hyperplane that separates two stroke types based on the computed rate of phase change.
[0099]
[0100] The results described above confirm that the apparatus and process described herein are capable of detecting stroke targets and determining their locations and dimensions within the brain. In the case of stroke targets that are at least as large as the Euclidian distance between two neighbouring antennas, they are capable of determining the size and indicating the shape of the stroke region. In the case of small targets that are significantly smaller than the Euclidian distance between two neighbouring antennas (approximately 2 or more times smaller), they may localize stroke regions correctly, but the stroke dimensions might not be accurate. This is not surprising because the spatial resolution is mainly determined by the number of the antennas in the antenna array. Increasing the number of available signals increases the localization resolution, and hence the precision of the determined target size.
[0101] The apparatus and process described herein therefore: [0102] are suitable for localization of both types of stroke, located anywhere in the head except along the symmetry plane; [0103] are capable of differentiating between ischemic and haemorrhagic stroke types; [0104] do not require a priori knowledge of the shape or dielectric properties of the imaging domain; [0105] can detect and locate big and small targets; [0106] do not require a reference (e.g., data collected in an average medium) if the stroke side is known (left or right side of the brain); and [0107] have a typical execution time of less than a minute on standard personal computer hardware at the time of writing, which makes them suitable for real-time applications.
[0108] The main requirements are related to antenna array positioning, namely: [0109] symmetrical positioning of the antenna array with respect to the major axis of the brain (or other object) to ensure the same distance from the major axis of the object; and [0110] any tilt of the antenna array on both sides of the brain with respect to the vertical plane passing through the major axis of the brain to be the same.
[0111] Many modifications will be apparent to those skilled in the art without departing from the scope of the present invention.