SYSTEM AND METHOD FOR PROCESSING MEASUREMENT DATA FROM ELECTROCARDIOGRAM ELECTRODES

Abstract

A system and method for processing measurement data from ECG electrodes. The method includes obtaining a three-dimensional image of the torso of the subject including position information of the electrodes; obtaining ultrasound data of the heart of the subject; and modifying a non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso of the subject on the basis of the ultrasound data. The method includes using electrocardiogram data and the three dimensional patient-specific anatomical model for estimating the distribution, fluctuation and/or movement of electrical activity through heart tissue.

Claims

1. An electrocardiogram, ECG, device comprising: one or more electrodes arranged to be placed on a subject; one or more ultrasound probes; a three-dimensional camera; and a processor configured to: obtain, from the three-dimensional camera, a three-dimensional image of the torso of the subject including position information of the electrodes; obtain, e.g. from a database, a non-patient-specific three-dimensional anatomical model of the heart and torso for the subject on the basis of the three-dimensional image; obtain, from the one or more ultrasound probes, ultrasound data of the heart of the subject; modify the non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso of the subject on the basis of the ultrasound data; determine a position of each electrode in the patient-specific three-dimensional anatomical model based on the three-dimensional image; obtain electrocardiogram data from the electrodes; and use the electrocardiogram data and the positions of the electrodes in the three dimensional patient-specific anatomical model for determining a three-dimensional model of electrical heart activity.

2. The ECG device of claim 1, wherein the processor is configured to determine a position and/or orientation of an ultrasound probe on the basis of the three-dimensional image.

3. The ECG device of claim 1, wherein at least one of the electrodes includes an ultrasound probe.

4. The ECG device of claim 1, including an ultrasound transmitter.

5. The ECG device of claim 1, including a robot, wherein the processor is configured to cause the robot to position the electrode(s) and/or ultrasound probe(s) on the basis of a three-dimensional image of the torso of the subject.

6. The ECG device of claim 1, wherein the processor is configured to synchronize the obtaining of the ultrasound data to a heart rhythm obtained from the electrocardiogram data obtained from the electrodes.

7. The ECG device of claim 1, wherein the processor is configured to determine whether or not the obtained ultrasound data is sufficient for modifying the non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso, and if the obtained ultrasound data is insufficient to proceed to obtain additional ultrasound data of the heart of the subject.

8. The ECG device of claim 1, including display means for displaying the three-dimensional model of electrical heart activity to a user.

9-25. (canceled)

26. A system for processing measurement data from electrocardiogram, ECG, electrodes on a subject, the system including a processor configured to: obtain, from a three-dimensional camera, a three-dimensional image of the torso of the subject including position information of the electrodes; obtain, e.g. from a database, a non-patient-specific three-dimensional anatomical model of the heart and torso for the subject on the basis of the three-dimensional image; obtain, from one or more ultrasound probes, ultrasound data of the heart of the subject; modify the non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso of the subject on the basis of the ultrasound data; determine a position of each electrode in the patient-specific three-dimensional anatomical model based on the three-dimensional image; obtain electrocardiogram data from the electrodes; and use the electrocardiogram data and the positions of the electrodes in the three dimensional patient-specific anatomical model for estimating the distribution, fluctuation and/or movement of electrical activity through heart tissue.

27. The system of claim 26, wherein the processor is configured to determine a position and/or orientation of an ultrasound probe on the basis of the three-dimensional image.

28. The system of claim 26, including a plurality of ultrasound probes.

29. The system of claim 26, wherein at least one of the electrodes includes an ultrasound probe.

30. The system of claim 26, including an ultrasound transmitter.

31. The system of claim 26, including a robot, wherein the processor is configured to cause the robot to position the electrodes and/or ultrasound probe(s) on the basis of a three-dimensional image of the torso of the subject.

32. The system of claim 26, wherein the processor is configured to synchronize the obtaining of the ultrasound data to a heart rhythm obtained from the electrocardiogram data obtained from the electrodes.

33. The system of claim 26, wherein the processor is configured to determine whether or not the obtained ultrasound data is sufficient for modifying the non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso, and if the obtained ultrasound data is insufficient to proceed to obtain additional ultrasound data of the heart of the subject.

34. The system of claim 33, wherein the processor is configured to determine a desired position for the additional location and/or a desired orientation for the additional angle.

35. The system of claim 34, wherein the processor is configured for indicating the desired position and/or the desired orientation to a user.

36. The system of claim 34, wherein the processor is configured to cause the robot to position the ultrasound probe(s) to the desired position and/or the desired orientation.

37. The system of claim 26, wherein the processor is configured to estimate the position of heart scar tissue on the basis of absence or limited motion of the heart wall in the ultrasound data.

38. The system of claim 26, wherein the processor is configured to select the non-patient-specific three-dimensional anatomical model of the heart and torso on the basis of thorax contours determined from the three-dimensional image.

39. The system of claim 26, wherein the processor is configured to select a non-patient-specific three-dimensional anatomical model of the heart and torso on the basis of at least one of gender, age, weight, body length, chest circumference, frame size, and body-mass-index.

40. The system of claim 26, wherein the processor is configured to align the three-dimensional image and the non-patient-specific three-dimensional anatomical model.

41. The system of claim 26, wherein the processor is configured to scale the three-dimensional image to the obtained non-patient-specific three-dimensional anatomical model and/or scale the obtained non-patient-specific three-dimensional anatomical model to the three-dimensional image.

42. The system of claim 26, wherein the processor is configured to modify a position and/or orientation of the heart in the obtained non-patient-specific three-dimensional anatomical model on the basis of the ultrasound data.

43. A non-transitory computer readable medium storing computer implementable instructions which when implemented by a programmable computer cause the computer to: obtain a three-dimensional image of the torso of the subject including position information of the electrodes; obtain a non-patient-specific three-dimensional anatomical model of the heart and torso for the subject on the basis of the three-dimensional image; obtain ultrasound data of the heart of the subject; modify the non-patient-specific three-dimensional anatomical model into a patient-specific three-dimensional model of the heart and torso of the subject on the basis of the ultrasound data; determine a position of each electrode in the patient-specific three-dimensional anatomical model based on the three-dimensional image; obtain electrocardiogram data; and use the electrocardiogram data and the positions of the electrodes in the three dimensional patient-specific anatomical model for estimating the distribution, fluctuation and/or movement of electrical activity through heart tissue.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Embodiments of the present invention will now be described in detail with reference to the accompanying drawings in which:

[0058] FIGS. 1A, 1B, 1C and 1D show an example of a system;

[0059] FIG. 2 shows an example of a cross section of a torso;

[0060] FIGS. 3A, 3B, 3C and 3D show an example of a system;

[0061] FIG. 4 shows an example of a cross section of a torso;

[0062] FIG. 5 shows an example of a method;

[0063] FIG. 6 shows an example of part of a method;

[0064] FIG. 7 shows an example of part of a method;

[0065] FIG. 8 shows an example of part of a method;

[0066] FIG. 9 shows an example of part of a method;

[0067] FIG. 10 shows an example of part of a method;

[0068] FIG. 11 shows an example of part of a method; and

[0069] FIG. 12 shows an example of part of a method.

DETAILED DESCRIPTION

[0070] FIGS. 1A, 1B and 1C show an example of a system 1 for processing measurement data from electrocardiogram, ECG, electrodes 2 on a subject 4. FIG. 1A shows a top view, FIG. 1B a side view, and FIG. 1C a cross sectional view. FIGS. 1A-1C show a table 6 on which the subject 4 is positioned. On the torso 8 of the subject 4 a plurality of ECG electrodes 2 is placed. In this example a plurality of ultrasound probes 10 is placed on the torso 8. Here, each electrode 2 is provided with a probe 10. Hence, a plurality of ECG electrode/ultrasound probes is provided. The electrodes 2 are arranged to detect surface potentials on the torso 8. The ultrasound probes 10 are arranged to emit an ultrasound signal 12 into the torso 8 and receive a reflected ultrasound signal 14 from the torso.

[0071] FIG. 2 shows an example of a cross section of the torso 8. In this example the heart 16 is indicated. The ultrasound signal 12 transmitted into the torso 8 by the probe 10 and the reflected ultrasound signal 14 reflected from the heart 16 towards the probe 10 are also indicated in FIG. 2. Note that in FIG. 2 not every ECG electrode 2 is provided with an ultrasound probe 10.

[0072] Returning to FIG. 1C the system 1 is provided with at least one 3D camera 18, here two 3D cameras. The system further comprises a processor 20. Here, the processor 20 is communicatively connected to the 3D camera 20, the electrodes 2 and the probes 10.

[0073] In this example, the electrodes 2, ultrasound probes 10, 3D cameras 18 and processor 20 form an electrocardiogram, ECG, device 3. The ECG device 3 is arranged for performing inverse electrocardiography as will be explained below.

[0074] The electrodes 2, ultrasound probes 10, or combined electrodes/probes can be attached to the subject 4 e.g. by an adhesive. It is also possible that the system includes a robot 24, such as a robot arm, controlled by the processor 20 for positioning the electrodes, probes or electrodes/probes onto the subject, as shown in FIG. 1D.

[0075] FIGS. 3A, 3B, 3C and 3D show an alternate example of a system 1 for processing measurement data from electrocardiogram, ECG, electrodes 2 on a subject 4. The system of FIGS. 3A-3D is similar to that shown in FIGS. 1A-1C, with the difference that in this example the table 6 includes one or more ultrasound transmitters 10T. In this example, the ultrasound probes are ultrasound receivers 10R. Similar to FIG. 1D a robot 24 may be used to position the receivers 10R.

[0076] FIG. 4 shows an example of a cross section of the torso 8. In this example the heart 16 is indicated. The ultrasound signal 12 transmitted into the torso 8 by the transmitter 10T and the reflected ultrasound signal 14 reflected from the heart 16 towards the receiver 10R are also indicated in FIG. 4. Note that in FIG. 4 not every ECG electrode 2 is provided with an ultrasound probe 10.

[0077] The system 1, and the ECG device 3, as described can be used as follows, referring to the exemplary method 99 of FIG. 5. The processor 20 obtains in step 100 a three-dimensional image of the torso 8 of the subject 4 and selects, from a database 22, a non-patient-specific 3D anatomical model of the heart and torso for the subject. Thereto the processor 20 can control the 3D camera(s) 18 to obtain the 3D image. From the ultrasound probes 10 the processor 20 obtains in step 200 ultrasound data of the heart 16 of the subject 4. On the basis of the ultrasound data, in step 600 the processor 20 modifies the non-patient-specific 3D anatomical model into a patient-specific 3D model of the heart 16 and torso 8 of the subject 4. From the 3D image the processor 20 determines a position of each electrode 2 on the torso 4 and relates this to a position in the patient-specific 3D anatomical model. From the electrodes 2 the processor 20 obtains ECG data in step 800. Finally, using the ECG data and the positions of the electrodes in the 3D patient-specific anatomical model the processor 20 determines a 3D model of electrical heart activity for the subject in step 900. The processor can e.g. estimate the distribution, fluctuation and/or movement of electrical activity through heart tissue.

[0078] Hence, the system 1, and the ECG device 3, is arranged to perform inverse electrocardiography. The system 1 or the ECG device 3 can include display means, such as a display screen or printer, for displaying the 3D model of electrical heart activity to a user. The 3D model of electrical heart activity can be displayed as a, e.g. rotatable and/or movable and or scalable, 2D rendering on the display means. The 3D model of electrical heart activity can e.g. have a value representative of the electrical heart activity associated with each location, such as each node, on the surface of the 3D model of the heart. The values can e.g. represent electrical activation sequence, distribution, fluctuation and/or movement of electrical activity through heart tissue, heart synchronicity, or the like. The 3D model of electrical heart activity can be represented in false colors on the surface of the 3D model of the heart. Each value can e.g. be associated with a particular color. The 3D model of electrical heart activity can e.g. be represented in contours of equal value on the surface of the patient-specific 3D model of the heart.

[0079] FIG. 6 shows an exemplary elaboration of step 100. In step 115 the processor 20 obtains the 3D image. In this example, in step 120 the processor 120 localizes reference points in the 3D image. Such reference points can e.g. be anatomical reference points, such as shoulders, xyphoid, etc. The reference points can also be artificial reference points such as markers (e.g. stickers) applied to the torso 4. In step 125 the processor 20 analyzes different body parts from the 3D image. The different body parts can be investigated to determine a local normal vector orthogonal to the thorax surface. A significant amount of adipose tissue can enable the operator to position the ultrasound probe in the optimal direction, ribs may do the opposite. The presence of adipose tissue and/or ribs can be deduced from the 3D image. The step 130 the processor 20 obtains the used electrode 2 and ultrasound probe 10 characteristics from a database. An ultrasound beam generally points away from the ultrasound probe in a fan shaped pattern. The shape and/or direction of the fan relative to the ultrasound probe may vary with the type of probe. The processor 30 can e.g. retrieve ultrasound fan shape and/or direction relative to the ultrasound probe from the database. In step 135 the processor localizes the individual electrode 2/ultrasound probes 10 in the 3D image. In step 140 the processor determines subject thorax characteristics from the 3D image and selects, from a database 1400, a non-patient-specific 3D model based on the thorax characteristics.

[0080] The selection of the non-patient-specific 3D anatomical model is here based on the 3D image, e.g. on thorax contours determined from the 3D image. The selecting here includes selecting, from the plurality of non-patient-specific 3D anatomical models in the database, the 3D anatomical model showing closest conformity to the torso of the subject. The selection may be based on visual comparison of the 3D image of the torso of the subject with the 3D models in the database. Such selection may be automated on the basis of pattern recognition. The selection may, e.g. additionally, be made on the basis of parameters, such as gender, age, weight, body length, chest circumference, frame size, BMI, etc. of the subject 4.

[0081] FIG. 7 shows an exemplary elaboration of step 200. In step 210 the processor 20 selects an ultrasound probe for collecting ultrasound data, i.e. an ultrasound image obtained by that respective probe 10. Tin this example, the ultrasound data is stored at a DICOM (Digital Imaging and Communications in Medicine) server 2200 in step 220. In step 230 the processor 20 checks whether ultrasound data has been collected from all ultrasound probes 10. If not, ultrasound data of the next probe is collected. It will be appreciated that it is not absolutely necessary that ultrasound data is collected from all ultrasound probes. In some cases the ultrasound data from a sub-set of the ultrasound probes may suffice.

[0082] It is possible that the method 99 includes the step 300 of segmenting the ultrasound DICOM images. The goal of segmenting is to simplify and/or change the representation of the DICOM images into something that is more meaningful and easier to analyze. Image segmenting is typically used to locate objects and boundaries in images, such as the heart or parts of the heart in the ultrasound images. When applied to a plurality of ultrasound images the resulting points and/or contours after image segmenting can be used to create a 3D reconstruction of the heart, e.g. with the help of interpolation algorithms. Preferably the ultrasound images segmenting is performed at the same trigger time for each ultrasound image, e.g. all images at diastolic cardiac phase. FIG. 8 shows an exemplary elaboration of step 300. In step 310 the ultrasound data is retrieved from the DICOM server 2200. In step 320 blood cavities in the ultrasound images are segmented. In step 330 the ventricular epicard is segmented.

[0083] It is possible that the method 99 includes the step 400 of determining whether enough ultrasound data has been collected, e.g. a large part of the heart surface has been captured. For instance when just an endocardium is captured, and only a part of the epicardium, a constant wall thickness can be assumed to estimate the epicardial surface based on the endocardial segmentation points. FIG. 9 shows an exemplary elaboration of step 400. In step 410 a position of the current heart model, i.e. the heart model of the non-patient-specific 3D anatomical model, is modified to optimally correspond with the segmentation points. In an example, the current heart model has a vena cava inferior which is used as a rotation point. Repositioning of the heart can include in a first step rotating the current heart model about the long axis (base to apex of the left ventricle) of the heart. Repositioning of the heart can include in a second step rotating the current heart model about the Z-axis (feet-to-head) such that the heart model does not intersect the thorax wall and fits optimally with the segmentation points. Repositioning of the heart can include in a third step scaling the current heart model to optimally fit the segmentation points. Herein “optimally fit” in this example means a minimal distance between the surface of the heart model and the segmentation points in a least square sense.

[0084] In step 420 an area of the heart model covered by segmentation contours is estimated. Once the heart model has been optimally positioned every segmentation point can be projected on the initial selected heart model. A minimal number of segmentation points per area is required, e.g. 1 per 4 cm2. If in step 400 it is determined that ultrasound data coverage of the heart is insufficient, in step 500 one or more ultrasound probes 10 can be repositioned and additional ultrasound data can be obtained from the repositioned probe(s) 10. In an example, the system 1 can include a robot 24. The processor 20 can be configured to control the robot 24 to reposition one or more of the ultrasound probes 10.

[0085] FIG. 10 shows an exemplary elaboration of step 500. In step 510 the processor 20 determines the area of the heart surface not sufficiently covered by ultrasound data, e.g. based on the outcome of step 420. In step 520 a new position and/or orientation for a selected one or more ultrasound probes 10 is determined for obtaining an ultrasound image of the area of the heart surface not yet sufficiently covered by ultrasound data.

[0086] FIG. 11 shows an exemplary elaboration of step 600. In step 610 the heart model can be morphed to the segmentation points. The heart model can already be repositioned in step 410. In step 610 the valves of the heart model can be repositioned to correspond to the position of the imaged valves. The heart can be morphed to the segmentation points. The modified heart model can be checked to be free from areas where the model intersects itself. If model intersections are detected these are resolved. Hence, the intersection-free model can easily be used in computer algorithms.

[0087] FIG. 12 shows an exemplary elaboration of step 700. In step 710 scar tissue is detected from the ultrasound images. For instance, the ultrasound data can be obtained during the cardiac cycle to determine locations on the heart wall that do not move, or at least move significantly less than to be expected in a healthy heart. Such locations can be used as indications of scar tissue presence.

[0088] Herein, the invention is described with reference to specific examples of embodiments of the invention. It will, however, be evident that various modifications and changes may be made therein, without departing from the essence of the invention. For the purpose of clarity and a concise description features are described herein as part of the same or separate embodiments, however, alternative embodiments having combinations of all or some of the features described in these separate embodiments are also envisaged.

[0089] In the examples the method includes selecting from a database, a non-patient-specific 3D anatomical model of the heart and torso for the subject on the basis of the 3D image. Alternatively, or additionally, the non-patient-specific 3D anatomical model can e.g. be obtained from parameters derived from the 3D image. Alternatively, or additionally, the non-patient-specific 3D anatomical model can e.g. be obtained from a machine learning device on the basis of the 3D image.

[0090] However, other modifications, variations, and alternatives are also possible. The specifications, drawings and examples are, accordingly, to be regarded in an illustrative sense rather than in a restrictive sense.

[0091] For the purpose of clarity and a concise description features are described herein as part of the same or separate embodiments, however, it will be appreciated that the scope of the invention may include embodiments having combinations of all or some of the features described.

[0092] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word ‘comprising’ does not exclude the presence of other features or steps than those listed in a claim. Furthermore, the words ‘a’ and ‘an’ shall not be construed as limited to ‘only one’, but instead are used to mean ‘at least one’, and do not exclude a plurality. The mere fact that certain measures are recited in mutually different claims does not indicate that a combination of these measures cannot be used to an advantage.