MEDICAL IMAGE DEVICE AND OPERATING METHOD

Abstract

This application proposes an improved medical imaging device enabling a timely communication of critical findings. The medical imaging device comprises an image acquisition unit, adapted to acquire image data of a subject to be imaged. The medical imaging device further comprises a local data processing device having an artificial-intelligence-module, Al-module, adapted to automatically detect a finding on basis of the acquired image data and to determine a priority status of the detected finding. Further, the medical imaging device comprises a notification module, adapted to provide, if the determined priority status reaches or exceeds a notification threshold, a notification data containing the detected finding. The application further proposes a medical imaging system, a method of operating a medical imaging device, a computer program element and a computer-readable medium having stored the computer program element.

Claims

1. A medical imaging device, comprising: an image acquisition unit configured to acquire medical image data of a subject to be imaged; a local data processing device comprising an artificial intelligence (AI) module configured to automatically detect a medical finding by performing a classification of content of the medical image data, the medical finding being indicated by an anomaly identified during the classification, the AI module being further configured to determine a priority status of the medical finding; and a notification module configured to provide a notification data containing the medical finding if the priority status reaches or exceeds a notification threshold, wherein the AI module is configured to determine a likelihood of detection that indicate the likelihood of the medical finding being correctly identified, and wherein the likelihood of detection is added to the notification data.

2. The medical imaging device according to claim 1, wherein the notification module is configured to provide the notification data to a local display device.

3. The medical imaging device according to claim 1, wherein the notification module is configured to provide the notification data to a first remote terminal.

4. The medical imaging device according to claim 3, wherein the notification module is configured to request a reading confirmation for the notification data from the first remote terminal.

5. The medical imaging device according to claim 4, wherein the notification module is configured, if the reading confirmation is not received within a predetermined time period, to notify the first remote terminal again via a second communication path that is different than a first communication path through which the reading confirmation is not received within the predetermined time period.

6. The medical imaging device according to claim 4, wherein the notification module is configured, if the reading confirmation is not received within a predetermined time period, to provide the notification data to a second remote terminal.

7. The medical imaging device according to claim 1, wherein the AI module is configured to determine a spatial location of the medical finding within the subject, and wherein the determined spatial location is added to the notification data.

8. The medical imaging device according to claim 1, wherein the AI module is configured to determine at least one image of the medical image data that represents at least a partial view of the medical finding, and wherein the at least one image is at least partly added to the notification data.

9. The medical imaging device according to claim 1, wherein the medical finding comprises at least one of a pneumothorax and an arterial dissection.

10. The medical imaging device according to claim 1, wherein the AI module is configured to perform detecting of the medical finding and/or providing the notification data exclusively through local data processing.

11. A medical imaging system, comprising: the medical imaging device according to claim 1; and a receiving device configured to receive the notification data transmitted by the medical imaging device.

12. The medical imaging system according to claim 11, further comprising: a further remote clinical system connected to the image acquisition unit, wherein the medical imaging system is configured to perform a pre-processing of the medical image data by a local data processor using the medical imaging device and providing the notification data to the receiving device prior to performing a main processing of the medical image data by the clinical system.

13. A method of operating an medical imaging device, comprising: acquiring medical image data of a subject to be imaged; processing the acquired image data by an artificial intelligence (AI) module of a local data processing device to automatically detect a medical finding in the subject by providing a classification of content of the medical image data, the medical finding being indicated by an anomaly identified during the classification; determining a priority status of the detected medical finding by the AI module; and providing a notification, containing at least the medical finding, to a notification module if the determined priority status reaches or exceeds a notification threshold.

14. (canceled)

15. A non-transitory computer-readable medium for storing executable instructions, which cause a method to be performed according to claim 13.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Exemplary embodiments of the invention will be described in the following with reference to the following drawings:

[0063] FIG. 1 shows schematically an embodiment of a medical imaging device in a side view.

[0064] FIG. 2 shows schematically a block diagram of an exemplary operation of a medical imaging device.

[0065] FIG. 3 shows schematically a block diagram of another exemplary operation of a medical imaging device.

[0066] FIG. 4 shows a flow chart of a method of imaging an object by an X-ray imaging system.

[0067] The figures are merely schematic representations and serve only to illustrate embodiments of the invention. Identical or equivalent elements are in principle provided with the same reference signs.

DETAILED DESCRIPTION OF EMBODIMENTS

[0068] FIG. 1 shows schematically a medical imaging device 100, which is in this embodiment a computed tomography imaging scanner. The X-ray imaging system 100 comprises a stationary housing 110 and a rotatable gantry 120 which is rotatable over an angular range of about 360° about a subject support 130, which is in this embodiment a support table. In this embodiment, a subject 140 to be imaged, which is exemplarily a human patient, is located on an upper surface of the subject support 130. The medical imaging device 100 further comprises an image acquisition unit 150 having a radiation source 160 that is in this embodiment configured to emit an X-ray radiation beam towards the subject 140 to be imaged, and in particular configured to generate the radiation beam to be directed into an examination region. The radiation beam interacts with a region of interest of the object 140 disposed in the examination region, wherein spatially varying absorption of the radiation is generated, as it passes through the examination region.

[0069] The medical imaging device 100 in this embodiment further comprises an X-ray detector 170 configured to detect X-rays which have passed through the subject 140 and in particular configured to detect an absorption-attenuated radiation after having passed through the examination region. In this embodiment, the radiation source 160 and the X-ray detector 170 are mounted to the gantry 120 and are arranged opposite each other, so that the X-ray detector 170 continuously receives X-rays from the radiation source 160. The X-ray detector 170 may comprise a two-dimensional array of detector elements, wherein other embodiments may be contemplated.

[0070] The medical imaging 100 further comprises one or more computational means, wherein in this embodiment mainly a local data processing device 180 will be described. In some embodiments, the data processing device 180 is connected to at least the X-ray detector and/or the radiation source 160 to control these and/or to at least obtain data therefrom, in particular from the X-ray detector 170. The data processing device 180 may also be formed by several subsystems, function modules or units, software modules or units, or the like (not further detailed here), and is configured to reconstruct an image of the subject 140 based on the X-rays detected by the X-ray detector 170, and in particular based on a plurality of acquired projection images of the subject 140. In this embodiment, the data processing device 180 comprises at least one processor 181, at least one memory 182 for storing image data and at least one memory 183 for storing one or more program elements.

[0071] The data processing device 180 further comprises an artificial intelligence module, AI-module, which for better illustration is denoted by reference sign 184. The AI-module 184 has a data connection to the processor 181 and/or the X-ray detector 170 to obtain image data already processed by the processor 181 or raw image data directly provided by the X-ray detector 170. The AI-module 184 further comprises one or more artificial neural networks which may use one or more layers, e.g. convolutional layers, batch-normalization layers, dense layers, backpropagation, or the like, and which may be in particular provided as a convolutional neural network (CNN) adapted to process image data. Further, according to some embodiments, the AI-module 184 may alternatively or additionally include a deep learning algorithm and/or classification means, such as a suitable classifier. The CNN, classification means etc. may be pre-trained with suitable training data sets. Additionally, such a training takes place during ongoing operation to further improve the detection result. The image data is provided to the AI-module 184 as an input variable. On this basis, the AI-module 184 is adapted to automatically detect a finding on basis of the acquired image data and to determine a priority status of the detected finding. Further, the AI-module 184 is adapted to determine a spatial location of the finding within the subject 140. Also, the AI-module 184 is adapted to determine at least one image of the image data that represents at least a partial view of the finding. The AI-module 184 is further adapted to determine a likelihood of detection indicating the likelihood with which the detected finding has been correctly identified. The likelihood may be indicated in percentage or another suitable unit of measurement.

[0072] Further referring to FIG. 1, the medical imaging device 100 further comprises a notification module 190 that is connected to the AI-module 184. The notification module 190 may be implemented within the data processing device 180 or may, alternatively, be implemented in a further data processing device, or the like. In this embodiment, the notification module 190 comprises a communication data interface 191, adapted to enable a data connection via a data network, a telecommunications network, e.g. a cellular or mobile network, a radio network, or the like. Further, the notification module 190 is adapted to transmit and/or receive text messages, combined text-picture messages etc., which may also be provided as a push message. The notification message transmitted by the notification module 190 may be encrypted for data security.

[0073] As shown in FIG. 1 the notification module 190 is adapted to transmit its notification to a system operator console 192 of the medical imaging device 100, which is operated by a technician, medical support staff, or the like. Alternatively or additionally, the notification module 190 is adapted to transmit its notification to a remote terminal 193, which in this embodiment is a portable terminal, such as a mobile phone, or the like. In particular, the terminal 193 may be carried on-person by a radiologist, physician, or the like. In this embodiment, the medical imaging device 100 is connected to a further remote clinical system 200 which in this embodiment is a Picture Archiving and Communication System (PACS), EMR, or the like, using communication standards like DICOM or HL-7. It is noted that the AI-module 184 is in particular adapted to perform a pre-processing of the image data prior to providing the image data to the clinical system 200 where a subsequent main-processing of the image data is performed.

[0074] FIG. 2 shows a schematic block diagram of an exemplary notification operation of the medical imaging device 100 notifying one or more of the system operator console 192 and the terminal 193 via the communication data interface 191. By way of example, the notification message of the notification module 190 contains one or more data fields, wherein in this embodiment for better illustration display fields corresponding to the data fields are denoted by reference signs 190A, 190B and 190C. In display field 190A, a notification text may be included, such as “Notification: Actionable Finding Detected for Patient ##; Pneumothorax in right lung (98%)”. Accordingly, the notification may include a text indicating the detected finding, an identification data of the subject 140, and the determined likelihood. It is noted that the notification may also include additional data regarding the subject 140 such as age, gender, known clinical findings or the like. These data may be obtained by the AI-module 184, a patient information system, the clinical system 200, or the like. In display field 190B, one of the acquired images of the subject 140, in particular of the finding, may be displayed. In display field 190C, an enlarged view of an image of the finding may be displayed. For example, suitable images, especially meaningful images, to be transmitted with the notification are selected by the AI-module 184. These notification data are provided to the notification module 190 which transmits the same to the terminal 193 and/or the operator console 192.

[0075] FIG. 3 shows a schematic block diagram of generating and sending the notification to be transmitted by the notification module 190. As explained above, from the X-ray detector 170 and/or the data processing device 180 acquired image data is provided to the AI-module 184, where an automatic processing of the image data is carried out with the aim of automatically detecting a possible abnormality to determine a possible finding. The AI-module 184 determines if a priority status of the finding reaches or exceeds a notification threshold, i.e. if the finding is that critical that it triggers a notification action. If the AI-module 184 determines the detected finding as critical or actionable and/or if the likelihood of detection is too low, the AI-module 184 generates several data contents for the above-mentioned notification message to be transmitted. For example, the AI-module 184 generates the naming of the finding, such as pneumothorax etc., the likelihood of detection, the spatial location of the finding etc. In some embodiments, also an appropriate pictorial representation of the finding is determined and/or generated. Then, the data contents generated by the AI-module 184 are provided to the notification module 190. In some embodiments, the notification module 190 is adapted to employ different notification or messaging technologies using different communication paths, such as push-up notification, e-mail, short message service (SMS) etc. In this embodiment, the notification is transmitted to the system operating console 192 and/or the terminal 193. In some embodiments, the notification module 190 requests an acknowledgment of receipt and/or a reading confirmation for the notification data from the remote terminal 193, as indicated in FIG. 3 by the double arrow. Accordingly, the data connection between the system operating console 192 and/or the terminal 193 and the notification module 190 is at least temporarily bidirectional. The reading confirmation may be implemented in or provided by the messaging technology used for notification. If the notification cannot be delivered to the intended recipient, the notification is be escalated to another recipient, i.e. another terminal 193 (not shown). If the reading confirmation is not received by the notification module 190 within a certain time period, it notifies the terminal 193 again via a second communication path, e.g. SMS, that is different to a first communication path, e.g. e-mail, through which the reading confirmation is not received within the certain time period. The certain time period may be dependent from priority status of the detected finding, the reached or exceeded notification threshold, or the like. Therefore, the certain time period may be minutes, hours etc. As indicated in FIG. 3, the notification module 190 logs the notification process in a data record 194.

[0076] FIG. 6 shows a flow chart of a method of operating the medical imaging device 100 and/or medical imaging system. In a step S1, by use of e.g. the radiation source and the X-ray detector 170 image data of the subject 140 is acquired.

[0077] In a step S2, the AI-module 184 processes the acquired image data to automatically detect a finding in the subject 140.

[0078] In a step S3, the AI-module 184 determines the priority status of the detected finding.

[0079] In a step S4, the AI-module 184 provides a notification, containing at least the naming of the finding, to the notification module 190, if the determined priority status reaches or exceeds a notification threshold.

[0080] In an optional step S5, the notification module 190 transmits the notification as a notification message to one or more of the system operator console 192 and the remote terminal 193.

[0081] In another exemplary embodiment of the present invention, a computer program or a computer program element is provided that is characterized by being adapted to execute the method steps of the method according to one of the preceding embodiments, on an appropriate system.

[0082] The computer program element might therefore be stored on a computer unit, which might also be part of an embodiment of the present invention. This computing unit may be adapted to perform or induce a performing of the steps of the method described above. Moreover, it may be adapted to operate the components of the above-described apparatus. The computing unit can be adapted to operate automatically and/or to execute the orders of a user. A computer program may be loaded into a working memory of a data processor. The data processor may thus be equipped to carry out the method of the invention.

[0083] This exemplary embodiment of the invention covers both, a computer program that right from the beginning uses the invention and a computer program that by means of an up-date turns an existing program into a program that uses the invention.

[0084] Further on, the computer program element might be able to provide all necessary steps to fulfil the procedure of an exemplary embodiment of the method as described above.

[0085] According to a further exemplary embodiment of the present invention, a computer readable medium, such as a CD-ROM, is presented wherein the computer readable medium has a computer program element stored on it which computer program element is described by the preceding section.

[0086] A computer program may be stored and/or distributed on a suitable medium (in particular, but not necessarily, a non-transitory medium), such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.

However, the computer program may also be presented over a network like the internet and can be downloaded into the working memory of a data processor from such a network. According to a further exemplary embodiment of the present invention, a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.

[0087] It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, a person skilled in the art will gather from the above and the following description that, unless otherwise notified, in addition to any combination of features belonging to one type of subject matter also any combination between features relating to different subject matters is considered to be disclosed with this application. However, all features can be combined providing synergetic effects that are more than the simple summation of the features.

[0088] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.

[0089] In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfil the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.

LIST OF REFERENCE SIGNS

[0090] 100 medical imaging device [0091] 110 housing [0092] 120 gantry [0093] 130 subject support [0094] 140 subject to be imaged [0095] 150 image acquisition unit [0096] 160 radiation source [0097] 170 X-ray detector [0098] 180 data processing means [0099] 181 processor [0100] 182 memory [0101] 183 memory [0102] 184 artificial-intelligence-module [0103] 190 notification module [0104] 191 communication data face [0105] 192 system operator console [0106] 193 remote terminal [0107] 194 data record [0108] 200 further clinical system