COLLABORATIVE SYSTEM FOR VISUAL ANALYSIS OF A VIRTUAL MEDICAL MODEL
20230326373 · 2023-10-12
Inventors
Cpc classification
G06T19/00
PHYSICS
G09B5/02
PHYSICS
International classification
Abstract
A system for visual analysis of a virtual medical model, particularly for medical product development and/or for anatomical comparison by multiple users, comprises a means for providing a virtual medical model and a visualization means, for generating a view and/or a scene of the virtual medical model. The visualization means sends image data representing the generated view and/or scene to a display means. The view-manipulation means allows a user to manipulate a view of the virtual medical model, receives a user input, and translates the user input in vision change data of the virtual medical model or a sub-model thereof. A synchronization means receives and synchronizes the received vision change data and transmits synchronized vision change data to the visualization means. The view-manipulation means receives the synchronized vision change data and based on the received data updates the view and/or a scene of the virtual medical model.
Claims
1. A collaborative system for visual analysis of a virtual medical model, particularly for medical product development and/or for anatomical comparison by multiple users, the collaborative system comprising a means for providing a virtual medical model; at least one visualization means, for generating a view and/or a scene of the virtual medical model, the visualization means being configured to send image data representing the generated view and/or scene to a display means; at least one view-manipulation means, that allows manipulating a view of the virtual medical model by at least one user, the view-manipulation means is configured to receive a user input and to translate the user input in vision change data of the virtual medical model a sub-model thereof, a synchronization means, that is configured to receive vision change data, to synchronize the received vision change data and to transmit the synchronized vision change data to the at least one visualization means, wherein the at least one visualization means is configured to receive the synchronized vision change data and based on the received data to update the view and/or a scene of the virtual medical model.
2. The collaborative system according to claim 1, wherein the virtual medical model comprises at least one virtual patient model and/or at least one virtual model of a medical device, the collaborative system further comprising a guidance means that supports aligning a virtual model of a medical device within a virtual patient model.
3. The collaborative system according to claim 1, further comprising an interaction simulation means, that is configured to simulate interaction between at least one of a virtual patient model of the virtual medical model and/or a virtual model of a medical device with at least one of at least one further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device.
4. The collaborative system according to claim 1, wherein the at least one visualization means, sends image data to at least one display means may be a monoscopic display and/or a stereoscopic display, and wherein the image data representing the generated view and/or scene may be superimposed with further image data.
5. The collaborative system according to claim 1, wherein the system comprises multiple view-manipulation means, each of the view-manipulation means being associated with a user and allows the user manipulating a view of the virtual medical model, wherein the view-manipulation means is configured to receive a user specific user input and to translate the user specific user input in user specific vision change data of the virtual medical model or a sub-model thereof, wherein the synchronization means, is configured to receive user specific vision change data, to synchronize the received user specific vision change data and to transmit user specific synchronized vision change data to the at least one visualization means, wherein the at least one view-manipulation means is configured to receive the user specific vision change data and based on the received data to update the view and/or a scene of the virtual medical model user specifically.
6. The collaborative system according to claim 1, wherein the system is configured to store a generated view and/or a scene of the virtual medical model and/or vision change data of the virtual medical model or a sub-model thereof.
7. The collaborative system according to claim 1, wherein the system is a web-based system that is configured to be run browser based.
8. The collaborative system according to claim 1, further providing a communication channel for the users, wherein the communication channel may be a video and/or audio communication channel and/or may allow for screen sharing.
9. The collaborative system according to claim 1, wherein the visualization means is configured to highlight interaction between different sub-models of the virtual medical model and/or different virtual patient models.
10. The collaborative system according to claim 1, further comprising a means for updating and/or amending the virtual medical model.
11. The collaborative system according to claim 1, wherein the synchronization means is configured to prioritize vison change data associated with user input received from different users and/or block vison change data associated with user input received from at least one user.
12. A method for collaborative visual analysis of a virtual medical model, particularly for medical product development and/or for anatomical comparison by multiple users, the method comprising providing a virtual medical model; generating a view and/or a scene of the virtual medical model, and sending image data representing the generated view and/or scene to a display means; receiving a user input and translating the user input in vision change data of the virtual medical model or a sub-model thereof; synchronizing the vision change data, and updating the view and/or a scene of the virtual medical model based on the synchronized vision change data of the virtual medical model or a sub-model thereof.
13. The method according to claim 12, further comprising automatically aligning a virtual model of a medical device within a virtual patient model.
14. The method according to claim 12, further comprising simulating an interaction between at least one of a virtual patient model, of the virtual medical model and/or a virtual model of a medical device with at least one of at least one further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device.
15. A computer program comprising instructions that, when being carried out by at least one processor, cause the processor to perform for performing a method according to claim 12.
Description
BRIEF DESCRIPTION OF THE FIGURES
[0076] In the following, the accompanying figures are briefly described:
[0077]
[0078]
[0079]
[0080]
[0081]
[0082]
DETAILED DESCRIPTION OF THE FIGURES
[0083]
[0084] The virtual medical model 100a, 100b, 100c is provided by a means 10 for providing the virtual medical model. The virtual medical model 100a, 100b, 100c may comprise different sub-models, such as a virtual patient model 100a and/or a virtual model of a medical device 100b, and may further comprise meta-data 100c, including for example anatomical landmark(s), boundary conditions, an attachment point(s), a result of a collision detection, a device-tissue interaction simulation, patient-specific meta-data, and/or the like.
[0085] A virtual patient model 100a may be based on one or multiple anatomy data sets. These data sets may represent a single patient or multiple patients and may be generated, using at least one of the following data acquisition techniques, such as radiography, magnetic resonance imaging, molecular imaging, ultrasound imaging, elastography, photoacoustic imaging, tomography, echocardiography, near-infrared spectroscopy, magnetic particle imaging, and/or the like. The means 10 for providing the virtual medical model may be adapted to generate a virtual patient model 100a from at least one anatomy data set, and/or may receive a previously generated virtual patient model 100a from a data base.
[0086] The virtual medical model (e.g. the patient model 100a, the model of the medical device 100b, and/or the like) may be a 3D or higher dimensional model and may optionally include corresponding meta-data. The meta-data may provide additional information of a related patient, such as pathology, gender, weight, etc.
[0087] Further, the system 1 comprises at least one visualization means 20. The visualization means 20 serves for generating a view and/or a scene of the virtual medical model 100a, 100b, 100c and is configured to send image data representing the generated view and/or scene to a display means (not shown in
[0088] Further, the system 1 comprises at least one view-manipulation means 30, that allows for manipulating a view of the virtual medical model 100a, 100b, 100c by at least one user. The view-manipulation means 30 is configured to receive a user input 40 and to translate the user input 40 in vision change data of the virtual medical model 100a, 100b, 100c or a sub-model thereof. The translation may be any kind of data conversion, including the mere forwarding of the user input 40.
[0089] The system comprises further a synchronization means 25, that is configured to receive vision change data from the view-manipulation means 30, to synchronize the received vision change data and to transmit the synchronized vision change data to the at least one visualization means 20. The synchronization means 25 may further synchronize and/or prioritize vision change data associated with user inputs of different users to allow for multi-user collaboration in a synchronous and/or an asynchronous mode. Further, the synchronization means 25 may be adapted to synchronize an ownership of an object of the virtual medical model, such as a sub-model. Only one owner per object may be allowed, thereby avoiding conflicts.
[0090] The view manipulation means 30 may further allow a user to interact with the provided virtual medical model 100a, 100b, 100c. For example, the user may edit and/or create annotations 42 that can be superimposed over a generated view and/or scene of the virtual medical model.
[0091] The visualization means 20 is configured to receive the vision change data and based on the received data to update the view and/or a scene of the virtual medical model 100a, 100b, 100c that may be subsequently displayed on at least one display means. The at least one display means may include a monoscopic and/or a stereoscopic display means.
[0092] The collaborative system 1 optionally comprises a guidance means 60 that supports aligning a virtual model of a medical device 100b within a virtual patient model 100a. Aligning includes inter alia positioning (or suggesting at least one position) of the virtual model of a medical device 100b within a virtual patient model 100a, and/or limiting possible movements of the model of the medical device within the virtual patient model. Thus, implantation and/or operation of the medical device can be simulated. Further, the guidance means 60 may support the user to generate meaningful views/scenes of the virtual medical model.
[0093] Further the collaborative system 1 may comprise an interaction simulation means 70, that is configured to simulate interaction between at least one of a virtual patient model 100a of the virtual medical model and/or a virtual model of a medical device 100b with at least one of a further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device. The results of the interaction simulation may be forwarded and/or synchronized (via view-manipulation means 30 and synchronization means 25) to the visualization means 20 to be displayed on at least one display means.
[0094]
[0095] In an asynchronous mode, each user may work on the virtual medical model on his/her own. Thus, the respective display means may display different user specific views/scenes of the virtual medical model. A user specific view/scene may be stored for later sharing among the users of the system.
[0096] A means 10 for providing a virtual medical model may be included in and/or run on a server 15, such as a web server. The means 10 for providing the virtual medical model is configured to provide each user with the same virtual medical model. For example, the means 10 for providing the virtual medical model may be adapted to download at least one virtual medical model from a database that may be a local database or a global database, such as a cloud-based database. Further, the means 10 for providing the virtual medical model may be adapted to transmit at least one virtual medical model, or a copy thereof to each of the computing devices 80, 82. In case the virtual medical model(s) is/are amended, the virtual medical model(s) can be updated on the respective computing device(s).
[0097] On each computing device 80, 82 different means of the system 1 may be run. For example, on each computing device 80, 82 a view-manipulation means 30, a visualization means 20 and/or a synchronization means 25 may be run, as described above with respect to
[0098] The visualization means 20 and the synchronization means 25 may be integrally formed. Additionally, or alternatively, the visualization means 20 and the view-manipulation means 30 may be integrally formed. These means may be run browser based. Thus, there is no need for a local installation of software components of the collaborative system on a user’s computing device.
[0099] In a further embodiment, the synchronization means 25 may be provide in a central manner. Thus, each view-manipulation means is configured to receive a user input 40, 41 and to translate the user input 40, 41 in vision change data 34, 36 of the virtual medical model or a sub-model thereof. The translation may be any kind of data conversion, including the mere forwarding of the user input 40, 41. This vision change data 34, 36, or user input 40, 41 (of different view-manipulation means) is transmitted to a central synchronization means. The central synchronization means is configured to receive vision change data (or forwarded user input), to synchronize the received vision change data and to transmit the synchronized vision change data to respective visualization means that are run on distinct computing devices 80, 82. Each of the visualization means is configured to receive the synchronized vision change data (which may be user specific) and based on the received data to update the view and/or a scene of the virtual medical model. In this embodiment, the signaling amount is also reduced, as only vision change data and synchronized vision change data has to be exchanged for updating a view/scene. Further, updates/amendments of the virtual medical model and/or attributes representing the ownership of an object of the virtual medical model, may be shared between the computing devices. The central synchronization means may be configured to synchronize updates/amendments of the virtual medical model and/or attributes representing the ownership of an object of the virtual medical model, to avoid conflicts.
[0100] The collaborative system 1 may be a web-based system that is configured to be run browser based. The web-based system may comprise a first server 15, such as a web server 15, that hosts the software components of the collaborative system. Accordingly, the first server 15 may allow for downloading software instructions (code) to at least one local computing device 80, 82, that is adapted to execute the respective software instructions. Thus, for example, at least one of the visualization means 20, the synchronization means 25 and the view-manipulation means 30 may be run on the at least on computing device 80, 82. Further, the first server 15 may include the means 10 for providing a virtual medical model. Accordingly, a virtual medical model (i.e. respective data 104, 106) may be downloaded from the first server 15 to at least one computing device 80, 82. Further, this first server 15 may allow for updating/amending the virtual medical model.
[0101] The first server 15 is not limited to a single server but may include a server network. The first server 15 may be configured to provide an Internet-based hypertext system for the collaborative system 1.
[0102] Additionally, a second server 90 may be provided. The second server 90 may be a streaming server and may be configured for exchange of vision change data and/or synchronized vision change data. Further, signaling, such as signaling corresponding to communication channels 53 to 58 may also be exchanged via the second server 90. The second server 90 is not limited to a single server but may include a server network.
[0103] This visual, model-based communication can be supported by a video channel 55, 56 and/or audio communication channel 53, 54. Further, screens may be shared via a screen sharing channel 57, 58.
[0104]
[0105] Further anatomical measurements may be generated and/or amended using the above described system 1 and in particular view-manipulating means 30. Exemplary anatomical measurements include information about dimensions, surfaces, and/or volumes (1D measurements and of higher dimensions), including coordinates of data points and type of measurements.
[0106]
[0107] Further, the difference in shape may for example represent different configurations of the anatomical structure in different patients. Thus, the system allows for medical device development considering the fitting of a medical device for a large population. Still further, the difference in shape may for example represent growth of the anatomical structure, thereby allowing facilitated development of pediatric medical devices.
[0108]
[0109]
TABLE-US-00001 List of reference signs 1 collaborative system 10 means for providing a virtual medical model 15 web server 20 visualization means 25 synchronization means 30 view-manipulation means 34, 36 vision change data 40, 41 user input 42 annotation 42a′ annotation 44 generated view 46 generated view 50, 52 display means 53, 54 audio communication 55, 56 video communication 57, 58 screen sharing 60 guidance means 70 interaction simulation means 80, 82 computing device 90 server 100a, b, c virtual medical model 100a′ virtual medical model 100a″ virtual medical model 100b′ model of a medical device 104, 106 virtual medical model data 142a′, 142a″ sub-models 142b′ collision zone 120 amendments of virtual patient model 122 updates for a model of a medical device 1000 method 1010 providing a virtual medical model; 1020 generating a view and/or a scene of the virtual medical model, 1025 aligning a virtual model of a medical device within a virtual patient model 1030 receiving a user input and translating the user input in vision change data 1035 simulating an interaction 1040 synchronizing vision change data 1050 updating the view and/or a scene of the virtual medical model
[0117] In the following, further embodiments are described to facilitate the understanding of the invention:
[0118] Embodiment 1: A collaborative system (1) for visual analysis of a virtual medical model (100), particularly for medical product development and/or for anatomical comparison by multiple users, the collaborative system comprising [0119] a means (10) for providing a virtual medical model (100a, 100b, 100c; [0120] at least one visualization means (20), for generating a view and/or a scene of the virtual medical model (100a, 100b, 100c), the visualization means (20) being configured to send image data representing the generated view and/or scene to a display means (50, 52); [0121] at least one view-manipulation means (30), that allows manipulating a view of the virtual medical model (100a, 100b, 100c by at least one user, the view-manipulation means (30) is configured to receive a user input (40) and to translate the user input (40) in vision change data (34) of the virtual medical model (100a, 100b, 100c) or a sub-model thereof, [0122] a synchronization means (25), that is configured to receive vision change data, to synchronize the received vision change data and to transmit the synchronized vision change data to the at least one visualization means (20), [0123] wherein the at least one visualization means (20) is configured to receive the synchronized vision change data (34) and based on the received data to update the view and/or a scene of the virtual medical model (100a, 100b, 100c).
[0124] Embodiment 2: The collaborative system (1) according to Embodiment 1, wherein the virtual medical model (100a, 100b, 100c) comprises at least one virtual patient model and/or at least one virtual model of a medical device, the collaborative system (1) further comprising
[0125] a guidance means (60) that supports aligning a virtual model of a medical device (100b) within a virtual patient model (100a).
[0126] Embodiment 3: The collaborative system (1) according to any preceding Embodiment, further comprising
[0127] an interaction simulation means (70), that is configured to simulate interaction between at least one of a virtual patient model (100a) of the virtual medical model (100) and/or a virtual model of a medical device (100b) with at least one of at least one further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device.
[0128] Embodiment 4: The collaborative system (1) according to any preceding Embodiment, wherein the at least one visualization means (20), sends image data to at least one display means (50,52) that may be a monoscopic display and/or a stereoscopic display, and wherein the image data representing the generated view and/or scene may be superimposed with further image data.
[0129] Embodiment 5: The collaborative system (1) according to any preceding Embodiment, wherein the system comprises multiple view-manipulation means (30, 32), each of the view-manipulation means being associated with a user and allows the user manipulating a view of the virtual medical model, wherein [0130] the view-manipulation means is configured to receive a user specific user input (40) and to translate the user specific user input in user specific vision change data (34) of the virtual medical model or a sub-model thereof, wherein [0131] the synchronization means (25), is configured to receive user specific vision change data, to synchronize the received user specific vision change data and to transmit user specific synchronized vision change data to the at least one visualization means (20), wherein [0132] the at least one view-manipulation means (20) is configured to receive the user specific vision change data (34) and based on the received data to update the view and/or a scene of the virtual medical model user specifically.
[0133] Embodiment 6: The collaborative system (1) according to any preceding Embodiment, wherein the system is configured to store a generated view and/or a scene of the virtual medical model (100) and/or vision change data (34) of the virtual medical model or a sub-model thereof.
[0134] Embodiment 7: The collaborative system (1) according to any preceding Embodiment, wherein the system is a web-based system that is configured to be run browser based.
[0135] Embodiment 8: The collaborative system (1) according to any preceding Embodiment, further providing a communication channel for the users, wherein the communication channel may be a video and/or audio communication channel (53, 54; 55, 56) and/or may allow for screen sharing (57, 58).
[0136] Embodiment 9: The collaborative system (1) according to any preceding Embodiment, wherein the visualization means (20) is configured to highlight interaction between different sub-models of the virtual medical model and/or different virtual patient models.
[0137] Embodiment 10: The collaborative system (1) according to any preceding Embodiment, further comprising a means for updating and/or amending the virtual medical model.
[0138] Embodiment 11: The collaborative system (1) according to any preceding Embodiment, wherein the synchronization means (25) is configured to prioritize vison change data associated with user input received from different users and/or block vison change data associated with user input received from at least one user.
[0139] Embodiment 12: A method (1000) for collaborative visual analysis of a virtual medical model, particularly for medical product development and/or for anatomical comparison by multiple users, the method comprising [0140] providing (1010) a virtual medical model; [0141] generating (1020) a view and/or a scene of the virtual medical model, and sending image data representing the generated view and/or scene to a display means; [0142] receiving (1030) a user input and translating the user input in vision change data of the virtual medical model or a sub-model thereof; [0143] synchronizing (1040) the vision change data, and [0144] updating (1050) the view and/or a scene of the virtual medical model based on the synchronized vision change data of the virtual medical model or a sub-model thereof.
[0145] Embodiment 13: The method (1000) according to Embodiment 12, further comprising automatically aligning (1025) a virtual model of a medical device within a virtual patient model.
[0146] Embodiment 14: The method (1000) according to any one of Embodiments 12 or 13, further comprising simulating (1035) an interaction between at least one of a virtual patient model, of the virtual medical model and/or a virtual model of a medical device with at least one of at least one further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device.
[0147] Embodiment 15. Computer program comprising instructions that, when being carried out by at least one processor, cause the processor to perform for performing a method (1000) according to any one of Embodiments 12 to 14.
[0148] Embodiment 16: A non-transitory computer readable medium having stored thereon software instructions that, when carried out by at least one processor, cause the processor to perform for performing a method according to any one of Embodiments 12 to 14.
[0149] Embodiment 17: A collaborative system for visual analysis of a virtual medical model, particularly for medical product development and/or for anatomical comparison by multiple users, the collaborative system comprising at least one processor and a memory coupled with the at least one processor, wherein the at least one processor and memory are configured to [0150] provide a virtual medical model (100a, 100b, 100c); [0151] generate a view and/or a scene of the virtual medical model (100a, 100b, 100c) and to send image data representing the generated view and/or scene to a display means (50, 52); [0152] to receive a user input (40) and to translate the user input (40) in vision change data (34) of the virtual medical model (100a, 100b, 100c) or a sub-model thereof, [0153] synchronize the vision change data, and [0154] update the view and/or a scene of the virtual medical model based on the synchronized vision change data of the virtual medical model or a sub-model thereof.
[0155] Embodiment 18: The collaborative system (1) according to Embodiment 17, wherein the virtual medical model (100a, 100b, 100c) comprises at least one virtual patient model and/or at least one virtual model of a medical device, the at least one processor and memory are further configured to
[0156] align a virtual model of a medical device (100b) within a virtual patient model (100a).
[0157] Embodiment 19: The collaborative system (1) according to any one of Embodiments 17 or 18, wherein the at least one processor and memory are further configured to
[0158] simulate interaction between at least one of a virtual patient model (100a) of the virtual medical model (100) and/or a virtual model of a medical device (100b) with at least one of at least one further virtual patient model of the virtual medical model and/or at least one further virtual model of a medical device.
[0159] Embodiment 20: The collaborative system (1) according to any one of Embodiments 17 to 19, wherein the at least one processor and memory are further configured to
[0160] send image data to at least one display means (50, 52) that may be a monoscopic display and/or a stereoscopic display, and wherein the image data representing the generated view and/or scene may be superimposed with further image data.
[0161] Embodiment 21: The collaborative system (1) according to any one of Embodiments 17 to 20, wherein the at least one processor and memory are further configured to [0162] allow multiple users manipulating a view of the virtual medical model, and wherein [0163] the at least one processor and memory are further configured to [0164] receive a user specific user input (40) and to translate the user specific user input in user specific vision change data (34) of the virtual medical model or a sub-model thereof, wherein [0165] the at least one processor and memory are further configured to [0166] receive user specific vision change data, to synchronize the received user specific vision change data and to update the view and/or a scene of the virtual medical model user specifically.
[0167] Embodiment 22: The collaborative system (1) according to any one of Embodiments 17 to 21, wherein the at least one processor and memory are further configured to
[0168] store a generated view and/or a scene of the virtual medical model (100) and/or vision change data (34) of the virtual medical model or a sub-model thereof. Embodiment 23: The collaborative system (1) according to any one of Embodiments 17 to 22, wherein the system is a web-based system that is configured to be run browser based.
[0169] Embodiment 24: The collaborative system (1) according to any one of Embodiments 17 to 23, further providing a communication channel for the users, wherein the communication channel may be a video and/or audio communication channel (53, 54; 55, 56) and/or may allow for screen sharing (57, 58).
[0170] Embodiment 25: The collaborative system (1) according to any one of Embodiments 17 to 24, wherein the at least one processor and memory are further configured to
[0171] highlight interaction between different sub-models of the virtual medical model and/or different virtual patient models.
[0172] Embodiment 26: The collaborative system (1) according to any one of Embodiments 17 to 25, wherein the at least one processor and memory are further configured to update and/or amend the virtual medical model.
[0173] Embodiment 27: The collaborative system (1) according to any one of Embodiments 17 to 26, wherein the at least one processor and memory are further configured to prioritize vison change data associated with user input received from different users and/or block vison change data associated with user input received from at least one user.