DEVICE FOR VISUALIZING A 3D OBJECT

20170281111 · 2017-10-05

Assignee

Inventors

Cpc classification

International classification

Abstract

The invention relates to a device (10) for visualizing a 3D object, an X-ray imaging system (1) for visualizing a 3D object, a method for visualizing a 3D object, and a computer program element for controlling such device (10) and a computer readable medium having stored such computer program element. The device (10) for visualizing a 3D object comprises a processing unit (11). The processing unit (11) is configured to provide an image in a 2D projection plane (23). The processing unit (11) is configured to project an initial 3D object (22) from an initial plane (27) with an inverse projection transformation in the 2D projection plane (23) of the image to achieve an inverse 2D object (24). The inverse projection transformation is a projection transformation, wherein a vanishing point is at the other side of the 2D projection plane (23) than the initial object. The processing unit (11) is configured to point-mirror the inverse 2D object (24) to achieve a mirrored non-inverse 2D object (25). The processing unit (11) is configured to project the mirrored non-inverse 2D object (25) back to the initial plane (27) to provide a corrected 3D object (26). The processing unit (11) is configured to project the corrected 3D object (26) again to the 2D projection plane (23) of the image to provide a final 3D object (28) appearing to be non-inversely projected.

Claims

1. A device for visualizing a 3D object, comprising a processing unit, wherein the processing unit is configured to provide an image in a 2D projection plane wherein the processing unit is configured to project an initial 3D object lying in an initial plane with an inverse projection transformation in the 2D projection plane of the image to achieve an inverse 2D object; wherein the initial 3D object has a shape symmetrical to the initial 3D object's geometrical centroid, wherein the inverse projection transformation is a projection transformation, and wherein a vanishing point is at the other side of the 2D projection plane than the initial object; characterized in that the processing unit is configured to point-mirror the inverse 2D object to achieve a mirrored non-inverse 2D object; the processing unit is configured to project the mirrored non-inverse 2D object back to the initial plane to provide a corrected 3D object, and the processing unit is configured to project the corrected 3D object to the 2D projection plane of the image to provide a final 3D object appearing to be non-inversely projected.

2. Device according to claim 1, wherein the image is an X-ray image.

3. Device according to claim 1, wherein the initial 3D object is a cutting plane or a clipping plane.

4. Device according to claim 1, wherein the image further comprises an inversely projected anatomical 3D structure, which remains inversely projected while providing the final object appearing to be non-inversely projected.

5. Device according to claim 4, wherein the processing unit is configured to scale the final 3D object such that it enlarges when approaching a camera.

6. Device according to claim 5, further comprising an interface unit configured for a manipulation of the initial 3D object.

7. An X-ray imaging system for visualizing a 3D object, comprising: an image acquisition unit, a device for visualizing a 3D object according to claim 6, and a display unit, wherein the image acquisition unit is configured for acquiring an image to be provided by a processing unit of the device for visualizing a 3D object; and wherein the display unit is configured to display a final 3D object provided by the processing unit of the device for visualizing a 3D object.

8. A method for visualizing a 3D object, comprising the following steps: providing an image in a 2D projection plane; projecting an initial 3D object from an initial plane with an inverse projection transformation to the 2D projection plane of the image to achieve an inverse 2D object; wherein the initial 3D object has a shape symmetrical to the initial 3D object's geometrical centroid, wherein the inverse projection transformation is a projection, and wherein a vanishing point is at the other side of the 2D projection plane than the initial object; characterized by the further steps of: point-mirroring the inverse 2D object to achieve a mirrored non-inverse 2D object; projecting the mirrored non-inverse 2D object back to the initial plane to provide a corrected 3D object; and projecting the corrected 3D object to the 2D projection plane of the image to provide a final 3D object appearing to be non-inversely projected.

9. A computer program element for controlling a device or system according to claim 1, which, when being executed by a processing unit, is adapted to perform the method steps for visualizing a 3D object.

10. A computer readable medium having stored the computer program element of claim 9.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Exemplary embodiments of the invention will be described in the following with reference to the accompanying drawings:

[0030] FIG. 1 shows a schematic drawing of an example of an embodiment of an X-ray imaging system 1 for visualizing a 3D object according to the invention.

[0031] FIGS. 2a to d show schematically and exemplarily an embodiment of a visualization of a 3D object according to the invention. FIGS. 3a to e show schematically and exemplarily an embodiment of a visualization of a 3D object according to the invention.

[0032] FIG. 4 shows basic steps of an example of a method for visualizing a 3D object.

DETAILED DESCRIPTION OF EMBODIMENTS

[0033] FIG. 1 shows schematically and exemplarily an embodiment of an X-ray imaging system 1 for visualizing a 3D object according to the invention. The X-ray imaging system 1 comprises a device 10 for visualizing a 3D object, an image acquisition unit 2, and a display unit 3.

[0034] The device 10 for visualizing a 3D object comprises a processing unit 11. The image acquisition unit 2 acquires an image to be provided by the processing unit 11 of the device 10 for visualizing a 3D object. The display unit 3 displays a final 3D object 28 (shown in FIG. 2) provided by the processing unit 11.

[0035] The device 10 for visualizing a 3D object further comprises an interface unit 12 for a display and a manipulation of the initial 3D object 22 (shown in FIG. 2). The interface unit 12 may be the above described display unit 3 or a separate device.

[0036] The processing unit 11 of the device 10 for visualizing a 3D object provides an image in a 2D projection plane 23 (shown in FIG. 2). The image is here an X-ray image showing an inversely projected anatomical 3D structure. Inverse projection is a projection, wherein objects further away from a detector appear bigger than objects closer to the detector. This is in contrast to normal human life, where objects further away appear smaller than closer objects.

[0037] As shown in FIG. 2a, the processing unit 11 projects an initial 3D object 22 (here shown as 2D) in an initial plane 27 with an inverse projection transformation (shown by arrows) in a 2D projection plane 23 of the image to achieve an inverse 2D object 24. The initial 3D object 22 (shown in FIG. 2a as 2D) is a rectangular 3D shape that may cut a 3D anatomical structure into two parts. The rectangle may indicate how a user can manipulate the cutting plane. The initial 3D object 22 lies in the initial plane 27 and has a shape symmetrical to the initial 3D object's geometrical centroid. As stated above, inverse projection transformation is a projection transformation, wherein objects further away from a detector appear bigger than objects closer to the detector. In other words, inverse projection transformation is a projection transformation, wherein a vanishing point is at the other side of the 2D projection plane 23 than the initial object 22.

[0038] As shown in FIG. 2b, the processing unit 11 point-mirrors (shown by an arrow) all points of the inverse 2D object 24 to achieve a mirrored non-inverse 2D object 25 that looks reversed. As shown in FIG. 2c, the processing unit 11 then projects the mirrored non-inverse 2D object 25 back to the initial plane 27 to provide a corrected 3D object 26. Then, the corrected 3D object 26 still aligns with the initial plane 27, but is now deformed such that projecting it back to the 2D projection plane 23 of the image using the inverse perspective projection results in a perspective projected final 3D object 28 appearing to be non-inversely projected.

[0039] As a result, a perspective projected final 3D object 28 is achieved in an inverse perspective projected scene. By reversing the inverse projection of the 3D object to normal, non-inverse, perspective projection while the anatomical structure in the image remains in inverse perspective, the user can easily manipulate the 3D object as if it is seen with the human eye.

[0040] In FIG. 2c, the final 3D object or rectangle 28 (here shown in 2D) in is rendered as if it is perspective projected while the anatomical structure in the image is maintained in inverse perspective. However, when the user moves the rectangle 28 away from the camera, the rectangle 28 will appear bigger instead of smaller. As shown in FIG. 2d, this can then be solved by scaling the rectangle 28 such that it grows when moving towards the user or a camera. The processing unit 11 therefore scales the final 3D object 28 such that it enlarges when approaching a camera. The result can then be rendered along with the rest of the image using inverse perspective projection.

[0041] FIG. 3a shows the initial 3D object 22 in parallel 2D projection and inversely projected to achieve the inverse 2D plane 24 shown in FIG. 3b. The inverse 2D plane is point-mirrored to achieve a point-mirrored non-inverse 2D plane 25, which makes the plane look perspective projected as shown in FIG. 3c. The point-mirrored non-inverse looking 2D plane 25 is then projected back to the original 3D plane to provide the corrected 3D object 26 shown in FIG. 3d in parallel projection. As shown in FIG. 3e, the corrected object is then rendered using perspective projection resulting in an image with an inverse perspective projection for a cube and a perspective projection for the final 3D object 28.

[0042] FIG. 4 shows a schematic overview of steps of a method for visualizing a 3D object. The method comprises the following steps, not necessarily in this order: [0043] providing an image in a 2D projection plane 23; [0044] projecting an initial 3D object 22 from an initial plane 27 with an inverse projection transformation to the 2D projection plane 23 of the image to achieve an inverse 2D object 24. The inverse projection transformation is a projection, wherein a vanishing point is at the other side of the 2D projection plane 23 than the initial object; [0045] point-mirroring the inverse 2D object 24 to achieve a mirrored non-inverse 2D object 25; [0046] projecting the mirrored non-inverse 2D object 25 back to the initial plane 27 to provide a corrected 3D object 26; [0047] projecting the corrected 3D object 26 to the 2D projection plane 23 of the image to provide a final 3D object 28 appearing to be non-inversely projected.

[0048] As a result, a perspective projected 3D object is achieved in an inverse perspective projected scene. In other words, it is described to reverse the inverse projection of a 3D object to be manipulated (e.g. a clipping plane) to normal, non-inverse, perspective projection, while e.g. an anatomical structure in the image is maintained in inversely projected.

[0049] In another exemplary embodiment of the present invention, a computer program or a computer program element is provided that is characterized by being adapted to execute the method steps of the method according to one of the preceding embodiments, on an appropriate system.

[0050] The computer program element might therefore be stored on a computer unit, which might also be part of an embodiment of the present invention. This computing unit may be adapted to perform or induce a performing of the steps of the method described above. Moreover, it may be adapted to operate the components of the above described apparatus. The computing unit can be adapted to operate automatically and/or to execute the orders of a user. A computer program may be loaded into a working memory of a data processor. The data processor may thus be equipped to carry out the method of the invention.

[0051] This exemplary embodiment of the invention covers both, a computer program that right from the beginning uses the invention and a computer program that by means of an up-date turns an existing program into a program that uses the invention.

[0052] Further on, the computer program element might be able to provide all necessary steps to fulfill the procedure of an exemplary embodiment of the method as described above.

[0053] According to a further exemplary embodiment of the present invention, a computer readable medium, such as a CD-ROM, is presented wherein the computer readable medium has a computer program element stored on it, which computer program element is described by the preceding section.

[0054] A computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.

[0055] However, the computer program may also be presented over a network like the World Wide Web and can be downloaded into the working memory of a data processor from such a network. According to a further exemplary embodiment of the present invention, a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.

[0056] It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, all features can be combined providing synergetic effects that are more than the simple summation of the features.

[0057] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.