Method for computing holograms for holographic reconstruction of two-dimensional and/or three-dimensional scenes

11460809 · 2022-10-04

Assignee

Inventors

Cpc classification

International classification

Abstract

The invention relates to methods for computing holograms for holographic reconstruction of two-dimensional and/or three-dimensional scenes in a display apparatus, wherein a scene for reconstruction is broken down into object points and the object points are encoded as sub-holograms into at least one spatial light modulation device of the display apparatus. A reconstructed scene is viewed from a region of visibility. At least one virtual plane of the at least one spatial light modulation device is stipulated on the basis of a real plane of the spatial light modulation device. A computation of sub-holograms is performed in the at least one virtual plane of the at least one spatial light modulation device.

Claims

1. A method for calculating holograms for the holographic reconstruction of two-dimensional and/or three-dimensional scenes in a display apparatus, comprising decomposing a scene to be reconstructed into object points and encoding the object points as sub-holograms into at least one spatial light modulator device of the display apparatus, where a reconstructed scene is observed from a visibility region; determining at least one virtual plane of the at least one spatial light modulator device based on a real or physical plane of the spatial light modulator device, carrying out a calculation of sub-holograms in the at least one virtual plane of the at least one spatial light modulator device, and depending on the position of all object points of the scene to be reconstructed, the distance of the at least one virtual plane of the spatial light modulator device to the visibility region is selected such that the average size, preferably averaged over all object points, in form of a number of modulation elements of the sub-holograms to be calculated for the scene to be reconstructed takes a minimum value.

2. The method according to claim 1, wherein the object points of the scene to be reconstructed are calculated as sub-holograms in the at least one virtual plane of the at least one spatial light modulator device, the calculated sub-holograms are transformed from the at least one virtual plane of the at least one spatial light modulator device into the visibility region by means of an integral transformation and are added up there, and the summed sub-holograms are transformed from the visibility region into the physical plane of the at least one spatial light modulator device by means of a further integral transformation and are written in as a hologram.

3. The method according to claim 1, wherein the object points of the scene to be reconstructed are calculated as sub-holograms in the at least one virtual plane of the at least one spatial light modulator device and the sub-holograms are added up in the at least one virtual plane, the summed sub-holograms of the at least one virtual plane of the at least one spatial light modulator device are transformed into the visibility region by means of an integral transformation and are transformed from the visibility region into the physical plane of the at least one spatial light modulator device by means of a further integral transformation and are written in as a hologram.

4. The method according to claim 3, wherein when at least two virtual planes of the at least one spatial light modulator device are determined, one of these virtual planes is each assigned to the object points of the scene to be reconstructed and the object points are calculated as sub-holograms in the virtual plane assigned to them and the sub-holograms of the object points assigned to the virtual plane are added up in each virtual plane, the summed sub-holograms are transformed from the at least two virtual planes into the visibility region by means of an integral transformation, the transforms of the at least two virtual planes are added up in the visibility region, and the total result of the summed transforms is transformed from the visibility region into the physical plane of the at least one spatial light modulator device by means of a further integral transformation and is written in as a hologram.

5. The method according to claim 3, wherein when at least two virtual planes of the at least one spatial light modulator device are determined, one of these virtual planes is each assigned to the object points of the scene to be reconstructed and the object points are calculated as sub-holograms in the virtual plane assigned to them and the sub-holograms of the object points assigned to the virtual plane are added up in each virtual plane, the summed sub-holograms are transformed from the at least two virtual planes into the visibility region by means of an integral transformation, for each of the at least two virtual planes the corresponding transform is transformed from the visibility region into the real or physical plane of the at least one spatial light modulator device by means of a further integral transformation, the transforms of the at least two virtual planes are added up in the physical plane of the at least one spatial light modulator device, and the total result of the summed transforms is written in as a hologram.

6. The method according to claim 1, wherein the transformation of the sub-holograms or the summed sub-holograms from a virtual plane into the visibility region or the further integral transformation from the visibility region into the physical plane of the spatial light modulator device is carried out by means of a one-dimensional integral transformation in the case of a single-parallax encoding or by means of a two-dimensional integral transformation in the case of a single-parallax encoding or a full-parallax encoding.

7. The method according to claim 1, wherein the position of the at least one virtual plane of the spatial light modulator device is selected within the depth range of the scene to be reconstructed, where the depth range of the scene to be reconstructed is delimited by the object point having the smallest distance to the visibility region and the object point having the greatest distance to the visibility region.

8. The method according to claim 1, wherein with respect to the depth range of the scene to be reconstructed, the position of the at least one virtual plane of the spatial light modulator device is selected such that the visible resolution during the reconstruction of the scene does not fall below a given value.

9. The method according to claim 1, wherein the scene to be reconstructed is decomposed into at least two depth range sections, where one virtual plane of the spatial light modulator device is each assigned to the at least two depth range sections and the sub-holograms in the virtual plane assigned to the depth range section are calculated for all object points located within a depth range section.

10. The method according to claim 9, wherein one virtual plane of the virtual planes of the spatial light modulator device, which are assigned to the at least two depth range sections, coincides with the physical plane of the spatial light modulator device.

11. The method according to claim 10, wherein the adding up of the sub-holograms calculated for the physical plane of the spatial light modulator device is carried out either in the physical plane of the spatial light modulator device or in the visibility region.

12. The method according to claim 1, wherein the individual object points of the scene to be reconstructed are encoded in form of sub-holograms on the physical plane of the spatial light modulator device as a lens element having different focal lengths in the horizontal direction and the vertical direction.

13. The method according to claim 1, wherein the calculation of the sub-holograms in the at least one virtual plane of the spatial light modulator device is carried out by means of a two-dimensional full-parallax encoding or by means of a one-dimensional single-parallax encoding.

14. The method according to claim 1, wherein depending on the depth range of the scene to be reconstructed, the number of the virtual planes of the spatial light modulator device as well as the distance of said virtual planes of the spatial light modulator device to the visibility region are selected such that the size in form of a number of modulation elements of the sub-holograms to be calculated for the scene to be reconstructed does not exceed a given value.

15. The method according to claim 1, wherein the number of the virtual planes of the spatial light modulator device is limited to a given value.

16. The method according to claim 1, wherein the position of the at least one virtual plane of the spatial light modulator device is adjusted to the new depth range when there is a change in time of the depth range of the scene to be reconstructed.

17. The method according to claim 1, wherein when tracking the visibility region in the axial direction and/or lateral direction according to a detected position of an observer of the reconstructed scene, the number and position of the at least one virtual plane of the spatial light modulator device are adjusted to the new position of the visibility region.

18. The method according to claim 1, wherein the deviation of the calculated hologram of the scene to be reconstructed by means of the at least one virtual plane of the spatial light modulator device from a hologram calculated directly in the physical plane of the spatial light modulator device for the same scene does not exceed a defined criterion.

19. The method according to claim 1, wherein when using a display apparatus for two-dimensional and/or three-dimensional scenes in which an image plane of the at least one spatial light modulator device is generated, which acts as a physical plane of the spatial light modulator device, at least one virtual plane of the at least one spatial light modulator device is determined depending on the content of a scene to be reconstructed, and the image plane of the spatial light modulator device is shifted such that said image plane coincides with the virtual plane of the spatial light modulator device, the object points of the scene to be reconstructed are calculated as sub-holograms and added up and are written in as a hologram.

20. A display apparatus, in particular a holographic display apparatus for the representation of two-dimensional and/or three-dimensional scenes, comprising a spatial light modulator device, where the light modulator device is suitable for carrying out the method according to claim 1.

21. The display apparatus according to claim 20, wherein the display apparatus comprises an image plane of the spatial light modulator device and an imaging system, where the imaging system is designed such that the position of the image plane is variable.

22. The display apparatus according to claim 21, wherein the imaging system comprises at least one element having a variable focal length.

23. The display apparatus according to claim 20, wherein the display apparatus is designed as a head-mounted display.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) The Figures Show:

(2) FIGS. 1a, 1b, 1c: different possible embodiments of a display apparatus for the holographic reconstruction of two-dimensional and/or three-dimensional scenes, according to the prior art,

(3) FIG. 2: a schematic drawing of a scene to be reconstructed in a frustum in a defined distance to an observer and to a spatial light modulator device,

(4) FIG. 3: a schematic drawing of a scene to be reconstructed according to FIG. 1 when using a spatial light modulator device smaller in size,

(5) FIG. 4: a schematic drawing of the extension of sub-holograms of a preferably three-dimensional scene in analogy to a single-parallax encoding in a physical plane and a virtual plane of the spatial light modulator device,

(6) FIG. 5: a schematic drawing of the extension of sub-holograms of a preferably three-dimensional scene having an extensive depth range in a physical plane and in two virtual planes of the spatial light modulator device,

(7) FIG. 6: a graphical representation of an embodiment for the extension of sub-holograms for different distances of the plane of the spatial light modulator device from a visibility region,

(8) FIG. 7: a schematic drawing of a display apparatus designed as a head-mounted display, and

(9) FIG. 8: the display apparatus according to FIG. 6, in which the image plane of the spatial light modulator device is shifted.

DETAILED DESCRIPTION OF THE INVENTION

(10) It should be mentioned briefly that the same elements/components have the same reference numerals.

(11) In FIG. 1a, schematically and by way of example, a display apparatus according to the prior art for the holographic reconstruction of two-dimensional and/or three-dimensional scenes is shown.

(12) In this example, the display apparatus comprises a light source LQ, a field lens FL and a spatial light modulator device 1. The light source LQ and the field lens FL are arranged in such a way that, where no hologram is written in into the spatial light modulator device 1, the light emitting by the light source LQ is focused by means of the field lens FL into an observer plane 2 at a distance z.sub.lm from the spatial light modulator device 1. If a scene to be reconstructed (not shown here) is decomposed into object points in a suitable way and the object points are encoded into the spatial light modulator device 1 of the display apparatus as sub-holograms, a visibility region 3 or a virtual viewing window is generated at said distance z.sub.lm from the spatial light modulator device 1.

(13) In the display apparatus shown, the distance of the field lens FL of the spatial light modulator device 1 is small, that is, significantly smaller than the distance z.sub.lm of the spatial light modulator device 1 to the visibility region 3.

(14) FIG. 1a shows a field lens having a fixed focal length. In general, the field lens can particularly also be designed to have a variable focal length, or the display apparatus can comprise variable focusing elements in addition to the field lens, used to adjust dynamically the distance z.sub.lm to a changed overserver's position. The display apparatus can, furthermore, comprise deflecting elements for tracking the visibility region 3 of a laterally changed observer's position.

(15) The display apparatus shown in FIG. 1a is also referred to as a holographic direct-view display.

(16) Compared to FIG. 1a, FIG. 1b also shows a display apparatus according to the prior art, which, however, is referred to as a holographic projection display.

(17) In FIG. 1b, several optical elements L, herein shown as lenses, are arranged in the display apparatus such that, first, one usually enlarged real image rB of a spatial light modulator device 1 is generated.

(18) Using a field lens FL, which is arranged very close to the real image rB of the spatial light modulator device 1, furthermore, light of a light source LQ is focused into an observer plane 2.

(19) Then, the decomposing of a scene to be reconstructed into object points and the encoding of the object points into the spatial light modulator device 1 of the display apparatus as sub-holograms can be carried out in such a way as if there were indeed a materially available spatial light modulator device at the location of the real image rB of the spatial light modulator device 1.

(20) FIG. 1c shows a display apparatus in which also a field lens FL focuses light of a light source LQ into an observer plane 2.

(21) In this exemplary embodiment of a display apparatus, a spatial light modulator device 1 is located at a position such that the distance between the spatial light modulator device 1 and the field lens FL is similar in size to the distance between the field lens FL and the observer plane 2.

(22) The distance between the field lens FL and the observer plane 2 corresponds to, for example, the focal length of the field lens FL. The distance between the spatial light modulator device 1 and the field lens FL is approximately as large as but smaller than the focal length of the field lens.

(23) In this case, a usually enlarged virtual image vB of the spatial light modulator device 1 is generated.

(24) In turn, the decomposing of a scene to be reconstructed into object points and the encoding of the object points into the spatial light modulator device 1 of the display apparatus as sub-holograms can then be carried out as if there were indeed a materially available spatial light modulator device 1 at the location of the virtual image vB of the spatial light modulator device 1.

(25) Such a display apparatus can, for example, be designed as a head-mounted display, where a field lens having a small focal length and a spatial light modulator device small in size are located near the eyes of an observer—for example, used as glasses or as a hocular.

(26) The term ‘physical plane of the spatial light modulator device’ as used in the description of the invention should be a generic one comprising also image planes of a spatial light modulator device in a display apparatus as illustrated, for example, by FIGS. 1b and 1c.

(27) FIG. 2 shows in a schematic way a spatial light modulator device 1 according to the present invention. The spatial light modulator device 1 is provided in a holographic display apparatus, where the structure of the holographic display apparatus is not significant for the presentation of the method according to the invention. Usually, as illustrated by the preceding FIGS. 1a to 1c, the holographic display apparatus comprises at least one spatial light modulator device in connection with an illumination device (backlight) and further components, such as, for example, a field lens, deflecting elements etc. To describe the method according to the invention, it is sufficient to describe in more detail only the at least one spatial light modulator device 1 in connection with an observer plane and illustrate it in FIGS. 2 to 5.

(28) Thus, further devices or elements provided in the display apparatus will not be described herein, unless pointed out accordingly.

(29) The spatial light modulator device 1, also referred to as SLM (spatial light modulator), according to FIGS. 2 to 6 can be designed as an amplitude+phase light modulator device, where, of course, other embodiments of the light modulator device are possible, too. However, the embodiment of the spatial light modulator device 1 is of minor importance herein, playing no significant role for the description of the method.

(30) If, however, a comlex value of a hologram is not written in in a single modulation element (pixel) of an amplitude+phase light modulator device but is written in instead using several modulation elements (pixels) of an only phase- or only amplitude-modulating light modulator device, the aforementioned terms ‘pixel pitch’ and ‘number of modulation elements (pixels)’ are to be understood so that a modulation element and a pixel pitch each refers to several modulation elements (pixels) of such a light modulator device into which, in total, one complex value is written in.

(31) The spatial light modulator device 1 can be designed as an amplitude+phase light modulator device in form of a sandwich array. The amplitude light modulator device has, for example, a smaller distance (typically <2 mm) from the phase light modulator device.

(32) In this case, the term ‘physical plane of the spatial light modulator device’ is used preferably such that a central plane is chosen in the sandwich array.

(33) As shown in FIG. 2 and illustrated in the described documents U.S. Pat. No. 7,969,633, WO 2008/025839 A1 and WO 2006/119760 A2 of the applicant, a visibility region 3 is generated in an observer plane 2, through which an observer can watch a reconstructed two-dimensional and/or three-dimensional scene if the observer is in the observer plane 2 and at least one eye 5 coincides with the location of the visibility region 3. The visibility region 3 can be designed as a virtual viewing window. For purposes of illustration, the eye 5 of the observer was shown behind the visibility region 3 in FIGS. 2 and 3. A scene 4 to be reconstructed, herein shown only schematically in dashed lines and by two object points P1 and P2, shall be displayed in a frustum 6 (a truncated pyramidal cone extending from the visibility region 3 to the spatial light modulator device 1 and beyond). Herein, the scene 4 to be reconstructed has a given position and a given distance to an observer.

(34) The spatial light modulator device 1 shown in FIG. 2 is slightly larger in its size and extension and has a greater distance from the visibility region 3 than the one in FIG. 3. By providing beams emanating from the edges of the visibility region 3 through an object point to be reconstructed, for example P2, to the plane of the spatial light modulator device 1, a region—referring to P2, a region S2—can be generated on the light modulator device 1 and is referred to as sub-hologram. In this sub-hologram, the respective object point is defined so that for this object point only a defined region S2 has to be calculated, which will then be encoded into the spatial light modulator device 1. The same applies to the object point P1 defined by a region S1 referred to as sub-hologram on the spatial light modulator device 1.

(35) Here, in absolute terms, small sub-holograms S1 and S2 are generated on the spatial light modulator device according to FIG. 2. Due to the comparatively large pixel pitch of the spatial light modulator device 1 provided in this exemplary embodiment, these sub-holograms extend only over few modulation elements 7, also referred to as pixels (as already explained above), of the spatial light modulator device 1. This is particularly advantageous regarding the amount of computation required for the calculation of sub-holograms and the complex-valued addition of sub-holograms in the visibility region, as explained below.

(36) FIG. 3 shows a spatial light modulator device 10 smaller in its extent and comprising modulation elements 70 smaller in size, where the spatial light modulator device 10 is arranged closer to the visibility region 3 with respect to the distance. For the same object points P1 and P2 of the scene 4 to be reconstructed, generated sub-holograms S10 and S20 become larger in absolute terms in this exemplary embodiment with respect to the spatial light modulator device 10. As here the spatial light modulator device 10 comprises smaller modulation elements 70 (pixels) and thus has a smaller pixel pitch than that of the spatial light modulator device 10 according to FIG. 1, here the sub-holograms S10 and S20 extend over a significantly larger number of modulation elements 70. The computational effort required for calculating the entire hologram from the scene 4 to be reconstructed would, therefore, be greater in this case.

(37) For calculating sub-holograms, the method according to the invention introduces a virtual plane of the spatial light modulator device, which is located at a physical location, in order to minimize the computational effort. In this way, it is possible to obtain fast and exact computational results, irrespective of the size and distance of the spatial light modulator device from the observer plane.

(38) Irrespective of the actual configuration of the holographic display apparatus, in particular of the position of the spatial light modulator device and of the optical system, first, a sub-hologram is calculated in such a way as if the virtual plane of the spatial light modulator device according to FIGS. 2 and 3 were in a physical plane of the spatial light modulator device 1 or 10 and is calculated based on the physical plane of the spatial light modulator device. Then, this sub-hologram is transformed into the physical plane of the spatial light modulator device, that is, into the actually available plane of the spatial light modulator device, by means of two integral transformations, for example, by means of two Fresnel transformations, or it is transformed into the image of the spatial light modulator device, for example, onto a screen, depending on the embodiment of the holographic display apparatus.

(39) Regarding FIGS. 2 and 3, the method according to the invention is now carried out as follows. For example, there is a configuration of the display apparatus as shown in FIG. 3, in which the spatial light modulator device 10 comprises a given number N of modulation elements 70 in an observer's distance D. For a scene 4 to be displayed or reconstructed with known coordinates of the object points P1 to P.sub.n or P10 to Pn′ it is provided that, for the calculation of the individual sub-holograms S1 to S.sub.n or S10 to S.sub.n′ for the individual object points or for the calculation of the entire hologram, the physical plane of the spatial light modulator device 10 is moved virtually to another position or location with respect to the scene to be reconstructed 4 such that the new apparent or only imaginary position of the physical plane of the spatial light modulator device 10, for example, is identical with the position of the physical spatial light modulator device 1 according to FIG. 2. It should be pointed out that the position of the physical plane of the spatial light modulator device 1, 10 is tight or fixed, thus not being shifted physically but only apparently or virtually. The virtual plane of the spatial light modulator device is, therefore, an imaginary size, which, although not provided physically, is provided with regard to its functionality or effect.

(40) For the virtual plane of the spatial light modulator device 1, 10, a position is chosen advantageously with regard to the scene 4 to be reconstructed, which is within the scene 4 to be reconstructed, so that, watched by an observer in the observer plane 2, one part of the object points P1 to P.sub.n, seen in the direction of propagation of light emitted by an illumination device of the display apparatus, is in front of and an other part of the object points P1 to P.sub.n is behind the virtual plane of the spatial light modulator device 1, 10, where the object points that are closest to the observer plane 2 should be located not more than half the virtual observer's distance in front of the virtual plane of the spatial light modulator device 1, 10.

(41) However, the method is not limited to a certain definition of the position of the virtual plane of the spatial light modulator device.

(42) The position of the virtual plane of the spatial light modulator device may move virtually, dynamically with the content of the scene to be displayed, to be able to calculate, for example, scenes with a variable depth range in an optimal way.

(43) The virtual size of the modulation elements 7, 70 of the spatial light modulator device 1, 10 is calculated using the intercept theorem from the ratio of the observer's distances of the virtual plane and the physical plane of the spatial light modulator device multiplied by the pixel pitch of the spatial light modulator device.

(44) For the virtual plane of the spatial light modulator device 1, 10, a sub-hologram or a hologram is calculated in such a way as would be required in the prior art, for example, according to WO 2008/025839 A1, if a spatial light modulator device were provided in this plane. This can be carried out such that for each object point P1 to P.sub.n a sub-hologram is calculated in form of a lens function, and the individual sub-holograms will then be added up coherently.

(45) Subsequently, a one-time computational (two-dimensional) integral transformation, for example, a Fresnel transformation, of the entire hologram is carried out, which corresponds to the optical propagation of light of the virtual plane of the spatial light modulator device to the visibility region 3. Then, a further computational (two-dimensional) integral transformation is carried out, here for example, also a Fresnel transformation, which corresponds to the propagation of light from the visibility region 3 back to the physical plane of the spatial light modulator device 1, 10. An entire hologram is thus obtained, corresponding at least approximately to the hologram that, according to the prior art, is obtained by directly calculating the hologram in the physical plane of the spatial light modulator device 1, 10. The resulting hologram may then be written in or encoded into the spatial light modulator device 1, 10.

(46) Compared to the conventional calculation, the method according to FIGS. 2 and 3 requires two additional integral transformations. On the other hand, for a large number of object points, the computational time savings, and the savings when adding up the individual sub-holograms can be more important than the two integral transformation, which are carried out only once for the entire hologram.

(47) The following embodiments according to FIGS. 4 to 6 show further variants of the method according to the invention.

(48) FIG. 4 is a schematic drawing of the extent of sub-holograms of a preferably three-dimensional scene 4 to be displayed in analogy to a single-parallax encoding in a physical plane 100 of the spatial light modulator device 100 and a virtual plane 100′ of the spatial light modulator device 100. Herein, the depth range of the scene 4 to be reconstructed is represented schematically by the oval limitation. Here, the scene 4 to be reconstructed is decomposed into object points P1 to P.sub.n as well, where only one object point P is shown in FIG. 4. For the object points P1 to P.sub.n, sub-holograms are calculated, for example, in analogy to a single-parallax encoding. The solid lines in FIG. 4 show schematically the light path from the object point P to the visibility region 3 in the encoding direction of one-dimensional sub-holograms S1 and S2. The dashed lines show schematically the course from the sub-hologram S1 to the visibility region 3 in the direction perpendicular to it, where the sub-hologram S1 comprises the extent of only one modulation element (pixel). For better illustration, both are drawn in the paper plane.

(49) The one-dimensional sub-hologram S1 calculated in the virtual plane 100′ of the spatial light modulator device 100 is then transformed by means of an integral transformation, for example, by means of a Fresnel transformation or a Fourier transformation, into the visibility region 3 and is then transformed from there into the physical plane 100 of the spatial light modulator device 100, where it acts as a sub-hologram extended into two dimensions. However, the focal lengths of the lens function of the sub-hologram are not identical in both directions on the physical plane 100 of the spatial light modulator device 100 (orthogonal to each other). In one direction, for example, the encoding direction of the sub-hologram on the virtual plane 100′ of the spatial light modulator device 100, the focal point of the lens function is located in the plane of the object point; in the direction perpendicular to it, the focal point of the lens function is located on the virtual plane 100′ of the spatial light modulator device 100.

(50) This variant of the method can be used in a particularly advantageous way for a spatial light modulator device that is located at a smaller distance to the observer plane 2 and in which the virtual plane of the spatial light modulator device has a greater distance to the observer plane 2 than the physical plane of the spatial light modulator device according to FIG. 4.

(51) FIG. 5 is a schematic drawing of the extent of sub-holograms of a preferably three-dimensional scene 4 to be displayed, with a broad depth range in a physical plane 100 of the spatial light modulator device 100 and in two virtual planes 100′ and 100″ of the spatial light modulator device 100.

(52) Thus, FIG. 5 shows schematically the extent of sub-holograms S1, S2 and S3 of a scene 4 to be reconstructed to be displayed, with a broad depth range, which is represented here also like in FIG. 4 by the oval limitation of the scene 4 to be reconstructed, in a physical plane 100 of the spatial light modulator device 100 and in two virtual planes 100′ and 100″ of the spatial light modulator device 100.

(53) According to FIG. 5, the scene 4 to be reconstructed is decomposed into three depth range sections TA1, TA2 and TA3. Each of the depth range sections TA1, TA2 and TA3 is assigned to one of the two virtual planes 100′, 100″ of the spatial light modulator device 100 or to the physical plane 100 of the spatial light modulator device 100. According to FIG. 5, this means here that the depth range section TA1 is assigned to the virtual plane 100′ of the spatial light modulator device 100, the depth range section TA2 is assigned to the virtual plane 100″ of the spatial light modulator device 100, and the depth range section TA3 is assigned to the physical plane 100 of the spatial light modulator device 100. Furthermore, all object points located in the depth range section TA1, such as the object point P1, are assigned to the virtual plane 100′ of the spatial light modulator device 100; and by means of said virtual plane the sub-holograms are then calculated for the respective object points in said depth range section TA1. All object points located in the depth range section TA2, such as the object point P2, are assigned to the virtual plane 100″ of the spatial light modulator device 100, which is different from the virtual plane 100′ of the spatial light modulator device 100 with respect to its position or location, and is arranged closer to the observer plane 3 here. All the remaining object points, such as the object point P3, are then assigned to the depth range section TA3, where said object points are assigned to the physical plane 100 of the spatial light modulator device 100. Then, for the virtual planes 100′ and 100″ of the spatial light modulator device 100 and the physical plane 100 of the spatial light modulator device 100, the individual sub-holograms, such as S1, S2 and S3 to S.sub.n, are calculated to the respective object points, such as P1, P2 and P3 to P.sub.n, in the respective depth range sections TA1, TA2 and TA3. In this case, the sub-holograms S1 to S.sub.n may be calculated as single-parallax sub-holograms or may also be calculated as full-parallax sub-holograms.

(54) In a single-parallax calculation, the segmentation into virtual planes of the spatial light modulator device and the subdivision of the scene 4 to be reconstructed into several depth range sections TA1, TA2 and TA3 are carried out such that an observer can see the reconstructed two-dimensional and/or three-dimensional scene with no or with only a minor loss in resolution.

(55) In a full-parallax calculation, the segmentation into virtual planes of the spatial light modulator device and the subdivision of the depth range of the scene 4 to be reconstructed into sections are carried out such that a maximum size of the sub-holograms is not exceeded, as explained in detail before the description of the figures.

(56) Subsequently, the calculated sub-holograms S1, S2 and S3 or S1 to S.sub.n of the depth range sections TA1, TA2 and TA3 are transformed into the observer plane 2 or into the visibility region 3, and are added up there. Then, the summed sub-holograms or the entire hologram are transformed into the physical plane of the spatial light modulator device 100.

(57) As shown in FIG. 5, the sub-holograms S1 and S2 for the respective object points P1 and P2 of the scene 4 to be reconstructed are smaller in their extent or size in the two virtual planes 100′ and 100″ of the spatial light modulator device 100 than if they had been calculated directly in the physical plane 100 of the spatial light modulator device 100.

(58) In a graphic representation, FIG. 6 shows a numerical example of the extent of sub-holograms for different distances of the (virtual and physical) plane 100, 100′, 100″ of the spatial light modulator device 100 from the visibility region 3 in the observer plane 2. The distance of the object point from the visibility region is plotted on the abscissa of the displayed diagram, and the size of the sub-hologram or the number of modulation elements (pixels) described by the sub-hologram is plotted on the ordinate. Thus, for an approximately 11-mm-large visibility region, the sizes of the sub-holograms (in modulation elements [pixels] per sub-hologram) are indicated as a function of the distance of the object point from the visibility region for different distances of the spatial light modulator device from the visibility region. The example shown in the diagram should be considered only as an example here.

(59) An object point of a scene to be reconstructed, which is 2 m away from an observer, generates, for example, a sub-hologram with a size of approximately 200×1 modulation elements (pixels) in a single-parallax encoding or a sub-hologram with a size of approximately 200×200 modulation elements in a full-parallax encoding on a spatial light modulator device (SLM), which is 0.7 m away from the visibility region in the observer plane. On a spatial light modulator device (SLM), which, however, is 2.2 m away from the visibility region in the observer plane, the extent of the sub-hologram of the same object point is only few modulation elements (pixels) in size, for example <10×1 modulation elements in a single-parallax encoding or <10×10 modulation elements in a full-parallax encoding. The contrary applies when object points are located at a closer distance to an observer. On a spatial light modulator device at a close distance, said object points are small in their extent or size, but on a spatial light modulator device at a far distance, they are larger in their extent.

(60) The dashed lines in the diagram according to FIG. 6 show schematically the subdivision of a scene to be reconstructed into four depth range sections. For example, the physical plane of the spatial light modulator device may be positioned at a distance of 0.7 m to the visibility region, and the virtual planes of the spatial light modulator device may be positioned at a distance of 1 m or 2.2 m to the visibility region or at infinity. Reversely, however, the physical plane of the spatial light modulator device may, for example, be positioned at a distance of 2.2 m to the visibility region, and a virtual plane of the spatial light modulator device may be positioned at a distance of 0.7 m to the visibility region. By subdividing the depth range into depth range sections, it is achieved that all sub-holograms for object points remain smaller than 70×1 modulation elements for a single-parallax encoding or 70×70 modulation elements for a full-parallax encoding at a distance approximately >62 cm to infinity from the visibility region. Without using virtual planes of the spatial light modulator device, the sub-holograms would, for example, reach an extent of up to 300×300 modulation elements in a full-parallax encoding, involving an increased computational effort.

(61) FIG. 7 shows a display apparatus for the holographic reconstruction of two-dimensional and/or three-dimensional scenes that can be used, for example, as a head-mounted display (HMD) or hocular. With regard to an HMD, usually an enlarged, virtually generated image of a spatial light modulator device is generated. As mentioned above, the physically available plane, that is, the physical plane of the spatial light modulator device can also be understood as an image plane of the spatial light modulator device within the meaning of the invention.

(62) In FIG. 7, a light source and a collimation element, herein in form of a lens as shown, for example, in FIG. 1c, for illuminating a spatial light modulator device 110 are not illustrated for the purpose of clarity. Here, the spatial light modulator device 110 is arranged at a position in the display apparatus in such a way that the distance between the spatial light modulator device 110 and a field lens FL is similar in size—like the distance between the field lens FL and an observer plane 2. If, for example, the distance between the field lens FL and the observer plane 2 equals the focal length of the field lens FL and if the distance between the spatial light modulator device 110 and the field lens FL is slightly smaller than the focal length of the field lens FL, an enlarged virtual image of the spatial light modulator device 110 is visible from the visibility region 3. The more the distance between the spatial light modulator device 110 and the field lens FL approached the focal length of the field lens FL, the further away and more greatly enlarged would be the virtual image. Of course, other arrangements are possible as well. In particular, the field lens FL, which is simplified here, illustrated as a single lens, can also be a composite system of several lenses. In this case, the data regarding the distances of the field lens FL to the visibility region 3 and to the spatial light modulator device 110 would, for example, apply to the principal planes of the lens system.

(63) Furthermore, light beams emanating from a modulator element (pixel) of the spatial light modulator device 110 and directed toward the center and the edges of a viewing window 3 are illustrated. The light beams are deflected by the field lens FL in such a way as if they emanated from or were emitted by an enlarged image 110B of the spatial light modulator device 110 at a greater distance. An imaging system or a focusing system AS which is, advantageously, configured to have a variable focal length herein, is provided between the spatial light modulator device 110 and the field lens FL. The focal length of the imaging system AS can thus be varied in a controllable way. Of course, the imaging system AS can also be arranged at another suitable position in the display apparatus.

(64) If the field lens FL is a lens system comprising several lenses, the imaging system AS having a variable focal length can also be a part of the field lens FL or the field lens FL itself can be designed as an imaging system or a focusing system AS having a variable focal length. The imaging system or the focusing system AS having a variable focal length can, for example, also be designed as a system of several lenses in which the distance of the individual lenses to each other can be varied, whereby the focal length of the entire system is changed.

(65) Furthermore, FIG. 7 shows a three-dimensional scene 4 to be reconstructed, which is illustrated as an example only and which, in this embodiment, is located at a relatively great distance behind an image 110B of the spatial light modulator device 110. For example, the image of the spatial light modulator device 110 is located at a distance of 0.7 m to the visibility region 3. The three-dimensional scene 4, however, is located at a distance of more than 2.5 m from the visibility region 3. The scene 4 to be reconstructed is decomposed into individual object points P1-Pn in order to calculate holograms to be encoded into the spatial light modulator device 110.

(66) For calculating the holograms for an HMD or hocular, a virtual plane 110′ of the spatial light modulator device 110 is determined based on the content of the scene 4 to be reconstructed and is set in the display apparatus at a position in such a way that a size suitable for the calculation of the sub-holograms results or is achieved. For example, as described above, the virtual plane 110′ can be set such that either the maximum size or the average size of the sub-holograms is minimized. According to FIG. 7, the virtual plane 110′ is arranged or set here within the scene 4 to be reconstructed in such a way that a part of the object points P1-Pn are in front of and a part of the object points P1-Pn are behind the virtual plane 110′. FIG. 7 shows the imaging system AS having a variable focal length in the non-controlled state or in the variable mode or off mode.

(67) In FIG. 8, the display apparatus according to FIG. 7 is shown, where in this embodiment the imaging system AS having a variable focal length is controlled in such a way that the image plane 110B of the spatial light modulator device 110 has been shifted such that said image plane 110B coincides with the virtual plane 110′ of the spatial light modulator device 110. In said plane 110B or 110′ of the spatial light modulator device 110, the sub-holograms of the individual object points P1-Pn are then calculated, added up and encoded into the spatial light modulator device 110.

(68) It is also possible to generate and determine not only one virtual plane of the spatial light modulator device but a multitude thereof, i.e., at least two virtual planes. The image of the spatial light modulator device can then be shifted into a suitable virtual plane, where the calculating and encoding of the sub-holograms into the spatial light modulator device can be carried out according to one of the many methods according to the invention described above. In the case of at least two virtual planes, it is furthermore possible to shift the image of the spatial light modulator device sequentially first into one virtual plane and then into another virtual plane.

(69) Particularly for dynamic hologram content, in which the depth range of the preferably three-dimensional scene to be reconstructed changes, the shifting of the image 110B of the spatial light modulator device 110 into the respective virtual plane 110′ of the spatial light modulator device 110 may be adjusted to the respective depth range of the scene of the frame to be displayed.

(70) By subdividing the scene to be reconstructed and displayed into depth range sections and using virtual planes of the spatial light modulator device, the computational effort required for calculating the sub-holograms is significantly reduced and thus there is a significant time improvement when displaying reconstructed scenes.

(71) In contrast, there is an additional effort involved in transforming the sub-hologram data from several virtual planes of the spatial light modulator device into the visibility region, adding it up there and subsequently transforming it into the physical plane of the spatial light modulator device. The total computational effort is reduced by the use of virtual planes of the spatial light modulator device and by positioning said virtual planes in a suitable way.

(72) In this way, the advantages of the calculation methods with regard to the integral transformations and the direct calculation of sub-holograms may be combined.

(73) The invention is not limited to the exemplary embodiments disclosed herein, and it can be used to minimize the computational effort for computer-generated holograms.

(74) In conclusion, it shall explicitly be pointed out that the exemplary embodiments described above serve only to describe the teaching claimed, but do not limit it to the exemplary embodiments.