Method of Hologram Calculation
20210173341 · 2021-06-10
Inventors
Cpc classification
G09G3/2085
PHYSICS
G03H1/0841
PHYSICS
G03H1/0808
PHYSICS
G03H1/2294
PHYSICS
G03H1/02
PHYSICS
International classification
G03H1/08
PHYSICS
G03H1/02
PHYSICS
G09G3/20
PHYSICS
Abstract
A method of calculating a hologram having an amplitude and a phase component. The method comprises (i) receiving an input image comprising a plurality of data values representing amplitude. The method then comprises (ii) assigning a random phase value to each data value of the plurality of data values to form a complex data set. The method then comprises (iii) performing an inverse Fourier transform of the complex data set. The method then comprises (iv) constraining each complex data value (X1, X2) of the transformed complex data set to one of a plurality of allowable complex data values (GL1-GL8), each comprising an amplitude modulation value and a phase modulation value, to form a hologram, wherein, the phase modulation values (GL1-GL7) of the plurality of allowable complex data values substantially span at least 3π/2 and at least one of the allowable complex data values has an amplitude modulation value of substantially zero (GL8) and a phase modulation value of substantially zero.
Claims
1. A method of calculating a hologram having an amplitude and a phase component, the method comprising the ordered steps of: (i) receiving an input image comprising a plurality of data values representing amplitude; (ii) assigning a random phase value to each data value of the plurality of data values to form a complex data set; (iii) performing an inverse Fourier transform of the complex data set; (iv) constraining each complex data value of the complex data set to one of a plurality of allowable complex data values, each comprising an amplitude modulation value and a phase modulation value, to form a hologram, the method further comprising: defining a line in the complex plane, wherein the line is a spiral towards the origin comprising a first section which is a substantially closed loop around the origin and a second section which extends inwardly from the circumference of the loop towards the origin of the complex plane; and defining the plurality of allowable complex data values substantially on the line, wherein the phase modulation values of the plurality of allowable complex data values substantially span at least 2π, and wherein at least one of the allowable complex data values has an amplitude modulation value of substantially zero and a phase modulation value of substantially zero.
2. A method of calculating a hologram as claimed in claim 1 wherein the step of constraining the second complex data set to the plurality of allowable complex data values forms a third data set, the method further comprising: (v) performing a forward Fourier transform of the third complex data set, to form a fourth complex data set; and (vi) measuring a difference between the amplitude component of the fourth complex data set and the input image.
3. A method of calculating a hologram as claimed in claim 2, wherein if the measured difference is greater than an error, the method further comprises: (vii) combining the phase component of the fourth complex data set with the plurality of data values representing amplitude of the input image, or a plurality of data values representing amplitude derived from the input image, to form a fifth complex data set; (viii) inverse Fourier transforming the fifth complex data set, to form a sixth complex data set; and (ix) constraining each complex data value of the sixth complex data set to one of the plurality of allowable complex data values to form a hologram.
4. A method of calculating a hologram as claimed in claim 3 further comprising repeating the ordered steps (v) to (ix) until the measured difference between the amplitude component of the complex data set that was produced by the previous iteration and the input image is less than the error.
5. (canceled)
6. A method of calculating a hologram as claimed in claim 1 wherein the first section is substantially circular or elliptical.
7. A method of calculating a hologram as claimed in claim 1 wherein the second section extends to origin.
8. A method of calculating a hologram as claimed in claim 1 wherein the second section extends past the origin.
9. A method of calculating a hologram as claimed in claim 1 wherein the second section is substantially spiral or arc-shaped.
10. A method of calculating a hologram as claimed in claim 1 wherein the length of the second section is less than half the length of the first section.
11. A method of calculating a hologram as claimed in claim 1 wherein the step of defining the plurality of allowable complex data values on the line in the complex plane comprises defining no more than 512 allowable complex data values on the line in the complex plane.
12. A method of calculating a hologram as claimed in claim 1 wherein for each complex data value of the second complex data set, the step of constraining comprises: replacing the amplitude and phase component with the amplitude and phase component of the nearest allowable complex data value in the complex plane.
13. A method of calculating a hologram as claimed in claim 1 wherein for each complex data value of the second complex data set, the step of constraining comprises: (a) if the amplitude component is less than a threshold, replacing the amplitude component and phase component with zero; and (b) if the amplitude component is equal to or greater than the threshold, replacing the amplitude and phase component with the amplitude and phase component of the nearest allowable complex data value in the complex plane.
14. A method of calculating a hologram as claimed in claim 1 wherein for each complex data value of the complex data set, the step of constraining comprises: replacing the amplitude and phase component with the amplitude and phase component of the nearest allowable complex data value in the quadrant of the complex plane containing the complex data value.
15. A method of holographic projection, the method comprising: calculating a hologram as claimed in claim 1; displaying the hologram on light-modulating pixels of at least one display device; and illuminating the at least one display device with coherent light and performing a Fourier transform to generate a holographic reconstruction at a replay plane.
16. A method of holographic projection as claimed in claim 15 wherein the light-modulating pixels are provided on one display device and wherein each light-modulating pixel is operable to modulate both amplitude and phase in accordance with a plurality of complex modulation levels, wherein the plurality of complex modulation levels is the plurality of allowable complex data values
17. A hologram engine arranged to calculate a hologram as claimed in claim 1.
18. A holographic projector comprising: a display device comprising an array of light-modulating pixels, wherein each light-modulating pixel is a cell containing liquid crystal operable to modulate both amplitude and phase; a display driver arranged to drive the display device to display a hologram by independently-driving each light-modulating pixel at a respective complex modulation level selected from a plurality of allowable complex modulation levels, each having an amplitude modulation value and phase modulation value, wherein the plurality of allowable complex modulation levels comprises phase modulation values which substantially span 2π, and wherein at least one of the complex modulation levels has an amplitude modulation value of substantially zero; and wherein the plurality of allowable complex data values are defined substantially on a line in the complex plane, wherein the line is a spiral towards the origin comprising a first section which is a substantially closed loop around the origin and a second section which extends inwardly from the circumference of the loop towards the origin of the complex plane.
19. The holographic projector of claim 18, further comprising a hologram engine configured to calculate a hologram to be displayed by the display driver, the hologram having an amplitude and a phase component and being calculated by a method comprising the ordered steps of: (i) receiving an input image comprising a plurality of data values representing amplitude; (ii) assigning a random phase value to each data value of the plurality of data values to form a complex data set; (iii) performing an inverse Fourier transform of the complex data set; (iv) constraining each complex data value of the complex data set to one of a plurality of allowable complex data values, each comprising an amplitude modulation value and a phase modulation value, to form a hologram, the method further comprising: defining a line in the complex plane, wherein the line is a spiral towards the origin comprising a first section which is a substantially closed loop around the origin and a second section which extends inwardly from the circumference of the loop towards the origin of the complex plane; and defining the plurality of allowable complex data values substantially on the line, wherein the phase modulation values of the plurality of allowable complex data values substantially span at least 2π, and wherein at least one of the allowable complex data values has an amplitude modulation value of substantially zero and a phase modulation value of substantially zero.
20. A holographic projector as claimed in claim 18 wherein the display device is a liquid crystal on silicon device.
21. A holographic projector as claimed in claim 20 wherein the liquid crystal is twisted nematic liquid crystal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Specific embodiments are described by way of example only with reference to the following figures:
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064] The same reference numbers will be used throughout the drawings to refer to the same or like parts.
DETAILED DESCRIPTION OF EMBODIMENTS
[0065] The present invention is not restricted to the embodiments described in the following but extends to the full scope of the appended claims. That is, the present invention may be embodied in different forms and should not be construed as limited to the described embodiments, which are set out for the purpose of illustration.
[0066] Terms of a singular form may include plural forms unless specified otherwise.
[0067] A structure described as being formed at an upper portion/lower portion of another structure or on/under the other structure should be construed as including a case where the structures contact each other and, moreover, a case where a third structure is disposed there between.
[0068] In describing a time relationship—for example, when the temporal order of events is described as “after”, “subsequent”, “next”, “before” or suchlike—the present disclosure should be taken to include continuous and non-continuous events unless otherwise specified. For example, the description should be taken to include a case which is not continuous unless wording such as “just”, “immediate” or “direct” is used.
[0069] Although the terms “first”, “second”, etc. may be used herein to describe various elements, these elements are not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the appended claims.
[0070] Features of different embodiments may be partially or overall coupled to or combined with each other, and may be variously inter-operated with each other. Some embodiments may be carried out independently from each other, or may be carried out together in co-dependent relationship.
[0071] Optical Configuration for Light Modulation
[0072]
[0073] A light source 110, for example a laser or laser diode, is disposed to illuminate the SLM 140 via a collimating lens 111. The collimating lens causes a generally planar wavefront of light to be incident on the SLM. In
[0074] Notably, in this type of holography, each pixel of the hologram contributes to the whole reconstruction. There is not a one-to-one correlation between specific points (or image pixels) on the replay field and specific light-modulating elements (or hologram pixels). In other words, modulated light exiting the light-modulating layer is distributed across the replay field.
[0075] The position of the holographic reconstruction in space is determined by the dioptric (focusing) power of the Fourier transform lens. In the embodiment shown in
[0076] However, the present disclosure is not limited to encoding a fully-complex hologram on a single spatial light modulator. In some examples, the amplitude component of a fully-complex computer-generated hologram is encoded on a first spatial light modulator and the phase component of the fully-complex computer-generated hologram is encoded on a second spatial light modulator. In other examples, the real component of the fully-complex hologram is displayed on a first modulator and the imaginary component is displayed on the second modulator.
[0077]
[0078] In more detail,
[0079] The beam splitter 250 is arranged to receive a planar wavefront of light and output light which is spatially modulated in accordance with the fully-complex hologram. A collimating lens 211 receives light from light source 210 and outputs the planar wavefront of light. The beam splitter is configured to receive the planar wavefront and direct the light to both a first spatial light modulator 242 and a second spatial light modulator 244. The first spatial modulator 242 modulates the amplitude of the light and the second spatial light modulator 224 modulates the phase of the light.
[0080] The components are arranged such that light makes two passes of the beam splitter. On a first pass, the beam splitter 250 transmits the planar wave to the first spatial light modulator 242. On a second pass, the beam splitter 250 receives the amplitude-only modulated light from the first spatial light modulator 242 and reflects the light to the Fourier transform lens 220. The second spatial light modulator 244 modulates the phase of the light to form complex modulated light. On the first pass, the beam splitter 250 reflects the planar wave to the second spatial light modulator 244. On a second pass, the beam splitter 250 transmits the light to the Fourier transform lens 220. Fourier transform lens 220 is configured to receive the output light and perform a frequency-space transformation resulting in a holographic reconstruction at the screen 225.
[0081] A beam splitter is described by way of example only and the skilled person will be familiar with the various possibilities for directing light to first and second spatial light modulators as described in order to achieve modulation of the light in accordance with the fully-complex hologram. It will be appreciated that the functionality of the first and second spatial light modulators may be reversed. That is, the first spatial light modulator 242 may be the phase-only modulation and the second spatial light modulator 244 the amplitude modulator.
[0082]
[0083] In more detail,
[0084] A collimating lens 211 receives light from light source 210 and outputs the planar wavefront of light. The first spatial light modulator 242 is arranged to receive the planar wavefront off-axis. That is, the first spatial light modulator 242 is arranged to receive the planar wavefront at non-normal incidence. In some embodiments, the first spatial light modulator 242 is arranged to receive the planar wavefront at an angle of a few degrees—e.g. 1 to 20 degrees—from the normal. The first spatial light modulator 242 is reflective—i.e. comprises a planar reflective surface—and so outputs spatially modulated light at an angle of a few degrees too. The first spatial light modulator 242 modulates the amplitude of the received light. The first spatial light modulator 242 may be a phase-only modulator configured to deliver a particular amplitude (and phase) distribution to the second spatial light modulator 244 using the propagation distance from the first spatial light modulator 242 to the second spatial light modulator 244. In this way, the first spatial light modulator 242 is arranged to modulate the amplitude of the light despite being a phase modulator. It may be said that
[0085] The second spatial light modulator 244 is arranged to receive the amplitude-only modulated light from the first spatial light modulator 242 off-axis. That is, the second spatial light modulator 244 is arranged to receive the amplitude-only modulated light from the first spatial light modulator 242 at non-normal incidence. In some embodiments, the second spatial light modulator 244 is arranged to receive light at the same angle as the first spatial light modulator 242. In other embodiments, the second spatial light modulator 244 is arranged to receive light at a different angle to the first spatial light modulator 242. The second spatial light modulator 244 is also reflective—i.e. also comprises a planar reflective surface—and so outputs spatially modulated light at an angle to the normal. The second spatial light modulator 244 modulates the phase of the light. The first spatial light modulator 242 modulates only the amplitude of the light and the second spatial light modulator 244 modulates only the phase of the light such that full complex modulation is achieved. The second spatial light modulator 244 directs the complex modulated light to the Fourier transform lens 220. Fourier transform lens 220 is configured to receive the output light and perform a frequency-space transformation resulting in a holographic reconstruction at the screen 225.
[0086]
[0087] Spatial Light Modulator
[0088] The computer-generated hologram may be encoded on any one of a number of different types of SLM. The SLM, or SLMs, may output spatially modulated light in reflection or transmission. In some embodiments, the SLM is a liquid crystal on silicon, “LCOS”, SLM but the present disclosure is not restricted to this type of SLM.
[0089] A LCOS device is capable of displaying large arrays of light-modulating elements in a small aperture. Small elements (typically approximately 10 microns or smaller) result in a practical diffraction angle (a few degrees) so that the optical system does not require a very long optical path. It is easier to adequately illuminate the small aperture (a few square centimetres) of a LCOS SLM than it would be for the aperture of a larger liquid crystal device. LCOS SLMs also have a large aperture ratio, there being very little dead space between the pixels (as the circuitry to drive them is buried under the mirrors). This is an important issue to lowering the optical noise in the replay field. Using a silicon backplane has the advantage that the pixels are optically flat, which is particularly important for a phase modulating device.
[0090] A suitable LCOS SLM is described below, by way of example only, with reference to
[0091] Each of the square electrodes 301 defines, together with the overlying region of the transparent electrode 307 and the intervening liquid crystal material, a controllable light-modulating element 308, often referred to as a pixel. The effective pixel area, or fill factor, is the percentage of the total pixel which is optically active, taking into account the space between pixels 301a. By control of the voltage applied to each electrode 301 with respect to the transparent electrode 307, the properties of the liquid crystal material of the respective light-modulating element may be varied, thereby to provide a spatially-variable modulation to light incident thereon. The effect is to provide spatial modulation to the wavefront.
[0092] The described LCOS SLM outputs spatially modulated light in reflection but the present disclosure is equally applicable to a transmissive LCOS SLM. Reflective LCOS SLMs have the advantage that the signal lines, gate lines and transistors are below the mirrored surface, which results in high fill factors (typically greater than 90%) and high resolutions. Another advantage of using a reflective LCOS spatial light modulator is that the liquid crystal layer can be half the thickness than would be necessary if a transmissive device were used because light makes two passes of the liquid crystal layer. This greatly improves the switching speed of the liquid crystal (a key advantage for the projection of moving video images).
[0093] Spatial light modulators which modulate amplitude-only or phase-only are commercially available and no further description is therefore required. A spatial light modulator comprising pixels each of which may modulate both amplitude and phase at the same time is disclosed herein. Pixels which modulate both amplitude and phase at the same time are described herein as providing fully complex modulation or, simply, complex modulation. This is distinct from pixels which modulate amplitude only or phase only.
[0094] A fully-complex hologram in accordance with the present disclosure may be displayed on a single modulator comprising pixels which modulate both amplitude and phase at the same time. A fully-complex hologram in accordance with the present disclosure may also be displayed on two spatial light modulators each comprising amplitude-only or phase-only modulating pixels in which one spatial light modulator is responsible for the amplitude component (or, alternatively, the real component) and the other spatial light modulator is responsible for the phase component (or, alternatively, the imaginary component).
[0095] Liquid Crystal for Complex Modulation
[0096] Traditionally, nematic liquid crystals have been configured in an amplitude modulation mode; this mode alters the polarisation state of light between crossed polarisers to create a light (transmissive) state and a dark state. Nematic liquid crystals are also presently the best available material for analogue phase modulation in an LCOS device.
[0097] Principally, nematic liquid crystal electro-optic effects are described in terms of electrically induced changes of the n-director structures that are set up using specific surface alignment techniques, the electric field acts upon the n-director and not upon the molecule. The n-director is a unit (headless) vector describing the average molecular orientation in an anisotropic fluid.
[0098] The n-director structures may be elastically deformed by electric fields; these deformations may or may not couple to fluid flow in the nematic liquid crystal. If the elastic deformations do couple to flow it has a significant impact upon the electro-optic response times.
[0099] In some embodiments, a fully-complex computer-generated hologram is represented on a single spatial light modulator comprising pixels each configured for complex modulation. In some embodiments, the light-modulating elements (i.e. the pixels) of the spatial light modulator are cells containing liquid crystal. The optically-active component is the liquid crystal. Each liquid crystal cell is configured to selectively-provide a plurality of light modulation levels. That is, each liquid crystal cell is configured at any one time to operate at one light modulation level selected from a plurality of possible light modulation levels. Each liquid crystal cell is dynamically-reconfigurable to a different light modulation level from the plurality of light modulation levels. For amplitude modulation, the light modulation levels may be considered grey levels. The term “grey level” may also be used for convenience to refer to the plurality of available phase levels in a phase-only modulator even though the different levels are not providing different shades of grey. The term “grey level” is also used herein for convenience to refer to the plurality of available complex modulation levels for the described fully complex modulator.
[0100] In some embodiments, the liquid crystal arranged for complex modulation is a twisted nematic liquid crystal. The tilt of the liquid crystals in the cell are affected by the potential difference across the cell. The liquid crystal may therefore be operable at a plurality of modulation levels which may be represented on the complex plane.
[0101] Twisted nematic liquid crystal devices are ones in which, typically the n-director is at an angle, for example perpendicular, on one electrode relative to the other. The difference in angles is called the twist. The material will have a positive dielectric anisotropy and when an electric field is applied across the cell a reorientation effect takes place. This reorientation is a combination of splay, bend and twist deformations. Although twisted nematic cells offer good performance for amplitude modulating displays, they are generally overlooked when phase modulation is required due to the complex way in which the phase and polarisation are altered by the twisted structure.
[0102] The inventors have recognised that it is possible to use liquid crystal for complex modulation of a complex computer-generated hologram by appropriately selecting the liquid crystals and tuning the properties of the liquid crystals and the cell to the computer-generated hologram. In particular, the inventors have found that an adequate holographic reconstruction can be formed by applying a so-called constrained complex modulation scheme to an appropriate liquid crystal cell. Specifically, the inventors have found that for optimal display of a fully complex hologram, the liquid crystal and cell should be tuned to provide at least 3π/2 of phase modulation and at least one modulation level providing zero amplitude or nominally zero amplitude. Optionally, the liquid crystal and cell are tuned to provide a substantially 2π of phase modulation and/or a plurality of modulation levels which substantially extend down to zero amplitude.
[0103]
[0104] When a liquid crystal cell is illuminated with light polarised parallel to the incident director at the front surface of the cell, it is found that the light reflected in the same polarisation has a complex amplitude which satisfies the equation:
where U.sub.r is the reflected wave, U.sub.i is the incident wave, a is the twist angle, β is the retardance of the liquid crystal, β.sub.1 is the fixed retardation provided by the boundary layers and γ=√{square root over (α.sup.2+β.sup.2)}. The retardance isπdΔn/λ wherein Δn is the birefringence of the liquid crystal and d is the cell gap. The term dΔn is known as the path difference. When an adequate voltage is applied across the liquid crystal cell, the liquid crystals tilt and the cell provides reduced retardance. The complex modulation provided by each cell is therefore a function of voltage. The behaviour shown in
[0105] The characteristic curves shown in
[0106] The behaviour shown in
[0107]
[0108] The characteristic curve shown in
[0109] The characteristic curve shown in
[0110] The cell represented in
[0111]
[0112]
[0113] Hologram Calculation
[0114] A Fourier hologram of a 2D image may be calculated in a number of ways, including using algorithms such as the Gerchberg-Saxton algorithm. The Gerchberg-Saxton algorithm may be used to derive a fully-complex hologram in the Fourier domain from amplitude information in the spatial domain (such as a 2D image). The phase information related to the object is effectively “retrieved” from intensity, or amplitude, only information in the spatial domain. Accordingly, a fully-complex Fourier transform of the object may be calculated.
[0115] In some embodiments, a computer-generated hologram is calculated from amplitude information using the Gerchberg-Saxton algorithm or a variation thereof. The Gerchberg Saxton algorithm considers the situation when intensity cross-sections of a light beam, I.sub.A(x, y) and I.sub.B(x, y), in the planes A and B respectively, are known and I.sub.A(x, y) and I.sub.B(x, y) are related by a single Fourier transform. With the given intensity cross-sections, an approximation to the phase distribution in the planes A and B, ψ.sub.A(x, y) and ψ.sub.B (x, y) respectively, is found. The Gerchberg-Saxton algorithm finds solutions to this problem by following an iterative process.
[0116] The Gerchberg-Saxton algorithm iteratively applies spatial and spectral constraints while repeatedly transferring a data set (amplitude and phase), representative of I.sub.A(x, y) and I.sub.B(x, y), between the spatial domain and the Fourier (spectral or frequency) domain. In accordance with some embodiments, constraints in both the spatial or spectral domain are imposed upon the data set. The corresponding computer-generated hologram in the spectral domain is obtained through at least one iteration of an algorithm.
[0117] In accordance with some embodiments, an algorithm based on the Gerchberg-Saxton algorithm retrieves the fully-complex data set H[u, v] in the spectral domain which, when Fourier transformed, gives rise to amplitude information T[x, y] representative of a target image in the spatial domain (e.g. a photograph). The fully-complex data set H[u, v] is therefore a holographic representative of the target image.
[0118] An example algorithm based on the Gerchberg-Saxton algorithm in accordance with some embodiments of the present disclosure is described in the following with reference to
[0119] The aim of the algorithm represented by
[0120] First processing block 550 receives the first complex data set and performs an inverse Fourier transform of the first complex data set to form a second complex data set. It may be said that the first complex data set is representative of the input image in the spatial domain and the second complex data set is representative of the input image in the spectral or Fourier or frequency domain.
[0121] Second processing block 553 receives the second complex data and constrains each data value of the second complex data set according to the operating characteristics of the light-modulating elements of the spatial light modulator which will be used to display the hologram. That is, each complex value of the second complex data set is constrained to one of a plurality of possible complex values in accordance with a characteristic of the light modulating elements to form a third complex data set (in the spectral domain). As described above, one of the available modulation levels is zero-intensity.
[0122] It will be appreciated that any number of different methods may be used for constraining the complex values of the second complex data set to the available modulation levels of the light modulating elements. In some embodiments, a least-squares fit approach is used to assign a modulation level to each complex value. In some embodiments, the smallest Euclidian distance in the complex plane is used to identify the closest modulation level for each complex data value of the second complex data set.
[0123] In some embodiments, complex values less than a threshold are set to the zero-intensity modulation level at the centre of the characteristic curve and complex values having an amplitude greater than the threshold are constrained to the circumference of the characteristic curve. This approach is referred to herein as thresholding. Two example complex values, X.sub.1 and X.sub.2, are shown in
[0124] In some embodiments, such as the embodiment shown in
[0125] In some embodiments, only the complex modulation levels within the quadrant containing the complex data value are assessed. This approach may be referred to as quadrant searching. In the example of
[0126] In some embodiments, the tail of the characteristic curve does not extend into all four quadrants. For example, the tail may extend into quadrants Q2 and Q4 only. In these embodiments, quadrant searching may be employed for complex data values in quadrants containing at least part of the tail and an alternative approach such as one of the other methods disclosed herein, including thresholding, may be employed for complex data values in the other quadrants.
[0127] Returning to the hologram calculation, the constrained values form the third complex data set of
[0128] Third processing block 556 receives the third complex data set and performs a forward Fourier transform of the third complex data set to form a fourth complex data set. It may be said that the fourth complex data set is representative of the input image in the spatial domain.
[0129] Fourth processing block 559 receives the fourth complex data set and assesses the amplitude component distribution 511A of the fourth complex data set. Specifically, the fourth processing block 559 compares the amplitude component distribution 511A of the fourth complex data set with the input image 510. If the difference between the amplitude component distribution 511A and the input image 510 is sufficiently small, the fourth processing block 559 determines that the hologram 580A is acceptable. That is, if the difference between the amplitude component distribution 511A and the input image 510 is sufficiently small (e.g. less than an error or threshold), the fourth processing block 559 determines that the hologram 580A is a sufficiently-accurate representative of the input image 510 in the spectral domain. In some embodiments, the phase component distribution 513A of the fourth complex data set is ignored for the purpose of this comparison.
[0130] It will be appreciated that any number of different methods for comparing the amplitude component distribution 511A and the input image 510 may be employed and the present disclosure is not limited to any particular method. In some embodiments, a mean square difference between the amplitude component distribution 511A and the input image 510 is calculated. In these embodiments, if the mean square difference is less than a threshold or “error” value, the hologram 580A is deemed acceptable. In these embodiments, the third processing block 556 and fourth processing block 559 therefore act as assessment or check steps which assess the quality of the hologram 580A.
[0131] If the fourth processing block 559 determines that the hologram 580A is not adequate, the algorithm progresses further as shown in
[0132] The phase component distribution 513A of the preceding iteration is fed-back through the processing blocks of the algorithm. The amplitude component distribution 511A is rejected in favour of the amplitude component distribution corresponding to the input image 510. In the first iteration, the data forming step 502 formed the first complex data set by combining an amplitude component distribution corresponding to the input image 510 and a phase component distribution corresponding to a random phase seed 530. However, in the second and subsequent iterations, the data forming step 502 comprises combining (i) the phase component distribution 513A from the previous iteration of the algorithm with (ii) the amplitude component distribution corresponding to the input image 510. The data forming step 502 therefore forms a complex data set by pairing each element of the original amplitude component distribution with the corresponding element of the phase component distribution 513A of the previous iteration.
[0133] The complex data set formed by the data forming step 502 of
[0134]
[0135] The modified input image 511B is calculated by the fifth processing block 558 and sixth processing block 560. Specifically, the fifth processing block 558 calculates a scaled difference between the amplitude component distribution 511A of the previous iteration and the input image 510. That is, the fifth processing block 558 subtracts the amplitude component distribution 511A of the previous iteration from the input image 510, and scales that difference by a multiplier (e.g. less than 1). For the avoidance of doubt, each data value of the array of data values resulting from the subtraction is scaled by the multiplier. Sixth processing block 560 subtracts the scaled difference from the input image 510 to form the modified input image 511B. The complex data set formed by the data forming step 502 of
[0136] In some embodiments, the processing time available for calculating the hologram is limited and this may determine how many iterations are performed. For example, in some embodiments, the holograms are calculated in real-time. In some embodiments, a plurality of holograms are calculated in real-time wherein each hologram corresponds to a respective frame of a sequence of video frames. The inter-frame time may therefore put an upper limit on the time available for calculating the hologram. In some embodiments, the hologram is representative of a frame of a sequence of video frames and the hologram is calculated in the inter-frame period.
[0137] In some embodiments, there is provided a real-time engine arranged to receive image data and calculate holograms in real-time using the algorithm. In some embodiments, the image data is a video comprising a sequence of image frames. In other embodiments, the holograms are pre-calculated, stored in computer memory and recalled as needed for display on a SLM. That is, in some embodiments, there is provided a repository of predetermined holograms.
[0138]
[0139]
[0140]
[0141] Additional Features
[0142] Some embodiments relate to Fourier holography and Gerchberg-Saxton type algorithms by way of example only. The present disclosure is equally applicable to Fresnel holography and holograms calculated by other techniques such as those based on point cloud methods.
[0143] In some embodiments, the light source is a laser. In some embodiments, the replay field is formed on a light receiving surface which may be a screen or a diffuser. The holographic projection system of the present disclosure may be used to provide an improved head-up display (HUD) or head-mounted display. In some embodiments, there is provided a vehicle comprising the holographic projection system installed in the vehicle to provide a HUD. The vehicle may be an automotive vehicle such as a car, truck, van, lorry, motorcycle, train, airplane, boat, or ship.
[0144] The quality of the holographic reconstruction may be affect by the so-called zero order problem which is a consequence of the diffractive nature of using a pixelated spatial light modulator. Such zero-order light can be regarded as “noise” and includes for example specularly reflected light, and other unwanted light from the SLM.
[0145] In the example of Fourier holography, this “noise” is focussed at the focal point of the Fourier lens leading to a bright spot at the centre of the holographic reconstruction. The zero order light may be simply blocked out however this would mean replacing the bright spot with a dark spot. Some embodiments include an angularly selective filter to remove only the collimated rays of the zero order. Embodiments also include the method of managing the zero-order described in European patent 2,030,072, which is hereby incorporated in its entirety by reference.
[0146] In some embodiments, the size (number of pixels in each direction) of the hologram is equal to the size of the spatial light modulator so that the hologram fills the spatial light modulator. That is, the hologram uses all the pixels of the spatial light modulator. In other embodiments, the size of the hologram is less than the size of the spatial light modulator. In some of these other embodiments, part of the hologram (that is, a continuous subset of the pixels of the hologram) is repeated in the unused pixels. This technique may be referred to as “tiling” wherein the surface area of the spatial light modulator is divided up into a number of “tiles”, each of which represents at least a subset of the hologram. Each tile is therefore of a smaller size than the spatial light modulator.
[0147] The Fourier transform of a rectangular window is a sinc function comprising a central lobe and a series of smaller lobes on either side. The total size of the replay field is a fixed size for a given spatial light modulator. A number of “resolution elements” or “image spots” are formed in the replay field, wherein each resolution element is a sinc function. The total number of resolution elements in the replay field is determined by the number of pixels in the hologram. The spacing between adjacent resolution elements provides the appearance of pixellation in the reconstruction. The inventors have found that if the number of pixels is sufficient, the higher frequency components of adjacent sinc functions may start to interfere. This manifests itself as noise in the reconstruction. In some embodiments, the inventors have addressed this problem by using fewer of the pixels in the hologram and tiling the hologram on the spatial light modulator to increase the spacing between the resolution elements in the reconstruction. In some embodiments, the holographic pattern written to the spatial light modulator comprises at least one whole tile (that is, the complete hologram) and at least one fraction of a tile (that is, a continuous subset of pixels of the hologram).
[0148] The holographic reconstruction is created within the zeroth diffraction order of the overall window defined by the spatial light modulator. It is preferred that the first and subsequent orders are displaced far enough so as not to overlap with the image and so that they may be blocked using a spatial filter.
[0149] In embodiments, the holographic reconstruction is colour. In examples disclosed herein, three different colour light sources and three corresponding SLMs are used to provide composite colour. These examples may be referred to as spatially-separated colour, “SSC”. In a variation encompassed by the present disclosure, the different holograms for each colour are displayed on different area of the same SLM and then combining to form the composite colour image. However, the skilled person will understand that at least some of the devices and methods of the present disclosure are equally applicable to other methods of providing composite colour holographic images.
[0150] One of these methods is known as Frame Sequential Colour, “FSC”. In an example FSC system, three lasers are used (red, green and blue) and each laser is fired in succession at a single SLM to produce each frame of the video. The colours are cycled (red, green, blue, red, green, blue, etc.) at a fast enough rate such that a human viewer sees a polychromatic image from a combination of the images formed by three lasers. Each hologram is therefore colour specific. For example, in a video at 25 frames per second, the first frame would be produced by firing the red laser for 1/75th of a second, then the green laser would be fired for 1/75th of a second, and finally the blue laser would be fired for 1/75th of a second. The next frame is then produced, starting with the red laser, and so on. In the FSC configuration, the light-modulating pixels of the SLM are calibrated for each different wavelength used. For example, the voltage required to achieve a particular complex modulation level with red light may be slightly different from the voltage required to achieve that complex modulation level with blue light. The skilled person will understand how to perform that calibration in order to provide to complex modulation levels described herein at any wavelength.
[0151] An advantage of FSC method is that the whole SLM is used for each colour. This means that the quality of the three colour images produced will not be compromised because all pixels of the SLM are used for each of the colour images. However, a disadvantage of the FSC method is that the overall image produced will not be as bright as a corresponding image produced by the SSC method by a factor of about 3, because each laser is only used for a third of the time. This drawback could potentially be addressed by overdriving the lasers, or by using more powerful lasers, but this would require more power to be used, would involve higher costs and would make the system less compact. In general, the higher costs of the three spatial light modulator assemblies in SSC outweighs the costs of the more powerful lasers.
[0152] An advantage of the SSC method is that the image is brighter due to all three lasers being fired at the same time. However, if due to space limitations it is required to use only one SLM, the surface area of the SLM can be divided into three parts, acting in effect as three separate SLMs. The drawback of this is that the quality of each single-colour image is decreased, due to the decrease of SLM surface area available for each monochromatic image. The quality of the polychromatic image is therefore decreased accordingly. The decrease of SLM surface area available means that fewer pixels on the SLM can be used, thus reducing the quality of the image. The quality of the image is reduced because its resolution is reduced. Embodiments utilise the improved SSC technique disclosed in British patent 2,496,108 which is hereby incorporated in its entirety by reference.
[0153] Examples describe illuminating the SLM with visible light but the skilled person will understand that the light sources and SLM may equally be used to direct infrared or ultraviolet light, for example, as disclosed herein. For example, the skilled person will be aware of techniques for converting infrared and ultraviolet light into visible light for the purpose of providing the information to a user. For example, the present disclosure extends to using phosphors and/or quantum dot technology for this purpose.
[0154] The methods and processes described herein may be embodied on a computer-readable medium. The term “computer-readable medium” includes a medium arranged to store data temporarily or permanently such as random-access memory (RAM), read-only memory (ROM), buffer memory, flash memory, and cache memory. The term “computer-readable medium” shall also be taken to include any medium, or combination of multiple media, that is capable of storing instructions for execution by a machine such that the instructions, when executed by one or more processors, cause the machine to perform any one or more of the methodologies described herein, in whole or in part.
[0155] The term “computer-readable medium” also encompasses cloud-based storage systems. The term “computer-readable medium” includes, but is not limited to, one or more tangible and non-transitory data repositories (e.g., data volumes) in the example form of a solid-state memory chip, an optical disc, a magnetic disc, or any suitable combination thereof. In some example embodiments, the instructions for execution may be communicated by a carrier medium. Examples of such a carrier medium include a transient medium (e.g., a propagating signal that communicates instructions).
[0156] It will be apparent to those skilled in the art that various modifications and variations can be made without departing from the scope of the appended claims. The present disclosure covers all modifications and variations within the scope of the appended claims and their equivalents.