Display system
11256215 · 2022-02-22
Assignee
Inventors
Cpc classification
G03H2226/02
PHYSICS
G03H1/2294
PHYSICS
G03H2001/303
PHYSICS
G03H1/26
PHYSICS
International classification
Abstract
A display system and a method of adjusting a display system are disclosed. A first plurality of pixels is arranged to display a first hologram, receive light of a first wavelength, and output spatially-modulated light according to the first hologram, along a first optical path. A first Fourier transform lens on the first optical path forms a first holographic reconstruction at a replay plane. A second plurality of pixels is arranged to display a second hologram, receive light of a second wavelength, and output spatially modulated light according to the second hologram, along a second optical path. A second Fourier transform lens on the second optical path forms a second holographic reconstruction at the replay plane. A first optical element on the first optical path is arranged to receive the output light from a first part of the first optical path and direct it along a second part of the first optical path to the replay plane. A second optical element on the second optical path is arranged to receive the output light of the second wavelength from a first part of the second optical path and direct it along a second part of the second optical path to the replay plane. The length of the first part of the first optical path is not equal to the length of the first part of the second optical path. The first part of the first optical path may he substantially collinear with the first part of the second optical path.
Claims
1. A display system comprising: a light source configured to provide light of at least a first wavelength and light of a second wavelength; one or more spatial light modulators including at least a first plurality of pixels and a second plurality of pixels, the first plurality of pixels being arranged to be written with a first holographic data set and first focusing lensing data, receive the light of the first wavelength from the light source, and output along a first optical path the light of the first wavelength that is spatially-modulated according to the first holographic data set and the first focusing lensing data, the first focusing lensing data being configured to cause formation of a first holographic reconstruction, corresponding to the first holographic data set, from the light of the first wavelength at a replay plane, and the second plurality of pixels being arranged to be written with a second holographic data set and second focusing lensing data, receive the light of the second wavelength from the light source, and output along a second optical path the light of the second wavelength that is spatially-modulated according to the second holographic data set and the second focusing lensing data, the second focusing lensing data being configured to cause formation of a second holographic reconstruction, corresponding to the second hologram, from the light of the second wavelength at the replay plane; a first optical element on the first optical path between the first plurality of pixels and the replay plane, wherein the first optical element is arranged to receive the light of the first wavelength from a first part of the first optical path and direct the light of the first wavelength along a second part of the first optical path to the replay plane; and a second optical element on the second optical path between the second plurality of pixels and the replay plane, wherein the second optical element is arranged to receive the modulated light of the second wavelength from a first part of the second optical path and direct the light of the second wavelength along a second part of the second optical path to the replay plane, the first part of the second optical path being substantially collinear with the first part of the first optical path, wherein the length of the second optical path between the second plurality of pixels and the replay plane is not equal to the length of the first optical path between the first plurality of pixels and the replay plane, and wherein the length of the first part of the first optical path is not equal to the length of the first part of the second optical path.
2. The display system of claim 1 wherein the first wavelength is less than the second wavelength, and the length of the first optical path between the first plurality of pixels and the replay plane is greater that the length of the second optical path between the second plurality of pixels and the replay plane.
3. The display system of claim 1 wherein the second optical element comprises a wavelength-selective mirror for reflecting the light of the second wavelength and transmitting the light of the first wavelength.
4. The display system of claim 1 wherein the length of the first part of the first optical path is greater than the length of the first part of the second optical path.
5. The display system of claim 1, wherein the second optical element is arranged to receive the substantially collinear first part of the first and second optical paths, and to transmit the light of the first wavelength along the first optical path to the first optical element, whilst directing the light of the second wavelength along the second part of the second optical path.
6. The display system of claim 1 wherein the first optical element is arranged to direct the light of the first wavelength along the second part of the first optical path to the replay plane, and the second optical element is arranged to direct the light of the second wavelength along the second part of the second optical path to the replay plane such that the first holographic reconstruction and the second holographic reconstruction are substantially coincident.
7. The display system of claim 1 wherein the first holographic reconstruction has a first full frame area, and the second holographic reconstruction has a second full frame area, and wherein the first and second optical elements are arranged so that the respective lengths of the first and second optical paths are such that the first and second holographic reconstructions have substantially the same resolution within the smaller of the first full-frame area and the second full frame area.
8. The display system of claim 1, wherein: the light source is configured to provide light of a third wavelength; the one or more spatial light modulators include a third plurality of pixels arranged to be written with third holographic data set and third focusing lensing data, receive the light of the third wavelength from the light source, and output along a third optical path the light of the third wavelength that is spatially-modulated according to the third holographic data set and the third focusing lensing data, the third focusing lensing data being configured to cause formation of a third holographic reconstruction corresponding to the third holographic data set from the light of the third wavelength at the replay plane; the display system further comprises a third optical element on the third optical path between the third plurality of pixels and the replay plane, wherein the third optical element is arranged to receive the light of the third wavelength from a first part of the third optical path and direct the light of the third wavelength along a second part of the third optical path to the replay plane; the length of the third optical path between the third plurality of pixels and the replay plane is not equal to the length of the first optical path between the first plurality of pixels and the replay plane and/or second optical path between the second plurality of pixels and the replay plane; and the length of the first part of the third optical path is not equal to the length of the first part of the second optical path and/or the first part of the first optical path.
9. The display system as claimed in claim 8 wherein the first part of the third optical path is substantially collinear with the first part of the first optical path and the first part of the second optical path.
10. The display system of claim 9 wherein the first wavelength is less than the second wavelength and the third wavelength is less than the second wavelength, and wherein the length of the first optical path between the first plurality of pixels and the replay plane is greater than the length of the second optical path between the second plurality of pixels and the replay plane, and the length of the second optical path between the second plurality of pixels and the replay plane is greater that the length of third optical path between the third plurality of pixels and the replay plane.
11. The display system of claim 9 wherein: the third optical element is arranged to receive the first part of each of the first, second and third optical paths, and to transmit the light of the first and second wavelengths along the first and second optical paths to the respective first and second optical elements, whilst directing the light of the third wavelength along the second part of the third optical path, and the second optical element is arranged to receive the light of the first and second wavelengths from the third optical element and to transmit the light of the first wavelength along the first optical path to the first optical element, whilst directing the light of the second wavelength along the second part of the second optical path.
12. A method of adjusting the display system of claim 8, the method comprising: adjusting the position of the first optical element, to form the first holographic reconstruction at the replay plane, comprising linear movement of the first optical element towards or away from the first plurality of pixels along an axis substantially parallel to the first part of the first optical path; adjusting the position of the second optical element to form the second holographic reconstruction at the replay plane, comprising linear movement of the second optical element towards or away from the second plurality of pixels along an axis substantially parallel to the first part of the second optical path so that the second holographic reconstruction matches the first holographic reconstruction in position, wherein the first holographic reconstruction has a first full frame area, and the second holographic reconstruction has a second full frame area matching the first full frame area, and wherein the first and second optical elements are adjusted so that the respective lengths of the first and second optical paths are such that the first and second holographic reconstructions have substantially the same resolution within the first full-frame area and the second full frame area, and adjusting the position of the third optical element to form the third holographic reconstruction at the replay plane, comprising linear movement of the third optical element towards or away from the third plurality of pixels along an axis substantially parallel to the first part of the third optical path so that the third holographic reconstruction matches the first and second holographic reconstructions in position, wherein the third holographic reconstruction has a third full frame area matching the first full frame area, and wherein the first and third optical elements are adjusted so that the respective lengths of the first and third optical paths are such that the first and third holographic reconstructions have substantially the same resolution within the first full-frame area and the third full frame area.
13. The method of claim 12, further comprising: adjusting the orientation of one or more of the first, second and third optical elements.
14. A display system comprising: a light source configured to provide light of at least a first wavelength and light of a second wavelength; one or more spatial light modulators including at least a first plurality of pixels and a second plurality of pixels, the first plurality of pixels being arranged to be written with first holographic data set and first focusing lensing data, receive the light of the first wavelength from the light source, and output along a first optical path the light of the first wavelength that is spatially-modulated according to the first holographic data set and the first focusing lensing data, the first focusing lensing data being configured to cause formation of a first holographic reconstruction, corresponding to the first holographic data set, from the light of the first wavelength at a replay plane, and the second plurality of pixels being arranged to be written with a second holographic data set and second focusing lensing data, receive the light of the second wavelength from the light source, and output along a second optical path the light of the second wavelength that is spatially-modulated according to the second holographic data set and the second focusing lensing data, the second focusing lensing data being configured to cause formation of a second holographic reconstruction, corresponding to the second hologram, from the light of the second wavelength at the replay plane; a first optical element on the first optical path between the first plurality of pixels and the replay plane, wherein the first optical element is arranged to receive the light of the first wavelength from a first part of the first optical path and direct the light of the first wavelength along a second part of the first optical path to the replay plane; and a second optical element on the second optical path between the second plurality of pixels and the replay plane, wherein the second optical element is arranged to receive the light of the second wavelength from a first part of the second optical path and direct the light of the second wavelength along a second part of the second optical path to the replay plane, wherein the length of the second optical path between the second plurality of pixels and the replay plane is not equal to the length of the first optical path between the first plurality of pixels and the replay plane, wherein the length of the first part of the first optical path is not equal to the length of the first part of the second optical path, and wherein a direction of the second part of the first optical path is different from a direction of the second part of the second optical path.
15. A display system comprising: a light source configured to provide light of at least a first wavelength and light of a second wavelength; one or more spatial light modulators including at least a first plurality of pixels and a second plurality of pixels, the first plurality of pixels being arranged to be written with first holographic data set and first focusing lensing data, receive light of the first wavelength from the light source, and output along a first optical path light of the first wavelength that is spatially-modulated according to the first holographic data set and the first focusing lensing data, the first focusing lensing data being configured to cause formation of a first holographic reconstruction, corresponding to the first holographic data set, from the light of the first wavelength at a replay plane, and the second plurality of pixels being arranged to be written with a second holographic data set and second focusing lensing data, receive the light of the second wavelength from the light source, and output along a second optical path the light of the second wavelength that is spatially-modulated according to the second holographic data set and the second focusing lensing data, the second focusing lensing data being configured to cause formation of a second holographic reconstruction, corresponding to the second hologram, from the light of the second wavelength at the replay plane; a first optical element on the first optical path between the first plurality of pixels and the replay plane, wherein the first optical element is arranged to receive the light of the first wavelength from a first part of the first optical path and direct the light of the first wavelength along a second part of the first optical path to the replay plane; and a second optical element on the second optical path between the second plurality of pixels and the replay plane, wherein the second optical element is arranged to receive the light of the second wavelength from a first part of the second optical path and direct the light of the second wavelength along a second part of the second optical path to the replay plane, wherein the length of the second optical path between the second plurality of pixels and the replay plane is not equal to the length of the first optical path between the first plurality of pixels and the replay plane, wherein the length of the first part of the first optical path is not equal to the length of the first part of the second optical path, and wherein the first optical element comprises a first mirror and the second optical element comprises a second mirror, wherein the first mirror is oriented at a different angle to the second mirror.
16. A method of displaying an image comprising providing light of a first wavelength and light of a second wavelength from a light source; writing a first holographic data set and first focusing lensing data on a first plurality of pixels of one or more spatial light modulators; receiving the light of the first wavelength from the light source at the first plurality of pixels and outputting along a first optical path the light of the first wavelength that is spatially modulated according to the first holographic data set; causing, via the first set of pixels written with the first focusing lensing data, the light of the first wavelength to form a first holographic reconstruction corresponding to the first holographic data set at a replay plane, wherein the forming the first holographic reconstruction at the replay plane includes transmitting the light of the first wavelength from the first plurality of pixels along a first part of the first optical path to a first optical element, and directing the light of the first wavelength with the first optical element along a second part of the first optical path to the replay plane; writing a second holographic data set and second focusing lensing data on a second plurality of pixels of the one or more spatial light modulators; receiving the light of the second wavelength from the light source at the second plurality of pixels and outputting from the second plurality of pixels along a second optical path the light of the second wavelength that is spatially modulated according to the second holographic data set; and causing, via the second set of pixels written with the second focusing lensing data, the light of the second wavelength to form a second holographic reconstruction corresponding to the second holographic data set at the replay plane, wherein the forming the second holographic reconstruction at the replay plane includes transmitting the light of the second wavelength from the second plurality of pixels along a first part of the second optical path to a second optical element, and directing the light of the second wavelength with the second optical element along a second part of the second optical path to the replay plane, and wherein the first part of the second optical path is substantially collinear with the first part of the first optical path, wherein the length of the second optical path between the second plurality of pixels and the replay plane is not equal to the length of the first optical path between the first plurality of pixels and the replay plane, and wherein the length of the first part of the first optical path is not equal to the length of the first part of the second optical path.
17. The method according to claim 16, wherein the directing of the light of the first wavelength and the directing of the light of the second wavelength are performed so that the second holographic reconstruction matches the first holographic reconstruction in position, and wherein the first holographic reconstruction has a first full frame area, and the second holographic reconstruction has a second full frame area matching the first full frame area, and wherein the first and second optical elements are adjusted so that the respective lengths of the first and second optical paths are such that the first and second holographic reconstructions have substantially the same resolution within the first full-frame area of and the second full frame area.
18. The method of claim 16, wherein the directing of the light of the first wavelength and the directing of the light of the second wavelength are performed so that the second holographic reconstruction matches the first holographic reconstruction in position, wherein the first holographic reconstruction has a first full frame area, and the second holographic reconstruction has a second full frame area matching the first full frame area, and wherein the first and second optical elements are adjusted so that the respective lengths of the first and second optical paths are such that the first and second holographic reconstructions have substantially the same resolution within the first full-frame area and the second full frame area; the directing of the light of the first wavelength is performed with a first optical element that is a first mirror and the directing of the light of the second wavelength is performed with a second optical element that is a second mirror; and the second optical element receives a substantially collinear first part of the first and second optical paths, and transmits the light of the first wavelength along the first optical path to the first optical element, whilst directing the light of the second wavelength along the second part of the second optical path, the method further comprising: adjusting the position of the first optical element, to form the first holographic reconstruction at the replay plane, comprising linear movement of the first optical element towards or away from the first plurality of pixels along an axis substantially parallel to the first part of the first optical path; and adjusting the position of the second optical element to form the second holographic reconstruction at the replay plane, comprising linear movement of the second optical element towards or away from the second plurality of pixels along an axis substantially parallel to the first part of the second optical path so that the second holographic reconstruction matches the first holographic reconstruction in position, wherein the first holographic reconstruction has a first full frame area, and the second holographic reconstruction has a second full frame area matching the first full frame area, and wherein the first and second optical elements are adjusted so that the respective lengths of the first and second optical paths are such that the first and second holographic reconstructions have substantially the same resolution within the first full-frame area and the second full frame area.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Specific embodiments are described by way of example only with reference to the following figures:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13) The same reference numbers will be used throughout the drawings to refer to the same or like parts.
DETAILED DESCRIPTION OF EMBODIMENTS
(14) The present invention is not restricted to the embodiments described in the following but extends to the full scope of the appended claims. That is, the present invention may be embodied in different forms and should not be construed as limited to the described embodiments, which are set out for the purpose of illustration.
(15) Terms of a singular form may include plural forms unless specified otherwise.
(16) A structure described as being formed at an upper portion/lower portion of another structure or on/under the other structure should be construed as including a case where the structures contact each other and, moreover, a case where a third structure is disposed there between.
(17) In describing a time relationship—for example, when the temporal order of events is described as “after”, “subsequent”, “next”, “before” or suchlike—the present disclosure should be taken to include continuous and non-continuous events unless otherwise specified. For example, the description should be taken to include a case which is not continuous unless wording such as “just”, “immediate” or “direct” is used.
(18) Although the terms “first”, “second”, etc. may be used herein to describe various elements, these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the appended claims.
(19) Features of different embodiments may be partially or overall coupled to or combined with each other, and may be variously inter-operated with each other. Some embodiments may be carried out independently from each other, or may be carried out together in co-dependent relationship.
(20) Optical Configuration
(21)
(22) A light source 110, for example a laser or laser diode, is disposed to illuminate the SLM 140 via a collimating lens 111. The collimating lens causes a generally planar wavefront of light to be incident on the SLM. In
(23) Notably, in this type of holography, each pixel of the hologram contributes to the whole reconstruction. There is nota one-to-one correlation between specific points (or image pixels) on the replay field and specific light-modulating elements (or hologram pixels). In other words, modulated light exiting the light-modulating layer is distributed across the replay field.
(24) In these embodiments, the position of the holographic reconstruction in space is determined by the dioptric (focusing) power of the Fourier transform lens. In the embodiment shown in
(25) Hologram Calculation
(26) In some embodiments, the computer-generated hologram is a Fourier transform hologram, or simply a Fourier hologram or Fourier-based hologram, in which an image is reconstructed in the far field by utilising the Fourier transforming properties of a positive lens. The Fourier hologram is calculated by Fourier transforming the desired light field in the replay plane back to the lens plane. Computer-generated Fourier holograms may be calculated using Fourier transforms,
(27) A Fourier transform hologram may be calculated using an algorithm such as the Gerchberg-Saxton algorithm. Furthermore, the Gerchberg-Saxton algorithm may be used to calculate a hologram in the Fourier domain (i.e. a Fourier transform hologram) from amplitude-only information in the spatial domain (such as a photograph). The phase information related to the object is effectively “retrieved” from the amplitude-only information in the spatial domain. In some embodiments, a computer-generated hologram is calculated from amplitude-only information using the Gerchberg-Saxton algorithm or a variation thereof.
(28) The Gerchberg Saxton algorithm considers the situation when intensity cross-sections of a light beam, I.sub.A(x, y) and I.sub.B(x, y), in the planes A and B respectively, are known and I.sub.A(x, y) and I.sub.B(x, y) are related by a single Fourier transform. With the given intensity cross-sections, an approximation to the phase distribution in the planes A and B, ψ.sub.A(x, y) and ψ.sub.B(x, y) respectively, is found. The Gerchberg-Saxton algorithm finds solutions to this problem by following an iterative process. More specifically, the Gerchberg-Saxton algorithm iteratively applies spatial and spectral constraints while repeatedly transferring a data set (amplitude and phase), representative of I.sub.A(x, y) and I.sub.B(x, y), between the spatial domain and the Fourier (spectral or frequency)) domain. The corresponding computer-generated hologram in the spectral domain is obtained through at least one iteration of the algorithm. The algorithm is convergent and arranged to produce a hologram representing an input image. The hologram may be an amplitude-only hologram, a phase-only hologram or a fully complex hologram.
(29) In some embodiments, a phase-only hologram is calculated using an algorithm based on the Gerchberg-Saxton algorithm such as described in British patent 2,498,170 or 2,501,112 which are hereby incorporated in their entirety by reference. However, embodiments disclosed herein describe calculating a phase-only hologram by way of example only. In these embodiments, the Gerchberg-Saxton algorithm retrieves the phase information ψ[u, v] of the Fourier transform of the data set which gives rise to a known amplitude information T[x, y], wherein the amplitude information T[x, y] is representative of a target image (e.g. a photograph). Since the magnitude and phase are intrinsically combined in the Fourier transform, the transformed magnitude and phase contain useful information about the accuracy of the calculated data set. Thus, the algorithm may be used iteratively with feedback on both the amplitude and the phase information. However, in these embodiments, only the phase information ψ[u, v] is used as the hologram to form a holographic representative of the target image at an image plane. The hologram is a data set (e.g. 2D array) of phase values.
(30) In other embodiments, an algorithm based on the Gerchberg-Saxton algorithm is used to calculate a fully-complex hologram. A fully-complex hologram is a hologram having a magnitude component and a phase component. The hologram is a data set (e.g. 2D array) comprising an array of complex data values wherein each complex data value comprises a magnitude component and a phase component.
(31) In some embodiments, the algorithm processes complex data and the Fourier transforms are complex Fourier transforms. Complex data may be considered as comprising (i) a real component and an imaginary component or (ii) a magnitude component and a phase component. In some embodiments, the two components of the complex data are processed differently at various stages of the algorithm.
(32)
(33) First processing block 250 receives the starting complex data set and performs a complex Fourier transform to form a Fourier transformed complex data set. Second processing block 253 receives the Fourier transformed complex data set and extracts the set of phase values. The second processing block 253 quantises each phase value to form hologram 280A. Each phase value is quantised in accordance with the phase-levels which may be represented on the pixels of the spatial light modulator which will be used to “display” the hologram. For example, if each pixel of the spatial light modulator provides 256 different phase levels, each phase value of the hologram is quantised into one phase level of the 256 possible phase levels. Hologram 280A is a phase-only Fourier hologram which is representative of an input image. It may be said that hologram 280A is representative of the input image in the spectral or Fourier or frequency domain. In some embodiments, the algorithm stops at this point.
(34) However, in other embodiments, the algorithm continues as represented by the dotted arrow in
(35) Third processing block 256 receives the complex data set output by the second processing block 253 and performs an inverse Fourier transform to form an inverse Fourier transformed complex data set. It may be said that the inverse Fourier transformed complex data set is representative of the input image in the spatial domain.
(36) Fourth processing block 259 receives the inverse Fourier transformed complex data set and extracts the distribution of magnitude values 211A and the distribution of phase values 213A. Optionally, the fourth processing block 259 assesses the distribution of magnitude values 211A. Specifically, the fourth processing block 259 may compare the distribution of magnitude values 211A of the inverse Fourier transformed complex data set with the input image 510 which is itself, of course, a distribution of magnitude values. If the difference between the distribution of magnitude values 211A and the input image 210 is sufficiently small, the fourth processing block 259 may determine that the hologram 280A is acceptable. That is, if the difference between the distribution of magnitude values 211A and the input image 210 is sufficiently small, the fourth processing block 259 may determine that the hologram 280A is a sufficiently-accurate representative of the input image 210. In some embodiments, the distribution of phase values 213A of the inverse Fourier transformed complex data set is ignored for the purpose of the comparison. It will be appreciated that any number of different methods for comparing the distribution of magnitude values 211A and the input image 210 may be employed and the present disclosure is not limited to any particular method. In some embodiments, a mean square difference is calculated and if the mean square difference is less than a threshold value, the hologram 280A is deemed acceptable. If the fourth processing block 259 determines that the hologram 280A is not acceptable, a further iteration of the algorithm may be performed. However, this comparison step is not essential and in other embodiments, the number of iterations of the algorithm performed is predetermined or preset or user-defined.
(37)
(38) The complex data set formed by the data forming step 202B of
(39)
R.sub.n+1[x, y]=F′{exp(iΨ.sub.n[u, v]}
Ψ.sub.n[u, v]=∠F{η.Math.exp(i∠R.sub.n[x, y])}
η=T[x, y]−α(|R.sub.n[x, y]|−T[x, y])
where: F′ is the inverse Fourier transform; F is the forward Fourier transform; R[x, y] is the complex data set output by the third processing block 256; T[x, y] is the input or target image; ∠ is the phase component; ψ is the phase-only hologram 280B; η is the new distribution of magnitude values 211B; and α is the gain factor.
(40) The gain factor a may be fixed or variable. In some embodiments, the gain factor α is determined based on the size and rate of the incoming target image data. In some embodiments, the gain factor α is dependent on the iteration number. In some embodiments, the gain factor α is solely function of the iteration number.
(41) The embodiment of
(42) In some embodiments, the Fourier transform is performed computationally by including lensing data in the holographic data. That is, the hologram includes data representative of a lens as well as data representing the object. In these embodiments, the physical Fourier transform lens 120 of
(43) In some embodiments, there is provided a real-time engine arranged to receive image data and calculate holograms in real-time using the algorithm. In some embodiments, the image data is a video comprising a sequence of image frames. In other embodiments, the holograms are pre-calculated, stored in computer memory and recalled as needed for display on a SLM. That is, in some embodiments, there is provided a repository of predetermined holograms.
(44) Embodiments relate to Fourier holography and Gerchberg-Saxton type algorithms by way of example only. The present disclosure is equally applicable to Fresnel holography and holograms calculated by other techniques such as those based on point cloud methods.
(45) Light Modulation
(46) A spatial light modulator may be used to display the computer-generated hologram. If the hologram is a phase-only hologram, a spatial light modulator which modulates phase is required. If the hologram is a fully-complex hologram, a spatial light modulator which modulates phase and amplitude may be used or a first spatial light modulator which modulates phase and a second spatial light modulator which modulates amplitude may be used.
(47) In some embodiments, the light-modulating elements (i.e. the pixels) of the spatial light modulator are cells containing liquid crystal. That is, in some embodiments, the spatial light modulator is a liquid crystal device in which the optically-active component is the liquid crystal. Each liquid crystal cell is configured to selectively-provide a plurality of light modulation levels. That is, each liquid crystal cell is configured at any one time to operate at one light modulation level selected from a plurality of possible light modulation levels. Each liquid crystal cell is dynamically-reconfigurable to a different light modulation level from the plurality of light modulation levels. In some embodiments, the spatial light modulator is a reflective liquid crystal on silicon (LCOS) spatial light modulator but the present disclosure is not restricted to this type of spatial light modulator.
(48) A LCOS device provides a dense array of light modulating elements, or pixels, within a small aperture (e.g. a few centimeters in width). The pixels are typically approximately 10 microns or less which results in a diffraction angle of a few degrees meaning that the optical system can be compact. It is easier to adequately illuminate the small aperture of a LCOS SLM than it is the larger aperture of other liquid crystal devices. An LCOS device is typically reflective which means that the circuitry which drives the pixels of a LCOS SLM can be buried under the reflective surface. The results in a higher aperture ratio. In other words, the pixels are closely packed meaning there is very little dead space between the pixels. This is advantageous because it reduces the optical noise in the replay field. A LCOS SLM uses a silicon backplane which has the advantage that the pixels are optically flat. This is particularly important for a phase modulating device.
(49) A suitable LCOS SLM is described below, by way of example only, with reference to
(50) Each of the square electrodes 301 defines, together with the overlying region of the transparent electrode 307 and the intervening liquid crystal material, a controllable phase-modulating element 308, often referred to as a pixel. The effective pixel area, or fill factor, is the percentage of the total pixel which is optically active, taking into account the space between pixels 301a. By control of the voltage applied to each electrode 301 with respect to the transparent electrode 307, the properties of the liquid crystal material of the respective phase modulating element may be varied, thereby to provide a variable delay to light incident thereon. The effect is to provide phase-only modulation to the wavefront, i.e. no amplitude effect occurs.
(51) The described LCOS SLM outputs spatially modulated light in reflection. Reflective LCOS SLMs have the advantage that the signal lines, gate lines and transistors are below the mirrored surface, which results in high fill factors (typically greater than 90%) and high resolutions. Another advantage of using a reflective LCOS spatial light modulator is that the liquid crystal layer can be half the thickness than would be necessary if a transmissive device were used. This greatly improves the switching speed of the liquid crystal (a key advantage for the projection of moving video images). However, the teachings of the present disclosure may equally be implemented using a transmissive LCOS SLM.
(52) Fourier Path Length
(53) The so-called “Fourier path length” is the optical path length from the Fourier transform lens to the corresponding holographic reconstruction. The size of the holographic reconstruction, I, is related to the Fourier path length as follows:
(54)
where f is the Fourier path length, λ is the wavelength of the light and p is the size of the pixel on the SLM.
(55) It may therefore be understood that for any given Fourier path length and spatial light modulator pixel size, differing hologram reconstruction sizes will result for different colours. For example: f=300 mm Red (λr)=640 nm Green (λg)=532 nm Blue (λb)=450 nm p[x,y]=8 um
(56) This gives rise to three different sized hologram reconstructions: Red=24.02 mm, Green=19.96 mm, and Blue=16.88 mm.
(57) In prior systems, since the Fourier path length is the same for all of the colour channels, the hologram reconstruction as shown in
(58) The largest full colour image (the area where the red, green and blue images overlap) is limited by the size of the blue hologram reconstruction. This presents a further problem: it is desirable to calculate hologram reconstructions using a single computation engine. Ideally the same resolution would be calculated for each image, meaning the calculated hologram reconstructions for the red, green and blue images would have the same number of pixels. However, if this were the case, the resolution of each colour of the full colour image would be different, meaning, in the area of overlap where the full-colour image is formed, the number of image pixels for each colour hologram reconstruction would be different. For example:
(59)
(60) It is undesirable for the individual wavelengths (colours) to have differing resolutions, in terms of number of pixels, within the full colour image area, as this leads to a degradation in image quality.
(61) A solution is to vary the resolution of the computed hologram to ensure all colours have the same resolution with the full colour area.
(62) In the present example, the resolution is determined as follows:
(63)
(64) However, computationally, this is undesirable because the blue channel is a power of 2 number (i.e. 2^10=1024) which is efficient to compute using an FFT. The Red and Green channels are no long power of 2 numbers and more importantly are significantly higher resolution. Given that the computation requirements of FFTs are logarithmic, any increase in resolution is undesirable.
(65) The inventors have recognised that it is advantageous to use different Fourier path lengths for each colour channel. The different Fourier path lengths are determined by the use of corresponding Fourier transform lenses. For each colour channel, a different optical path from the Fourier transform lens to the replay plane may be realised by means of at least one corresponding optical element (e.g. mirror) to achieve the relevant Fourier path length.
(66)
(67) In
(68) The second mirror 517 is a dichroic mirror which is substantially reflective to green light but substantially transmissive to blue light. The third mirror 527 is a dichroic mirror which is substantially reflective to red light but substantially transmissive to green and blue light. The person skilled in the art is familiar with the use of dichroic coatings on mirrors to provide the functionality described.
(69) In some embodiments, the device comprises two light channels and one dichroic mirror (or mirror with a dichroic coating). In other embodiments, the device comprises three light channels and two different dichroic mirrors (or mirrors with a dichroic coating). In some embodiments, the device comprises n light channels and (n-1) different dichroic mirrors (or mirrors with a dichroic coating). Again, the person skilled in the art will know how to provide the necessary dichroic mirror/s or different dichroic coatings on mirror/s to achieve the optical transmittance/reflectance described.
(70) The use of (n-1) dichroic mirrors—where n is the number of light channels—allows the different colour channels to be directed onto a common optical axis to the replay plane 550. In particular, the colour channels are collinear in the region from the final mirror to the replay plane 550. The described use of at least one dichroic mirror therefore provides substantially collinear optical paths. Referring back to
(71) The display device therefore comprises a collinear optical path for the plurality of colour channels, wherein the colour channels have different Fourier path lengths. This collinear optical path helps with optical alignment, stray light management and helps keep the device compact. Notably, the first mirror 507 of
(72) The inventors have recognised that by forming the full colour image in this manner, the number of pixels in the image for each colour is constant, thereby enabling a common computation engine to be used for all three colour channels. Conveniently, the optical configuration, shown in
(73) In embodiments, the wavelength-dependant path lengths may be determined as follows:
(74)
where f=Fourier path length, I=size of the holographic reconstruction, λ=wavelength of each colour channel and p=size of the pixel on the SLM.
(75) For example, the Fourier path length (Fourier lens focal length [FL]) may be determined for each wavelength as follows: I=30 mm Red (λr)=640 nm Green (λg)=532 nm Blue (λb)=450 nm p[x,y]=8 um
(76) This gives rise to three different sized hologram reconstructions: Red FL=374.7 mm Green FL=450.9 mm Blue FL=533.1 mm
(77) In embodiments, there is therefore provided a full colour virtual image where the size of each individual colour image is the same. That is, it may therefore be understood that, in embodiments, the first optical path length and second optical path length are such that the first holographic reconstruction and second holographic reconstruction are the same size. The inventors have recognised that, advantageously, the first optical path length and second optical path length may be such that the first holographic reconstruction and second holographic reconstruction have the same resolution. In embodiments, the problem of the mismatch in physical size and the mismatch in resolution are simultaneously addressed.
(78) It will be apparent that, in some embodiments, the first holographic reconstruction and second holographic reconstruction are coincident. Accordingly, a composite colour holographic reconstruction of a polychromic object may be provided. The first holographic reconstruction represents a first wavelength component of an object and the second holographic reconstruction represents a second wavelength component of the object. The present disclosure is not limited to Fourier holography but, in some embodiments, the first holographic data represents a first wavelength component of the object in the frequency domain and the second holographic data represents a second wavelength component of the object in the frequency domain.
(79) The skilled person will readily understand that Equation 2 may be equally applied to different colours/wavelengths to determine different Fourier path lengths in accordance with the present disclosure. In embodiments, the first wavelength is red light, the second wavelength is green light and the third wavelength is blue light. That is, the first wavelength is a wavelength or range of wavelengths in the region (or band) of the electromagnetic spectrum corresponding to red light. Likewise, the second and third wavelengths are respective wavelengths or ranges of wavelengths in the region (or band) of the electromagnetic spectrum corresponding to green and blue light, respectively.
(80) It may therefore be understood that, in embodiments, the first wavelength is greater than the second wavelength, which is greater than the third wavelength and the optical path length from the first Fourier transform lens to the replay plane is less than the optical path length from the second Fourier transform lens to the replay plane, which is less that the optical path length from the third Fourier transform lens to the replay plane.
(81) In embodiments, the focal length of the Fourier transform lens is inversely proportional to the wavelength of the corresponding light. The Fourier lens may be a phase-only lens as forming part of the respective holographic data (i.e. hologram). The Fourier lens may be a physical optic.
(82) A variation of
(83) In
(84) In
(85) The Fourier transform lenses 820b, 820g, 820r receive spatially modulated blue, green and red light from the respective first, second and third SLMs 801b, 801g, 801r, for output along respective first, second and third optical/Fourier paths 809b, 809g and 809r to the replay field/replay plane 850. First, second and third mirrors 807b, 817g and 827r are disposed on the optical paths of the output blue, green and red light to provide different Fourier path lengths. As in
(86) In particular, the spatially modulated blue, green and red light is output along respective first parts of the first, second and third optical paths 809b, 809g and 809r, and is reflected by the first, second and third mirrors 807b, 817g and 827r, respectively. As shown in
(87) The first mirror 807b is located furthest away from the replay field/replay plane 850. The first mirror 807b receives the output blue light from the first part of the first optical path 809b, and reflects the blue light along a second part 811 of first optical path 809b towards the replay field/replay plane 850. In the embodiment of
(88) In
(89) In
(90) As shown in
(91) An embodiment is shown in
(92) The embodiment of
(93) A Fourier transform lens (not shown in
(94) SLM 601 outputs spatially modulated blue, green and red light along respective first, second and third optical paths 609b, 609g and 609r to the replay field/replay plane 650. In
(95) Optical elements comprising first, second and third mirrors 607b, 617g and 627r are disposed on the respective optical paths of the output blue, green and red spatially modulated light from the SLM 601 to provide different optical path lengths between SLM 601 and the replay field/replay plane 650. In particular, the spatially modulated blue, green and red light is output along a common optical path 609 and the colour components are individually reflected by the first, second and third mirrors 607b, 617g and 627r, respectively. The first, second and third mirrors 607b, 617g and 627r are aligned with the common optical path 609. Thus, each of the first, second and third optical paths 609b, 609g and 609r to the replay field/replay plane 650 has a first part, from SLM 601 to the respective first, second and third mirror 607b, 617g and 627r, that is collinear with the common optical path 609.
(96) In particular, the first mirror 607b is located furthest away from SLM 601 and the replay field/replay plane 650. The first mirror 607b receives the spatially modulated blue light from a first part of the first optical path 609b, and reflects the blue light along a second part of first optical path 609b towards the replay field/replay plane 650. In the embodiment of
(97) In
(98) In the embodiment of
(99) In contrast to the embodiments of
(100) In
(101) As shown in
(102) In
(103) This collinear first part of the optical paths helps with optical alignment, stray light management and helps keep the device compact. Notably, the first mirror 607b of
(104) Accordingly, a method of adjusting the display system of
(105) In embodiments, the method may also comprise adjusting an orientation of one or more of the first, second and third mirrors 607b, 617g and 627r. This further enables fine adjustment of the position of the relevant holographic reconstruction at the replay plane 650.
(106)
(107)
(108)
(109) As will be appreciated from the above description, in the configuration shown in
(110) Additional Features
(111) The disclosed embodiments refer to an electrically-activated LCOS spatial light modulator by way of example only. The teachings of the present disclosure may equally be implemented on any spatial light modulator capable of displaying a computer-generated hologram in accordance with the present disclosure such as any electrically-activated SLMs, optically-activated SLM, digital micromirror device or microelectromechanical device, for example.
(112) The colour display system of the present disclosure may be used to provide an improved head-up display (HUD) or head-mounted display. In some embodiments, there is provided a vehicle comprising the colour display system installed in the vehicle to provide a HUD. The vehicle may be an automotive vehicle such as a car, truck, van, lorry, motorcycle, train, airplane, boat, or ship.
(113) In some embodiments, the size (number of pixels in each direction) of the hologram is equal to the size of the spatial light modulator so that the hologram fills the spatial light modulator. That is, the hologram uses all the pixels of the spatial light modulator. In other embodiments, the size of the hologram is less than the size of the spatial light modulator. In some of these other embodiments, part of the hologram (that is, a continuous subset of the pixels of the hologram) is repeated in the unused pixels. This technique may be referred to as “tiling” wherein the surface area of the spatial light modulator is divided up into a number of “tiles”, each of which represents at least a subset of the hologram. Each tile is therefore of a smaller size than the spatial light modulator.
(114) The size of the holographic replay field (i.e. the physical or spatial extent of the holographic reconstruction) is determined by the pixel spacing of the spatial light modulator (i.e. the distance between adjacent light-modulating elements, or pixels, of the spatial light modulator). The smallest feature which may be formed in the replay field may be called a “resolution element”, “image spot” or an “image pixel”. Typically, each pixel of the spatial light modulator has a quadrangular shape. The Fourier transform of a quadrangular aperture is a sinc function and therefore each image pixel is a sinc function. More specifically, the spatial intensity distribution of each image pixel on the replay field is a sinc function. Each sinc function may be considered as comprising a peak-intensity primary diffractive order and a series of decreasing-intensity higher diffractive orders extending radially away from the primary order. The size of each sinc function (i.e the physical or spatial extent of each sinc function) is determined by the size of the spatial light modulator (i.e. the physical or spatial extent of the aperture formed by the array of light-modulating elements or spatial light modulator pixels). Specifically, the larger the aperture formed by the array of light-modulating pixels, the smaller the image pixels. It is usually desirable to have small image pixels.
(115) In some embodiments, the technique of “tiling” is implemented to increase image quality. Specifically, some embodiments implement the technique of tiling to minimise the size of the image pixels whilst maximising the amount of signal content going into the holographic reconstruction.
(116) In some embodiments, the holographic pattern written to the spatial light modulator comprises at least one whole tile (that is, the complete hologram) and at least one fraction of a tile (that is, a continuous subset of pixels of the hologram).
(117) The holographic reconstruction is created within the zeroth diffraction order of the overall window defined by the spatial light modulator. It is preferred that the first and subsequent orders are displaced far enough so as not to overlap with the image and so that they may be blocked using a spatial filter.
(118) In embodiments, such as
(119) In other embodiments, such as
(120) In further advantageous embodiments, one of the first and second Fourier transform lenses is a physical optic and the other of the first and second Fourier transform lenses is lensing data of the second holographic data.
(121) In embodiments, a zero-order removal element is provided for one or more of the colour channels. The zero-order removal element may be considered a spatial filter. Advantageously, removal of the zero-order light increases the signal-to-noise ratio of the holographic reconstruction. In embodiments, the system therefore further comprising a first spatial filter on the optical path from the first Fourier transform lens to the replay plane arranged to prevent zero-order diffracted light of the first wavelength reaching the replay plane and/or a second spatial filter on the optical path from the second Fourier transform lens to the replay plane arranged to prevent zero-order diffracted light of the second wavelength reaching the replay plane.
(122) In embodiments, the first and/or second spatial filter is/are incorporated on the or a respective dichroic mirror and comprises a first portion arranged to provide (or direct) the zero-order diffracted light on a first optical path and a second portion arranged to provide (or direct) the higher-order diffracted light on a second optical path. In embodiments, the first portion is an aperture and the second portion is a reflection (or reflective) portion.
(123) In embodiments, the display system further comprises a first light source arranged to illuminate the first plurality of pixels with light of the first wavelength and a second light source arranged to illuminate the second plurality of pixels with light of the second wavelength. In embodiments, the light sources are substantially monochromatic. In embodiments, the light sources are (spatially) coherent light sources such as lasers. In other embodiments, the display system may not include a light source, but, instead, may be operated using one or more external light sources.
(124) It may be understood that the present teachings may be extended to more than two colour channels. In embodiments, red, green and blue colour channels are provided to produce a colour holographic reconstruction, further colour channels may be added for example red, green, yellow and blue.
(125) In embodiments, the display system therefore further comprises a third plurality of pixels arranged to display a third hologram. The third plurality of pixels is arranged to receive light of a third wavelength and output light of the third wavelength, spatially-modulated according to the third hologram, along a third optical path. The third optical path has a third Fourier transform lens for forming a third holographic reconstruction, corresponding to the third hologram, at the replay plane. A third optical element is provided on the third optical path between the third Fourier transform lens and the replay plane. The third optical element is arranged to receive the output/spatially modulated light of the third wavelength from a first part of the third optical path and direct the light of the third wavelength along a second part of the third optical path to the replay plane. The first part of the third optical path is substantially collinear with the first part of the first optical path and the first part of the second optical path. The length of the third optical path between the third Fourier transform lens and the replay plane is not equal to the length of the first optical path between the first Fourier transform lens and the replay plane or second optical path between the second Fourier transform lens and the replay plane
(126) In embodiments, the first holographic reconstruction, second holographic reconstruction and third holographic reconstruction are coincident. Accordingly, a high-quality colour holographic reconstruction is achieved.
(127) It may therefore be understood that in embodiments comprising three colour channels, the first optical path length, second optical path length and third optical path length are such that the first holographic reconstruction, second holographic reconstruction and third holographic reconstruction are the same size and have the same resolution.. In embodiments, the first wavelength corresponds to blue light, the second wavelength corresponds to green light and the third wavelength corresponds to red light.
(128) In the disclosed embodiments, each colour channel includes a mirror, to redirect light on the first part of the corresponding optical path to the second part of the optical path, for spatial displacement of the optical paths for the different colour channels. It may be understood that other types of optical element may be used to redirect light for each colour channel, such as prisms.
(129) In embodiments, each holographic reconstruction is one frame of a sequence of 2D video frames. In embodiments, the replay plane is spatially remote from a viewer. That is, the replay field is presented as a virtual image
(130) Examples describe illuminating the SLM with visible light but the skilled person will understand that the light sources and SLM may equally be used to direct infrared or ultraviolet light, for example, as disclosed herein. For example, the skilled person will be aware of techniques for converting infrared and ultraviolet light into visible light for the purpose of providing the information to a user. For example, the present disclosure extends to using phosphors and/or quantum dot technology for this purpose.
(131) Some embodiments describe 2D holographic reconstructions by way of example only. In other embodiments, the holographic reconstruction is a 3D holographic reconstruction. That is, in some embodiments, each computer-generated hologram forms a 3D holographic reconstruction.
(132) The methods and processes described herein may be embodied on a computer-readable medium. The term “computer-readable medium” includes a medium arranged to store data temporarily or permanently such as random-access memory (RAM), read-only memory (ROM), buffer memory, flash memory, and cache memory. The term “computer-readable medium” shall also be taken to include any medium, or combination of multiple media, that is capable of storing instructions for execution by a machine such that the instructions, when executed by one or more processors, cause the machine to perform any one or more of the methodologies described herein, in whole or in part.
(133) The term “computer-readable medium” also encompasses cloud-based storage systems. The term “computer-readable medium” includes, but is not limited to, one or more tangible and non-transitory data repositories (e.g., data volumes) in the example form of a solid-state memory chip, an optical disc, a magnetic disc, or any suitable combination thereof. In some example embodiments, the instructions for execution may be communicated by a carrier medium. Examples of such a carrier medium include a transient medium (e.g., a propagating signal that communicates instructions).
(134) The described display system comprises a colour display system with three primary colour channels, that displays a composite polychromatic image by overlapping corresponding monochromatic holographic reconstructions for each colour channel. The present disclosure is equally applicable to a colour display system with just two colour channels, or more than three colour channels. Furthermore, the present disclosure is also applicable to a display system with two or more colour channels, that displays corresponding monochromatic images in different non-overlapping parts of the replay plane.
(135) It will be apparent to those skilled in the art that various modifications and variations can be made without departing from the scope of the appended claims. The present disclosure covers all modifications and variations within the scope of the appended claims and their equivalents.