Method for integrating a synthetic hologram in a halftone image
09606507 ยท 2017-03-28
Assignee
Inventors
Cpc classification
G03H2001/0858
PHYSICS
G03H1/0841
PHYSICS
International classification
G03H1/08
PHYSICS
Abstract
A method for integrating a synthetic hologram in an image of a scene, including: forming, from a first image of the scene, a first matrix including pixels of two shades according to the gray level of the corresponding pixel of the first image, and a second matrix, image of the gray level difference between the corresponding pixels of the first image and of the first matrix; forming a third matrix based on a second image; forming a fourth matrix having each pixel including a central area with a surface area determined by the corresponding element of the second matrix and off-centered in the pixel according to the corresponding pixel of the third matrix; and performing a lithography of an opaque layer at the surface of a plate according to the pattern defined by the fourth pixel matrix.
Claims
1. A method for integrating a synthetic hologram in a directly observable image of a scene, comprising the steps of: defining a first source image of said scene, comprising grayscale pixels; forming first and second pixel matrixes from the first source image, the first matrix comprising pixels of a first and of a second shade according to whether a corresponding pixel of the first source image has a gray level greater than or smaller than a gray level threshold, each element of the second matrix comprising a value equal to a gray level difference between the corresponding pixel of the first source image and a corresponding pixel of the first matrix; forming a third pixel matrix by calculating a phase image of a synthetic hologram obtained by a Fourier transform of an image originating from a second source image of the hologram; forming a fourth pixel matrix, each pixel of the fourth matrix comprising an area internal to the pixel having its surface area determined based on a value of a corresponding pixel of the second matrix and off-centered in the pixel according to a value of a corresponding pixel of the third matrix; and performing a lithography of an opaque layer at the surface of a wafer according to a pattern defined by the fourth pixel matrix, the pattern comprising the value of the corresponding pixel of the second matrix and the value of the corresponding pixel of the third matrix, the lithography being provided to remove, from a pixel, the opaque layer inside of the internal area if the equivalent pixel of the first matrix is of the first shade and to remove the opaque layer outside of the central internal area if the equivalent pixel of the first matrix is of the second shade.
2. The method of claim 1, wherein the size of the internal area of each of the pixels of the fourth matrix is calculated from a value of a corresponding pixel of a fifth pixel matrix, each pixel of the fifth matrix being obtained by calculation of a diffracted amplitude of a wave through an aperture defined in the pixel, a ratio of the aperture surface area to the pixel surface area being equal to a value of a corresponding element of the second matrix.
3. The method of claim 2, wherein an amplitude A.sup.h.sub.nm, of a pixel of the fifth matrix depends on an intensity I.sub.nm of a corresponding element of the second matrix according to the following relation:
4. The method of claim 2, wherein the third matrix is obtained by carrying out the steps of: (a) calculating a sixth amplitude matrix obtained from the second source image of the hologram by carrying out the same steps as those enabling to obtain the fifth matrix from the second matrix; (b) combining the pixels of the sixth amplitude matrix with a random phase distribution or with a continuous phase component to obtain a complex value; and (c) calculating the phase image of the Fourier transform of said complex value.
5. The method of claim 2, wherein the third matrix is obtained by an optimization method taking advantage of the fifth matrix.
6. The method of claim 5, wherein the optimization method comprises: (a) calculating a sixth amplitude matrix obtained from the second source image of the hologram by carrying out the same steps as those enabling to obtain the fifth matrix from the second matrix; (b) combining the pixels of the sixth amplitude matrix with a random phase distribution or with a continuous phase component to obtain a first complex value; (c) calculating the Fourier transform of the first complex value; (d) combining the pixels of the sixth pixel matrix with the pixels of the phase image resulting from the Fourier transform of step (c) to obtain a second complex value; (e) calculating the inverse Fourier transform of the second complex value; (f) combining the pixels of the sixth amplitude matrix with the pixels of the phase image resulting from the calculation of step (e) to obtain a new first complex value; (g) repeating step (c) to calculate the Fourier transform of the new first complex value, the third matrix corresponding to the phase image obtained from this last Fourier transform.
7. The method of claim 6, wherein the optimization method further comprises the repeating of steps (d) to (g), the third matrix corresponding to the phase image obtained at step (g) after several cycles of repeating of steps (d) to (g).
8. The method of claim 7, wherein at least three cycles are carried out.
9. The method of claim 1, wherein the off-centering of the internal area of each pixel of the fourth matrix is directly proportional to the value of the corresponding pixel of the third matrix.
10. The method of claim 1, wherein the gray level threshold is equal to 0.5, to within 10%, on a normalized grayscale.
11. The method of claim 1, wherein the internal area of each pixel of the fourth matrix is elliptic.
12. The method of claim 11, wherein the aspect ratio of the elliptic internal area of each pixel of the fourth matrix is equal to /2.
13. The method of claim 1, wherein the first shade of the first matrix is a minimum shade, the second shade of the first matrix is a maximum shade, the lithography being provided to remove the opaque layer inside of the internal area of a pixel if the equivalent pixel of the first matrix has the first shade and to remove the opaque layer outside of the internal area of a pixel if the equivalent pixel of the first matrix has the second shade.
14. The method of claim 1, wherein a minimum size of the internal area of each pixel of the fourth matrix is imposed.
15. The method of claim 14, wherein the minimum size of the internal area of the pixels of the fourth matrix corresponds to a gray level of 0.02 for dark pixel shades and of 0.98 for light pixel shades, on a normalized grayscale.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18) For clarity, the same elements have been designated with the same reference numerals in the different drawings.
DETAILED DESCRIPTION
(19)
(20) These three drawings show, in three dimensions, a portion of a transparent wafer 50 having its surface defining a pixel of a synthetic coded-aperture hologram. The shown pixel has a width a.
(21) In the example of
(22) In the example shown in
(23) The elliptic shape provided herein has the advantage of being relatively smooth for the eye when used to form pixels of an image obtained by half toning of a grayscale image. In particular, this shape is much more pleasant to the eye than the rectangular shapes of
(24)
(25) The pixel of
(26) According to Babinet's principle of complementary screens, the pixel of
(27)
(28) Initial steps 60 and 62 of the method comprise selecting, on the one hand, a real grayscale image of a scene, IMAGE_G, which is desired to be seen with the naked eye once the hologram has been integrated in the image, and on the order hand, a source image of the hologram, IMAGE_H, which is desired to be integrated in the form of a synthetic coded-aperture hologram in a final visible image (IMAGE_F).
(29) Based on grayscale image 60 (IMAGE_G), a first black-and-white image matrix (IMAGE_G.sub.B&W) 64 is determined, this image comprising pixels of a first shade, for example, black, at the level of the pixels of image 60 having a gray level smaller than a threshold (dark pixels) and pixels of a second shade, for example, white, for the pixels of image 60 having a gray level higher than threshold (light pixels). It should be noted that the reverse is also possible, the idea being to distinguish the pixels of image 60 having a gray level lower or higher than threshold .
(30) Starting from image 60, processing and calculation means are used to determine a matrix IMAGE_G, 66, having a size identical to the resolution of image 60, IMAGE_G, where each element of the matrix contains a value proportional to the difference between the gray level of the corresponding pixel of image 60 and the gray level of the corresponding pixel of image 64 (IMAGE_G.sub.B&W). The link between images 60 and 64 and matrix 66 will be described in further detail hereafter in relation with
(31) In practice, the detection threshold of matrix 66 is the same threshold as detection threshold of image 64. It is preferably selected at a midscale gray level of image 60, for example, at 0.5 to within 10%, and is preferably equal to 0.5, on a normalized grayscale.
(32) A next step 68 comprises obtaining, from matrix 66 (IMAGE_G), an image matrix IMAGE_G.sub.A 68 of the amplitude of the holographic raster. The determination of the pixels of image 68 will be described in further detail hereinafter, in relation with
(33) In parallel, a step 70 comprises calculating the Fourier transform of an image originating from the source image of the hologram, 62 (IMAGE_H). More specifically, the Fourier transform of an amplitude image, IMAGE_H.sub.A, obtained from source image IMAGE_H, is calculated in a way similar to that in which image 68, IMAGE_G.sub.A, has been calculated from image 66, IMAGE_G, as will be described in further detail hereinafter. The Fourier transform calculated at step 70 provides an amplitude image A.sub.H and a phase image 72 (.sub.H). Amplitude image A.sub.H is not used.
(34) To improve the quality of the hologram, a random phase distribution may be added to amplitude image IMAGE_H.sub.A before the Fourier transform calculation. This phase scrambling method is known by those skilled in the art.
(35) A step 74, implemented by calculation and processing means, comprises combining phase image .sub.H resulting from Fourier transform 70, black-and-white image 64 (IMAGE_G.sub.B&W) and amplitude image 68 (IMAGE_G.sub.A) to obtain a final image 76 (IMAGE_F) having an appearance identical to the appearance of image 60 (IMAGE_G) and which integrates a hologram obtained from the source image of hologram 62 (IMAGE_H).
(36) To achieve this, each pixel of final image 76 comprises a central area surrounded with a background, defined as follows: if the pixel of same coordinates in image 64 (IMAGE_G.sub.B&W) has a first shade, for example, black, the central area is transparent and the background is opaque, and if the pixel of same coordinates of image 64 (IMAGE_G.sub.B&W) has a second shade, for example, white, the central area is opaque and the background is transparent; the size of the central area in each pixel is calculated from the gray level of the pixel of same coordinates of image 68 (IMAGE_G.sub.A); if the pixel of same coordinates of phase image .sub.H of the Fourier transform of image 62 is dark (phase values tending towards ), the central area in the pixel of same coordinates of final image 76 is strongly off-centered towards one side of the pixel, if the pixel of same coordinates of the phase image of Fourier transform 72 .sub.H of image 62 is light (phase tending towards +), the central area is off-centered in the pixel of same coordinates of image 76 towards an opposite side of the pixel, and if the pixel of same coordinates of phase image 72 has a medium shade, the central area of the pixel of same coordinates of final image 76 is centered in the pixel (the off-centering of the central area in the pixel is proportional to the value of the equivalent pixel of image .sub.H).
(37) Once final image IMAGE_F has been obtained, a lithography of an opaque layer defined at the surface of a plate according to the pattern of this image is performed.
(38)
(39)
(40) In this curve, it can be seen that for a pixel of image IMAGE_G having a gray level G ranging between 0 and 0.5 (black pixel to medium-grey pixel), the value of G of an element of matrix 66 increases up to a value .
(41) If gray level G of a pixel of the grayscale image, IMAGE_G, ranges between 0.5 and 1 (medium-gray pixel to white pixel), the value of the equivalent element of matrix IMAGE_G decreases between threshold and a zero value when the pixel is very light.
(42) To provide an optimal coding of the holograms, a minimum threshold of the value of the elements of matrix IMAGE_G may be provided for totally black or totally white pixels of image IMAGE_G 60 (respectively G=0 or G=1). This enables to optimize the appearance of the final reading of the hologram, as will be seen hereafter. The minimum threshold will typically be 2% of the maximum or minimum gray levels (the minimum size of the central area of the pixels corresponding to a gray level of 0.02 for dark pixel shades and of 0.98 for light pixel shades, on a normalized grayscale).
(43) Matrix 66 (IMAGE_G) is used to obtain an amplitude image IMAGE_G.sub.A (68) of the wave associated with the hologram, which is used to determine the size of the central areas of the pixels of the final image (IMAGE_F).
(44) It should be noted that, with an elliptic shape of the central area, the ellipse shape may be optimized so that the ellipse has a maximum size, in direction y, equal to the pixel side with a pixel filling rate equal to 50%. Simple geometric calculations provide the fact that an ellipse having a ratio of its large side to its small side equal to /2 enables to obtain a pixel filling rate equal to 50% for one dimension of the ellipse, along direction y, equal to the pixel width. This ratio further provides a very smooth visual appearance.
(45) The obtaining of amplitude image 68 requires considering the equations of diffraction of a planar wave through an aperture.
(46)
(47) When a planar wave is incident on the aperture of
(48)
(49) J.sub.1 being the first Bessel function. It should be noted that for an optimal coding of the phase, an elliptic shape of the aperture such that wy>wx is considered.
(50) In a grayscale image, the surface of the dark central portion of a pixel normalized with respect to the pixel surface sets the hue perceived by the observer. Hue I.sub.nm depends on the pixel shape by relation:
(51)
(52) To obtain the amplitude image of initial image 60 (IMAGE_G), equation (1) is directly applied to apertures having their surface area defined so that ratio I.sub.nm of the aperture surface area to the pixel surface area corresponds to the value of the corresponding element of matrix 66 (IMAGE_G). To provide a good definition of amplitude image IMAGE_G.sub.A 68, threshold may be set to 0.5 (the surface area of the aperture corresponding to half the pixel surface area). A relation enabling to calculate the dimensions of the central areas of the pixels of image IMAGE_F is thus obtained.
(53) In practice, an aspect ratio of the aperture =wy/wx is defined and wy is limited to a maximum value equal to 1 (normalized pixel side). The two above equations provide a relation between the value of the corresponding element I.sub.nm of matrix IMAGE_G and the amplitude of the wave diffracted by this pixel (A.sup.h.sub.nm), according to , which is as follows:
(54)
(55) The above equation thus enables to link the elements of matrix IMAGE_G, and thus the gray level of the corresponding pixel of initial image IMAGE_G, to the amplitude of the pixel of same coordinates of image IMAGE_G.sub.A, that is, to the size of the central area of the pixels of final image IMAGE_F.
(56)
(57) Beyond this value, the pattern goes over the cell limits and the quality of the phase coding decreases. In the case of the above method, intensity I.sub.nm is limited to threshold predefined by the curve of
(58)
(59) It should be noted that, to simplify the programming of this transfer function, the Bessel function may be replaced with its series expansion with a good accuracy, which provides the following equation:
(60)
(61) Thus, the pixels of the final image obtained by the method of
(62) The method of
(63) It should be noted that amplitude image IMAGE_H.sub.A having its Fourier transform calculated at step 70 of
(64)
(65) The method for optimizing the phase image imposed to the final image provided herein is an iterative optimization method described in Gerchberg and Saxton's publication entitled A pratical algorithm for the determination of the phase from image and diffraction plane pictures, Optik, Vol. 35, 237-246.
(66) Starting from the source image of the hologram, IMAGE_H (62), the amplitude image of this image, IMAGE_H.sub.A (80), is determined in a way similar to that in which the amplitude of holographic raster IMAGE_G.sub.A resulting from matrix IMAGE_G (66) has been determined.
(67) At a next step 82, amplitude image IMAGE_H.sub.A 80 is combined with an initialization phase component .sub.I 83 resulting either from a random phase distribution of phase scrambling type, or from a continuous phase component, to obtain a complex value (process initialization). The Fourier transform of the complex image obtained at step 82 is then calculated at a step 84.
(68) Amplitude image A obtained by the Fourier transform of step 84 is left aside (just as amplitude image A.sub.H in
(69) At a step 88, the inverse Fourier transform of the complex value obtained at step 86 is calculated. Amplitude image A of the obtained result is left aside. Phase image obtained by this inverse Fourier transform is introduced at the input of step 82 instead of the initialization phase distribution of process .sub.I, in combination with amplitude image IMAGE_H.sub.A. Step 84 of calculation of the Fourier transform of the complex value obtained at step 82 is repeated to obtain an optimized phase image .sub.H (step 90), due to the taking into account of image 68, IMAGE_G.sub.A. Cycle of steps 82 to 88 may be repeated several times to optimize the phase image .sub.H obtained at step 90.
(70) The phase image obtained at step 90 may be used directly in the method of
(71) Carrying out the above cycle of improvement of phase image .sub.H enables to improve the reading of the hologram integrated in the halftone image. It should be noted that the above cycle may be repeated as often as necessary so that the final phase image .sub.H of step 90 comprises an efficient corrective of the loss of information due to the lack of use of the amplitude image of the Fourier transform of the source image of the hologram.
(72) After a number of iterations, which number may vary as will be seen hereafter, an optimized phase image .sub.H which is used in the method of
(73)
(74) More specifically,
(75) In these drawings, it should be noted that the performing of the optimization method of
(76) Indeed, the reading performed from an image obtained by the method of
(77) In the context of the above method, the quality of the grayscale image visualization is a desired advantage.
(78)
(79) To simulate this blurred effect, it has been tried to artificially blur the image with a Gaussian blurring of a width of 2 and of 4 pixels.
(80) As previously discussed, the position of the halftone patterns is defined by the value of the phase assigned to the pixel. If two successive pixels have significantly different phase values, the distance between patterns will also be significant. According to whether the halftone background is light or dark, this difference will translate as the appearing of a white or black dot.
(81)
(82) This phenomenon is disturbing if the detection of the reconstructed image must be strictly identical to the original. Such is generally the case in data preservation.
(83) This effect can however be decreased. To achieve this, the following methods can be mentioned: after simulation of the write and detection effect, the source image is modified to anticipate the opacifying and the lightening of certain pixels; a modification of the amplitude is directly introduced into the phase calculation loop to take into account the present of phase shifts; source image IMAGE_G is oversampled to increase the blurring with no image resolution loss.
(84) The result of this last proposition is illustrated in
(85)
(86) Many applications of the above method can be envisaged.
(87) A first application relates to the analog storing of images. The provided solution allows a perennial preservation of graphic data due to a visual saving mode. The data recovery is performed with no digital decoding and does not risk the obsolescence of the read format.
(88) This solution has the disadvantage of having a relatively long data recovery mode; a solution would thus be to keep the durability of the analog storage while using the rapidity of digital data recovery.
(89) Take the example of an image of 1,0001,000 pixels, coded over 256 gray levels (1 byte). Its digital weight, at the uncompressed bitmap format, is approximately 10.sup.3 ko.
(90) The idea is to code a digital version of the source image of the hologram IMAGE_H. To make the detection easier, a binary representation of the source image of the hologram IMAGE_H is selected, assuming that only 50% of the hologram surface area is exploitable. This restriction is due to the difficulty of obtaining non-noisy images in coherent optics. This results in a bit storage capacity corresponding to 50% of the number of pixels. A digital capacity of approximately 62 ko is obtained. This decrease of the file size may be obtained by storing a compressed image of original image IMAGE_G, for example in jpeg format.
(91) The user can thus have the choice between a fast digital detection of digital images in a compressed format and a slow analog detection of source files in the native format.
(92) It should be noted that the detection of the image in compressed format may also be used to improve the quality of the reconstructed source image, by especially helping to correct the granularity effect.
(93)
(94) In the same field of application, a variation may also be provided to increase the surface area capacity of the analog storage medium.
(95) In addition to the analog data, the storage medium must be able to preserve the metadata associated with visual documents. Such data are contained in the digital file background and may concern all forms of information (file name, creation date, file format, comments, etc.). Such information may be visualized in binary format (character sequence) and may accept some quality loss (form is second to content). This type of data thus effectively applies to synthetic holography storage.
(96)
(97) Redigitizing the analog data being a long process, the halftone representation of image IMAGE_G must be imaged on an array sensor to restore the original grayscale pixel matrix. This process is carried out by a succession of image shots which then have to be put together. If the image has few details, the putting together may be complicated.
(98) A solution may be to arrange alignment holograms within the image, as shown in
(99) Halftone representation 104 exhibits a series of holograms 106. Each hologram 106 forms in the focal plane of a Fourier lens 108 a light spot 110 at a specific coordinate. If the probe beam is at the exact crossing of four holograms, four different light spots 110 are detected in the read plane. The positioning on the optical axis of the plate having the holograms formed thereon can thus be controlled by the detection of these light spots. The system can scan the image by positioning itself at specific locations, for which the intensity of the four spots is balanced, independently from the visual content of the image.
(100) Another application of the method provided herein, which is no longer within the context of analog storage, is the security of ID documents, and more generally of any type of documents. It can be envisaged to code in the ID photograph a hologram enabling to guarantee that the document is authentic.
(101) Specific embodiments of the present invention have been described. Various alterations, modifications, and improvements will readily occur to those skilled in the art. In particular, other applications of the integration of a coded-aperture hologram in a halftone image having a grayscale appearance may be provided. Further, it should be noted that known hologram scrambling methods, implying the impossibility of a direct reading of the hologram, may be provided in combination with the method described herein. In this case, the use of a phase key or of a read mask may be provided on reading of the hologram, for example, with a read device such as that in
(102) Various embodiments with different variations have been described hereabove. It should be noted that those skilled in the art may combine various elements of these various embodiments and variations without showing any inventive step.
(103) Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and the scope of the present invention. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The present invention is limited only as defined in the following claims and the equivalents thereto.