Multiple wavelengths real time phase shift interference microscopy
09880377 ยท 2018-01-30
Assignee
Inventors
- Avner Safrani (D.N. Misgav, IL)
- Michael Ney (Be'er Sheva, IL)
- Ibrahim ABDULHALIM (Wahat-Alsalam-Neve Shalom, IL)
Cpc classification
G02B21/365
PHYSICS
G02B21/0032
PHYSICS
G02B21/0084
PHYSICS
G02B21/367
PHYSICS
G02B21/0056
PHYSICS
G02B27/286
PHYSICS
G02B21/0064
PHYSICS
International classification
G02B21/36
PHYSICS
Abstract
A system microscopy system and method that enable obtaining high resolution 3D images in a single shot are presented. The system is an ultra-high speed, real time multi wavelength phase shift interference microscopy system that uses three synchronized color CCD cameras. Each CCD is equipped with a precision achromatic phase mask which in turn allows obtaining /2 phase shifted signals in three different wavelengths simultaneously.
Claims
1. An interference microscopy 3D imaging system comprising: a) an illumination unit, which provides light comprised of least two wavelengths to the system; b) a two beam orthogonally polarized interferometer, which is illuminated by light from the illumination unit; c) a detection unit comprising: i) a tube lens; ii) a first 50/50 non-polarizing beam splitter, a second 50/50 non-polarizing beam splitter and a third 50/50 non-polarizing beam splitter by which the interferometer output beam is split and manipulated in space; iii) three parallel detectors, and with a color filter on each pixel used to detect the interference images at three different wavelengths; and iv) one of the following groups of components: A) group 1: i) a compensating wave plate with zero retardation aligned with its optic axis parallel to the S and P waves emerging from the interferometer; ii) a precision achromatic quarter wave plate aligned with its optic axis parallel to the S and P waves emerging from the interferometer; iii) a precision achromatic half wave plate aligned with its optic axis parallel to the S and P waves emerging from the interferometer; iv) three analyzers positioned after the wave plates at 45 with respect to the S and P waves; B) group 2: i) a precision achromatic quarter wave plate aligned with its optic axes at 45 with respect to the S and P waves emerging from the interferometer; ii) three analyzers positioned at 0, 45, and 90 with respect to the S and P waves emerging from the interferometer; and d) a process and control unit that is connected to and controls the three detectors, the process and control unit comprising software algorithms adapted to carry out a calibration procedure from known phase shifts, which is used to determine the deviations from ideality of the optical phase components and to extract correct interferometric signals and correct object heights.
2. The interference microscopy 3D imaging system of claim 1, wherein the system comprises two beam splitters, two wave plates, two analyzers, and two parallel detectors after the tube lens.
3. The interference microscopy 3D imaging system of claim 1, wherein the three parallel detectors comprise monochrome pixels.
4. The interference microscopy 3D imaging system of claim 1, wherein the illumination unit comprises at least one of the following elements: a tunable light source, a non-tunable light source, a diffuser, a collecting lens, an aperture stop, a condensing lens, a field stop, a projecting lens and a polarizer.
5. The interference microscopy 3D imaging system of claim 4, wherein the light source is a three wavelength LED array.
6. The interference microscopy 3D imaging system of claim 4, wherein the light source is a wideband source.
7. The interference microscopy 3D imaging system of claim 4, wherein the light source is a laser fiber which has three different laser wavelengths coupled into the fiber or three fiber lasers of three different wavelengths with output beams that have been united in space using some optical components such as beam splitters, polarized beam splitters or dichroic mirrors.
8. The interference microscopy 3D imaging system of claim 7, wherein the laser is configured to allow wavelength sweeping.
9. The interference microscopy 3D imaging system of claim 1, wherein the two beam orthogonally polarized interferometer has the configuration of one of the following interferometer types: Linnik, Michelson, Twyman-Green, Fizau, Nomarski, Mach-Zehnder and Mirau.
10. The interference microscopy 3D imaging system of claim 1, wherein the sample is mounted on a motorized stage.
11. The interference microscopy 3D imaging system of claim 10, wherein the motorized stage is connected to and controlled by a processing device and is driven by at least one of: a stepper motor, a servo and a piezoelectric transducer.
12. The interference microscopy 3D imaging system of claim 1, wherein the parallel detectors and the motorized stage are connected to a processing device and are controlled by the processing device.
13. The interferometric system of claim 1 wherein collimated beams are used without microscope objectives and tube lens with the three parallel detectors and the three detectors comprise either single pixels for each wavelength wherein dichroic mirrors are used to split the spectral beams and direct them to the three single pixel detectors or three colored pixels combined in one detector; thereby allowing a fast interference signal to be grabbed and processed for fast displacement or vibrations measurement.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION
(6) The invention is a system and method that enable obtaining high resolution 3D images in a single shot.
(7) The system is an ultra-high speed, real time multi wavelength phase shift interference microscopy system that uses three synchronized color CCD cameras. Each CCD is equipped with a precision achromatic phase mask which in turn allows obtaining /2 phase shifted signals in three different wavelengths simultaneously. The combination of simultaneous phase shifts at different wavelengths allows overcoming all the above mentioned problems of the prior art. In comparison with the methods using pixelated phase mask CCD [15-16] or the frequency domain (FD) real time techniques [3-4] that are sometimes combined with color CCD [17-18], the method described herein is less limited to high spatial variations of the sample; FD techniques require that the carrier frequency induced by the tilting of the reference mirror is higher than the sample spatial bandwidtha requirement that can not always be met.
(8) By using three (alternatively two) parallel detectors, each equipped with an achromatic phase shifter, three phase shifted (alternatively two) interference images are grabbed simultaneously and in parallel at three different wavelengths (the entire field of view is recorded at once). By using a simple three wavelengths phase shift algorithm the 3D images are obtained in real time.
(9) The invention will now be described in two parts. Firstly the system will be described with respect to the figures and then the method of obtaining the results will be described.
Detailed Description of the Drawings
(10)
(11) In
(12)
(13) In
(14) The system in
(15)
(16)
(17)
(18) In
(19)
(20)
(21) Other interferometer units that can be used in embodiments of the system include, but are not limited to, Michelson-Taylor type and Mach-Zehnder type orthogonal polarization interferometers.
(22)
Detailed Description of the Method of Obtaining the Results
(23) In PSI, a two beam interferometer of some type (Linnik, Michelson, Mirau, Twyman-Green, Nomarski, Fizau, Mach-Zehnder) is normally used to produce the interference pattern of a specimen positioned in one of the interferometer arms. The reflected interference signal from each point of the sample is then formulated according to equation 1 [2]:
I=B+A cos ,(1)
where B is the so-called DC level, A is the modulation (envelope) and is the phase of the interference signal; this model holds also for sources with low temporal coherence [13]. The interference phase is related to the optical path difference (OPD) between a given point on the sample and the respective point on the reference mirror as formulated in equation 2, where is the central wavelength of the illuminating light source. In PSI, after the phase value of each point of the sample is extracted, the local OPD is calculated and then the 3D shape of the sample is constructed; in reflection mode, the difference in OPD between two neighbor sample points equals twice their difference in height (OPD/2=height).
(24)
(25) When the observed surface has overall height variations larger than one fringe of the interference signal, the extracted phase values are wrapped and a phase unwrap algorithm should be applied in order to unwrap the 2 modulo of the phase and reconstruct the 3D shape of the object. Phase unwrap algorithms are likely to collapse in cases where the samples have steep height variations, excess speckle noise and or discontinuities.
(26) An alternative way of using a phase unwrap algorithm is to use two (or more) wavelengths for imaging. For each wavelength the phase is extracted by grabbing three /2 phase shifts, which ideally are described as follows (in equation 3, with i=1, 2, 3):
I.sub.i=B+A cos [+(i1)/2],(3)
then,
=tg.sup.1[(I.sub.1+I.sub.32I.sub.2)/(I.sub.1I.sub.3)](4)
(27) Practically, the non-ideal optical components and system alignment may cause the three /2 phase shifted signals to have different DC levels (B) and modulations (A) along with phase shifts with some bias relative to the desired /2 values between the signals as described in equation 5:
I.sub.i=B.sub.i+A.sub.i cos[+(i+1)/2+.sub.i],(5)
(28) In this case, based on a one time preliminary data acquisition to characterize the nature of the non-ideality of the optical components in the system, a system fitting calibration of equation 4 has to be made in order to achieve exact phase extraction from the signals. Using a predetermined movement profile of the motorized stage mounted with a sample, such as, but not necessarily a linear movement, the three phase shifted signals for each image pixel are collected for each wavelength and the DC level, modulation and bias phase shifts are determined via fitting algorithms. Then, a modified version of equation 4 is used to extract the phase for each wavelength as follows:
=tg.sup.1[(c.sub.3.sub.1+c.sub.1.sub.3(c.sub.3+c.sub.1).sub.2)/((1+c.sub.4).sub.1(c.sub.21).sub.3(c.sub.2+c.sub.4).sub.2)](6)
where in equation 6, .sub.i=(A/A.sub.i).Math.(I.sub.iB.sub.i)+B, B=max{B.sub.1, B.sub.2, B.sub.3}, A=max{A.sub.1, A.sub.2, A.sub.3}, c.sub.1=cos(.sub.1.sub.2), c.sub.2=sin(.sub.1.sub.2), c.sub.3=cos(.sub.1.sub.2) and c.sub.4=sin(.sub.4.sub.2).
(29) After the phase is obtained for each wavelength, one can calculate the OPD for much larger effective fringe size. For example, when using two wavelengths .sub.1 and .sub.2, after calculating their respective phases .sub.1 and .sub.2, the OPD is calculated as follows:
(30)
(31) From equation 7 it is easy to note that the OPD can be easily calculated as long as the difference between .sub.1 and .sub.2 is smaller than 2. Therefore, much larger steps (height variations) can be imaged and no phase unwrapping algorithm is required. Effectively, the maximum step height is limited to the effective wavelength which is given according to eq.8 (in reflection mode):
h.sub.max=0.5.sub.2.sub.1/(.sub.1.sub.2)(8)
(32) When high numerical objective lenses are used, a correction factor which takes into account the effect of the numerical aperture should be applied to equation 8:
h.sub.max=0.5.sub.2.sub.1/[(1NA.sup.2/4)(.sub.1.sub.2)](9)
(33) The standard approach to extract the phase from the interference signal is by changing the reference arm length in four equal steps with step size equivalent to /2 phase shift [2]; for each step the interference signal is recorded. Using these phase shifted signals the phase is extracted for each point of the sample. This process is repeated for each wavelength. Then, by using equation 7 the OPD of each point of the sample is calculated and the 3D image is reconstructed (OPD/2=height). The fact that the phase shifting is done successively and not simultaneously is very problematic for imaging dynamically moving scenes. Moreover, the switching between wavelengths also requires time which further reduces the imaging speed and requires larger level of stability from the system.
(34) By using a three synchronized color phase shifted parallel detector unit 1900 (see
(35)
(36) Since close wavelength values are used, a large effective wavelength is produced which in turn imposes a relatively large error on the value of the calculated OPD (for some wavelength combinations it might be as large as ). Therefore, additional calculation of the OPD is made using the other two pixels, with less proximity wavelengths values in a four pixels square, say .sub.1 and .sub.2
(37)
(38) Since less close wavelength values are used, a smaller effective wavelength is produced which in turns imposes a relatively smaller error on the value of the calculated OPD (for some wavelength combinations it might be as large as 0.1). In equation 11, m is an integer that was introduced in order to account for the wrapping of the phase when the smaller effective wavelength is used (.sub.eff,21). The order of m is determined using equations 10 and 11:
m=int(.sub.32.sub.eff,32/.sub.eff,21.sub.21)/4(12)
(39) After the order of m is determined, the OPD is recalculated:
(40)
(41) Since the error in the OPD is still quite large by using eq.13 (0.1), additional calculation of the OPD is made using the average value of two pixels with identical wavelength values (.sub.2) in a four pixels square:
(42)
(43) In equation 14, n is an integer that was introduced in order to account for the wrapping of the phase when the primary wavelength is used (.sub.2). The order of n is determined using equations 13 and 14:
(44)
(45) After the order of n is determined, the OPD is recalculated with accuracy in the range of 0.005.sub.2 using equation 14 and 15:
(46)
(47) Using eq.16 and the fact that OPD/2=height between two adjacent points on the sample (for reflection mode), the 3D image of the sample can be calculated in real time with nanometer accuracy even for large step samples.
(48) Another embodiment of the invention uses a polarized Mirau common path interferometer. This interferometer is similar to the Mirau objective but with slight modification to allow integration into the system of the invention.
(49) Another preferred embodiment is depicted in
(50) Another embodiment is shown in
(51) Producing the Phase Shift
(52) The phase shifts between the three cameras are produced in the present invention by using two slightly different approaches to arranging the wave plates.
(53) First Approach:
(54) In the first approach element 33, 133 in
(55) Second Approach
(56) In the second approach the wave plates 22, 28 and 25 in the detection unit 1900 of
(57) To further clarify this issue the Jones matrices formalism is now used to show how the phase shift is generated. Consider the Jones vectors of RH and LH circularly polarized waves which represent the circular waves exiting the PQWP positioned in front of the tube lens (element 33, 133 in
(58)
(59) In equations 17-18, .sub.1 and .sub.2 are the phases of the optical waves coming from the reference and sample arms of the interferometer. After the circular waves split at the beam splitters, they are incident on a linear polarizer which is rotated at an angle where can be 0, 45 or 90 degrees. The Jones matrix is now written for an analyzer rotated at a degrees with respect to the P polarization direction:
(60)
(61) The RH circular polarization wave transmitted through the analyzer is then expressed using the Jones calculus formalism, giving:
(62)
(63) Similarly, the LH circular polarization wave is:
(64)
(65) Clearly, the phase delay introduced between the reference and sample waves is directly related to the rotation angle of the analyzer:
=E.sub.LH,outE.sub.RH,out=.sub.2.sub.1+2=+(22)
(66) The constant phase delay appears common to all the interference signals, which are produced at the different cameras, while the phase delay is different in each camera. For the camera equipped with the analyzer that is rotated at =00, the phase delay is =0. For the camera equipped with the analyzer that is rotated at =45, the phase delay is =2=90=/2 rad. For the camera equipped with the analyzer that is rotated at =90, the phase delay is =2=180= rad.
(67) Although embodiments of the invention have been described by way of illustration, it will be understood that the invention may be carried out with many variations, modifications, and adaptations, without exceeding the scope of the claims.
BIBLIOGRAPHY
(68) 1. J. H. Bruning, Fringe Scanning Interferometers, in Optical Shop Testing, D. Malacara, Ed., 409-437, (Wiley, New York, 1978). 2. K. Creath, Phase-measurement interferometry techniques, in [Progress in Optics], Wolf, E., ed., Elsevier Science Publishers, Amsterdam, 351-366, (1988). 3. M. Takeda, H. Ina, S. Kobayashi, Fourier-transform method of fringe-pattern analysis for computer based topography and interferometry, J. Opt. Soc. Am., 72, 156-160 (1982). 4. W. W. Macy, Two-dimensional fringe-pattern analysis, Appl. Opt., 22, 3898-3901, (1983). 5. H. A. Vrooman, A. A. M. Maas, Image processing algorithm for the analysis of phase-shifted speckle interference patterns, Appl. Opt., 30, 1636-1641 (1991). 6. K. A. Stetson, Phase-step interferometry of irregular shapes by using an edge-following algorithm, Appl. Opt., 31, 5320-5325 (1992). 7. Y. Xu, C. Ai, Simple and effective phase unwrapping technique, SPIE Vol. 2003, 254-263 (1993). 8. J. A. Quiroga, E. Bernabeu, Phase-unwrapping algorithm for noisy phase-map processing, Appl. Opt., 33, 6725-6731 (1994). 9. J. M. Hurntely, H. Saldner, Temporal phase-unwrapping algorithm for automated interferogram analysis, Appl. Opt., 32, 3047-3052 (1993). 10. J. C. Wyant, Testing Aspherics Using Two-Wavelength Holography, Appl. Opt., 10, 2113-2118 (1971). 11. C. Polhemus, Two-Wavelength Interferometry, Appl. Opt., 12, 2071-2074 (1973). 12. Y. Y. Cheng, J. C. Wyant, Two-wavelength phase shifting interferometry, Appl. Opt., 23, 4539-4543 (1984). 13. K. Creath, Step height measurement using two-wavelength phase-shifting interferometry, Appl. Opt. 26, 2810-2816 (1987). 14. Y. Y. Cheng, J. C. Wyant, Multiple-wavelength phase-shifting interferometry, Appl. Opt., 24, 804-807 (1985). 15. M. Novak, J. Millerd, N. Brock, M. N. Morris, J. Hayes, J. Wyant, Analysis of a micropolarizer array-based simultaneous phase-shifting interferometer, Appl. Opt., 44, 6861-6868 (2005). 16. K. Creath, G. Goldstein, Dynamic quantitative phase imaging for biological objects using a pixelated phase mask, Bio. Med. Opt. Expr., 3, 2866-2880 (2012). 17. Etienne Cuche, Yves Emery and Frederic Montfort, One Shot Analysis, Nature Photonics 3, 633-635 (2009). 18. M. T. Rinehart, N. T. Shaked, N. J. Jenness, R. L. Clark, A. Wax, Simultaneous two-wavelength transmission quantitative phase microscopy with a color camer, 35, 2612-2614 (2010). 19. R. Smythe, R. Moore, Instantaneous phase measuring interferometry, Opt. Eng., 23, 361-364 (1984). 20. C. L. Koliopoulos, Simultaneous phase shift interferometer, SPIE Vol., 1531, 119-127 (1991). 21. B. K. A. Ngoi, K. Venkatakrishnan, N. R. Sivakumar, T. Bo, Instantaneous phase shifting arrangement for microsurface profiling of flat surfaces, Opt. Comm., 190, 109-116 (2001). 22. S. Suja Helen, M. P. Kothiyal, R. S. Sirohi, Achromatic phase shifting by a rotating polarizer, Optics Communications 154, 1998, 249-254
ADDITIONAL REFERENCES
(69) a. US2010/0309476 A1 b. U.S. Pat. No. 8,072,610 B1 c. U.S. application Ser. No. 15/118,877 d. d. Avner Safrani and Ibrahim Abdulhalim, High-speed 3D imaging using two-wavelength parallel-phase-shift interferometry, Optics Letters, Vol. 40, No. 20, 4651-4654 (Oct. 15, 2015)