OPTICAL PROJECTOR WITH OFF-AXIS DIFFRACTIVE ELEMENT

Abstract

Apparatus for projecting a pattern includes a laser source, a collimating lens and a diffractive optical element (DOE) to diffract the collimated laser beam into a specific dot pattern for sensing the depth of a three dimensional (3D) surface.

Claims

1. (canceled)

2. An apparatus comprising: a laser configured to produce a laser beam; a collimating lens mounted to intercept the laser beam and produce a collimated beam: a diffractive optical element (DOE) having an off-axis diffraction pattern and mounted to intercept the collimated beam and produce an off-axis diffracted beam pattern including an off-center 0th order beam; and a projection element mounted to intercept the off-axis diffracted beam pattern and project a portion of the pattern excluding the 0th order beam; wherein the projection element comprises: a reflective component mounted at a non-45 degree angle to the 0th order beam; and a block mounted to intercept the 0th order beam.

3. The apparatus of claim 2 wherein the block is mounted to intercept the 0th order beam before the reflective component.

4. The apparatus of claim 2 wherein the block is mounted to intercept the 0th order beam after the reflective component.

5. The apparatus of claim 2 wherein the DOE is integrated with the reflective component.

6. The apparatus of claim 2 wherein the projection component comprises a reflective component mounted to reflect a portion of the off-axis diffracted beam pattern but not reflect the 0th order beam.

7. An apparatus comprising: a laser configured to produce a laser beam; a collimating lens mounted to intercept the laser beam and produce a collimated beam; a diffractive optical element (DOE) having an off-axis diffraction pattern and mounted to intercept the collimated beam and produce an off-axis diffracted beam pattern including an off-center 0th order beam; and a projection element mounted to intercept the off-axis diffracted beam pattern and project a portion of the pattern excluding the 0th order beam; wherein the projection component includes an aperture positioned to not pass the 0th order beam.

8. The apparatus of claim 2 wherein the laser is an edge emitting laser.

9. The apparatus of claim 2 wherein the laser is a vertical cavity surface emitting laser (VCSEL).

10. An apparatus comprising: a laser configured to produce a laser beam; a collimating lens mounted to intercept the laser beam and produce a collimated beam: a diffractive optical element (DOE) having an off-axis diffraction pattern and mounted to intercept the collimated beam and produce an off-axis diffracted beam pattern including an off-center 0th order beam; and a projection element mounted to intercept the off-axis diffracted beam pattern and project a portion of the pattern excluding the 0th order beam; wherein the projection element comprises: a block mounted to intercept the 0th order beam, the block having a low reflective, light diffusing surface such that any reflected portion of the 0th order beam is less bright than a second order diffraction beam.

11. (canceled)

12. The apparatus of claim 2 wherein the apparatus is mounted in a smartphone.

13. (canceled)

14. A method comprising: producing a laser beam; intercepting the laser beam and producing a collimated beam; intercepting the collimated beam and producing an off-axis diffracted beam pattern including an off-center 0th order beam; and intercepting the off-axis diffracted beam pattern and projecting a portion of the pattern excluding the 0th order beam wherein the projecting step comprises: reflecting a portion of the pattern excluding the 0th order beam using a non-45 degree angle to the 0th order beam; and blocking the 0th order beam.

15. The method of claim 14 wherein blocking the 0th order beam is done before reflecting a portion of the pattern excluding the 0th order beam.

16. The method of claim 14 wherein blocking the 0th order beam is done after reflecting a portion of the pattern excluding the 0th order beam.

17. The method of claim 14 wherein both producing an off-axis diffracted beam pattern and reflecting a portion of the pattern excluding the 0th order beam are done using an integrated reflective and diffractive optical element component.

18. The method of claim 14 further comprising: recording first positions of a plurality of elements of the off-axis diffraction pattern as reflected off a flat surface and detected by the a photodetector; recording second positions of a plurality of elements of the off-axis diffraction pattern as reflected of a non-flat object to be measured; determining the difference between the first and second positions for the plurality of elements of the off-axis diffraction pattern as reflected; and generating a map of the depth of the non-flat object at different points based on the difference between the first and second positions for the plurality of elements of the off-axis diffraction pattern as reflected.

19. The method of claim 14 wherein the laser is an edge emitting laser.

20. The method of claim 14 wherein the step of projecting a portion of the pattern excluding the 0th order beam uses a mirror.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0011] FIG. 1 is an example of a prior art on-axis diffraction pattern.

[0012] FIG. 2 is an example of an off axis diffraction pattern according to an embodiment.

[0013] FIG. 3 is a first embodiment of an optical projector using off-axis DOE.

[0014] FIG. 4 is a second embodiment of an optical projector using off axis DOE.

[0015] FIG. 5 is a third embodiment of an optical projector using off axis DOE.

[0016] FIG. 6 shows an embodiment of a hybrid laser and photo detector module which can be used in one embodiment of the invention.

[0017] FIG. 7 is a diagram of a smartphone with an integrated optical projector with an off-axis DOE in one embodiment of the invention.

[0018] FIG. 8 is a block diagram of the components of a smartphone with an integrated optical projector with an off-axis DOE in one embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0019] FIG. 2 is a diagram of an example of a pattern generated by an embodiment of the present invention where the DOE is an off-axis diffractive element. In contrast to the diffraction pattern shown in FIG. 1, the 0.sup.th order beam 200 is near the bottom of the diffraction pattern. The 0.sup.th order beam 200 is below the face 202 shown in FIG. 2. Since the 0.sup.th order is away from the surface measurement area, we can implement a block to this 0.sup.th order beam somewhere along the optical path. In theory, the 0.sup.th order beam need not be blocked, since it does not come close to the person's eyes as shown in FIG. 2. However, since the pattern may move around as the user is preparing to use it, or it may be seen by someone standing near the user, it is better to completely avoid a high intensity 0.sup.th order beam.

[0020] The construction of such an off-axis diffraction element is described, for example, in Wai-Hon Lee, Computer-Generated Holograms: Techniques and Applications, reprinted from Progress in Optics, 1978, and Wai-Hon Lee U.S. Pat. No. 7,699,516, the disclosures of which are hereby incorporated herein by reference. In general, an off-axis diffraction pattern is created by a computer generated hologram(CGH). Suppose that the projected dot pattern is represented by a function f(x,y) and F(u,v) is its Fourier transform. The mathematical representation of the CGH is given by

H(u,v)=|F(u,v)|{1+cos(2u/T+(u,v))} (1)

Where (u,v) is the phase of the complex function F(u,v) and T is related to the diffraction angle by the formula sin /. A laser recording device is then used to plot the function H(u,v) on photographic film or photoresist. The resulting CGH is the off axis diffraction element which may be used in an embodiment of this invention.

[0021] FIG. 3 is a diagram of a first embodiment of the present invention. A laser 300 is shown, which is an edge emitting laser in one embodiment. The diverging beam from the laser 300 is collimated by a collimating lens 301 to produce a collimated beam. The collimated laser beam is then transmitted through an off-axis DOE 303 to produce a group of diffracted beams 302. The beams 302 diffracted by DOE 303 are incident on mirror 304. As shown, beam 305 is the 0th order beam which is the continuation of the laser beams 302. Beam 305 is stopped by a block 306. Arrow 307 represents all the non-0 order off axis beams emerging from the optical projector toward a person's face or other 3D object. The dotted line 310 is the normal to the mirror surface. The center of the diffracted bundles is normal to beam 302.

[0022] Block 306 preferably has a low reflective, light diffusing surface such that any reflected portion of the 0.sup.th order beam is at least less bright than a second order diffraction beam. Ideally, any light from the 0.sup.th order beam is either uniformly dispersed, or is significantly less than the brightness of any higher order beam in the off-axis diffraction pattern. In this way, any reflection of the 0.sup.th order beam will not be picked up by mirror 304 and impact the measurement of the pattern.

[0023] FIG. 4 shows a second embodiment of this current invention. In this embodiment the off axis DOE 403 is a reflective elementthe diffractive element and the mirror are combined. Again the 0th order beam 405 is blocked by a block or stop 406. Arrow 407 represents all the off axis beams emerging from the optical projector. An advantage of this embodiment is the need for fewer parts, since the DOE and reflective element are combined. However, this results in the 0.sup.th order beam not having as much separation from the other beams in the pattern by the time it hits block 406. This can present a manufacturing challenge for obtaining the needed precise placement. Alternately, the diffraction pattern can be varied to create quicker divergence of beams, or the block can be placed further from the combined DOE/reflector 403. The dotted line 410 is the normal to the mirror surface. The center of the diffracted bundles is normal to beam 402.

[0024] FIG. 5 shows a third embodiment of this current invention. The optical axis of laser 500 is not along the optical axis 502 of the lens 501. This is a different way to produce an off-axis diffraction pattern, rather than having the laser axis along the lens axis, and using the diffraction pattern to diffract the 0.sup.th order beam to an off-axis position. As a result, the collimated beam 505 is incident on the DOE at an angle. The diffracted beam 507 from the DOE is then reflected by mirror 504 and exits the projection unit housing 510 through an opening 512. The 0th order beam 505 as shown does not need to be blocked because it is sufficiently off-axis to not be reflected by the mirror 504. The 0.sup.th order beam will then go past mirror 504, and impact the inside of a housing 510. By coating or otherwise manufacturing the inside of housing 510 to have a low reflectivity, light diffusing surface, reflections of the 0.sup.th order beam will not interfere with the diffraction pattern. In one embodiment, the angle of the mirror is not 45 degree and is determined by the incident angle of the laser beam and the diffraction angle of the off axis device.

[0025] In an alternate embodiment, a surface emitting laser can be used to replace the edge emitting lasers in the previous embodiments. In one embodiment, the laser is a vertical cavity surface emitting laser (VCSEL).

[0026] FIG. 6 shows an embodiment of a hybrid laser and photo detector module which can be adapted to be used in one embodiment of the invention, as shown in more detail in Wai-Hon Lee U.S. Pat. No. 6,188,062, the disclosure of which is hereby incorporated herein by reference. A photo detector device 200 is shown to have a V-shaped groove 210 etched on its surface. The photo detector is fabricated on a special silicon wafer which has a crystal plane subtending a 45 degree angle with respect to the surface of the wafer as shown in FIG. 2. A mirror 220 is attached to that 45 degree surface by means of adhesive or metallic bonding material such as thin solder. A corrugated structure with period T has been etched on top surface 230 of the mirror 220.

[0027] The corrugated structure is designed to split the laser beam into the diffraction pattern. Laser chip 240 is attached to pad 250 on the photo detector by means of electrically conductive adhesive. A bonding pad 260 allows electrical connection be made to the bottom of the laser chip 240. A light sensitive area 270 behind the laser chip 240 is to detect the back light emission from the laser chip and thus serves as a laser power monitor. Pad 272 is for connecting to the anode of the detector element 270. On the back side of the mirror 220 is a set of photo detectors 280 which has six elements, a,b,c,d,e, and fin this embodiment. Additional detector elements can be implemented for multichannel readouts. Pads 281,282,283,284,285,286 are respectively for the anodes of the detectors a,b,c,d,e, and f. The back surface of the detector 290 provide the contact to the cathode of all the light sensitive elements.

[0028] FIG. 7 shows an embodiment of an electronic device 702, such as a smartphone. Device 702 has a display 704 for presenting information to a user, and also functions as a touch screen for inputting information. An optical module 706 is provided, and may include the elements of one of the embodiments of FIGS. 3-6. The photodetector can be part of optical module 706, or can be separately mounted on electronic device 702.

[0029] FIG. 8 is a block diagram of the electronics of an embodiment of an electronic device such as device 702 of FIG. 7. A microcontroller 802, such as a microprocessor, controls the operation of the electronic device. A memory 804 contains the stored program for operating microcontroller 802, along with data storage. Memory 804 can be a flash or other solid state memory in one embodiment, and can be one or multiple memory chips.

[0030] A touch display 812 is controlled by a display controller 814, under the direction of microcontroller 802. The touch display provides both user inputs, and provides display information to the user. Optical projection module 806 may be one of the embodiments shown in FIGS. 2-5. A separate photodetector 808 is shown, although it could be integrated into optical projection module 806. A camera 810 is also provided, and other components (not shown) may be included in the electronic device.

[0031] In one embodiment, the off-axis DOE is used in an electronic device, such as a smartphone, to measure the depth features of a person's face or to determine the distance of a person's face from a camera. A program in memory 804 controls microcontroller 802 to control camera 810 and optical projection module 806 to provide a composite image of a person's face. Calibration is done by recording the calibration positions of a plurality of elements of the off-axis diffraction pattern as reflected off a flat surface and detected by the photodetector. Then, the measured positions of a plurality of elements of the off-axis diffraction pattern as reflected of a non-flat object to be measured, such as a person's face, are recorded. Then, the differences between the calibrated and measured positions are determined. From those differences, the change in depth can be determined. That information is used to generate a map of the depth of the non-flat object at different points.

[0032] In one embodiment, the method for determining depth using the diffraction pattern is set forth in Prime Sense US Published Application No. 20100007717, the disclosure of which is hereby incorporated herein by reference. Additional details of one embodiment are set forth in PCT Publication WO 2007/043036, which describes a system and method for object reconstruction in which a coherent light source and a generator of a random speckle pattern project onto the object a coherent random speckle pattern. An imaging unit detects the light response of the illuminated region and generates image data. Shifts of the pattern in the image of the object relative to a reference image of the pattern are used in real-time reconstruction of a 3D map of the object. Further methods for 3D mapping using speckle patterns are described, for example, in PCT Publication WO 2007/105205. The disclosures of PCT Publication WO 2007/043036 and PCT Publication WO 2007/105205 are hereby incorporated herein by reference.

[0033] In one embodiment, a program in memory 804 controls microcontroller 802 to combine images from camera 810 with depth information from optical projection module 806 to provide a composite image of a person's face. Facial recognition software can then compare the face to stored faces, either in the device or in the cloud. Such comparison can be used, for example, to authenticate a person as authorized to operate the electronic device or a program on the device. Alternately, it can be used to match a person to a face detected on a social media platform or other platform or application.

[0034] While the invention has been described with respect to specific embodiments, one skilled in the art will recognize that numerous modifications are possible. Thus, although the invention has been described with respect to specific embodiments, it will be appreciated that the invention is intended to cover all modifications and equivalents within the scope of the following claims.