RECEIVER WITH A LIGHT COLLECTOR ARRAY AND A MASK FOR IMPROVING DETECTION RESOLUTION DURING A SCANNING PROCEDURE OF AN OPTICAL SENSING SYSTEM
20230184903 · 2023-06-15
Assignee
Inventors
Cpc classification
G01S17/02
PHYSICS
G02B27/0988
PHYSICS
G02B19/0019
PHYSICS
International classification
G01S7/481
PHYSICS
G01S17/02
PHYSICS
G02B19/00
PHYSICS
Abstract
Embodiments of the disclosure include a receiver of an optical sensing system. The receiver may include a mask configured to resonate during a scanning procedure performed by the optical sensing system. The receiver may also include a photodetector array positioned on a first side of the mask. The photodetector array may be configured to detect light that passes through the mask during the scanning procedure to generate a frame. The receiver may further include a light collector array aligned with the photodetector array and configured to concentrate the light that passes through the mask during the scanning procedure before directing the light to the photodetector array.
Claims
1. A receiver of an optical sensing system, comprising: a mask configured to resonate during a scanning procedure performed by the optical sensing system; a photodetector array positioned on a first side of the mask, the photodetector array configured to detect light that passes through the mask during the scanning procedure to generate a frame; and a light collector array aligned with the photodetector array and configured to concentrate the light that passes through the mask during the scanning procedure before directing the light to the photodetector array.
2. The receiver of claim 1, wherein: the mask is a Hadamard mask comprising a coded pattern configured to provide sub-pixelization of the frame, each coded pattern comprises a plurality of coded regions arranged in a plurality of rows, each of the plurality of rows comprise a N number of coded regions, and each coded region is designed to either pass or block the light.
3. The receiver of claim 2, wherein the Hadamard mask further comprises: a frame beginning pattern corresponding to a start of the frame captured during the scanning procedure.
4. The receiver of claim 2, wherein: the photodetector array comprises a plurality of photodetectors each of which corresponding to one of the coded regions in a row of the coded pattern of the Hadamard mask, and the light collector array comprises a plurality of light collectors each of which corresponding to one of the plurality of photodetectors.
5. The receiver of claim 1, wherein the light collector array comprises an array of two-dimensional collectors or an array of three-dimensional collectors.
6. The receiver of claim 5, wherein the array of two-dimensional collectors includes V-trough collectors or compound parabolic concentrator (CPC) trough collectors.
7. The receiver of claim 5, wherein the array of three-dimensional collectors includes pyramid collectors or compound parabolic concentrator (CPC) collectors.
8. A method of forming a light collector array for an optical sensing system, comprising: forming a plurality of light collectors, wherein each light collector is formed by: forming a first mold of the light collector; forming a second mold of the light collector based at least in part on the first mold; filling the second mold of the light collector with a base material; curing the base material to form the light collector in the second mold; releasing the light collector from the second mold; and applying a reflective material to a surface of the light collector, wherein the light collector includes a two-dimensional collector or a three-dimensional collector; and arranging the plurality of light collectors into the light collector array.
9. The method of claim 8, wherein the two-dimensional collector includes a V-trough, a compound parabolic concentrator (CPC) trough, or a conical trough.
10. The method of claim 9, wherein the reflective material is formed on an inner surface or an outer surface of the two-dimensional collector.
11. The method of claim 8, wherein the three-dimensional collector includes a compound parabolic concentrator (CPC), a pyramid, or a cone.
12. The method of claim 11, wherein the reflective material is formed on an outer surface of the three-dimensional collector.
13. The method of claim 8, wherein the forming the first mold of the light collector comprises: obtaining, by first equipment, structural information associated with the light collector; generating, at the first equipment, a set of commands for forming the first mold of the light collector; and implementing, at the first equipment, the set of commands to form the first mold of the light collector.
14. The method of claim 13, wherein the first equipment includes one or more of computer numerical control (CNC) equipment or three-dimensional printing equipment.
15. The method of claim 13, wherein the structural information is obtained from a computer-aided design (CAD) file or a building information modeling (BIM) file associated with the light collector.
16. The method of claim 8, wherein the forming the second mold of the light collector comprises: forming a layer over the first mold; curing the layer to form a reverse mold of the light collector; and releasing the reverse mold of the light collector from the first mold, wherein the second mold is the reverse mold of the light collector released from the first mold.
17. The method of claim 16, wherein the layer includes a silicon-based organic polymer.
18. The method of claim 8, further comprising: covering the second mold filled with the base material with a transparent cover layer before curing the base material, wherein the base material includes an ultraviolet (UV)-curable polymer.
19. The method of claim 8, wherein arranging the plurality of light collectors into the light collector array further comprises: aligning each light collector in the plurality of light collectors with a photodetector in an array of photodetectors of the optical sensing system.
20. An optical sensing system, comprising: a transmitter configured to emit light towards an environment during a scanning procedure; and a receiver comprising: a mask configured to resonate during a scanning procedure performed by the optical sensing system; a photodetector array positioned on a first side of the mask, the photodetector array configured to detect light that passes through the mask during the scanning procedure to generate a frame; and a light collector array aligned with the photodetector array and configured to concentrate the light that passes through the mask during the scanning procedure before directing the light to the photodetector array.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
DETAILED DESCRIPTION
[0022] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0023] LiDAR is an optical sensing technology that enables autonomous vehicles to “see” the surrounding world, creating a virtual model of the environment to facilitate decision-making and navigation. An optical sensor (e.g., LiDAR transmitter and receiver) creates a 3D map of the surrounding environment using laser beams and time-of-flight (ToF) distance measurements. ToF, which is one of LiDAR's operational principles, provides distance information by measuring the travel time of a collimated laser beam to reflect off an object and return to the sensor. Reflected light signals are measured and processed at the vehicle to detect, identify, and decide how to interact with or avoid objects.
[0024] Due to the challenges imposed by the prohibitive size of a photodetector array that achieves a desired detection resolution and light detection efficiency in conventional solid-state optical sensing systems, as discussed in the BACKGROUND section above, the present disclosure provides a Hadamard mask configured to resonate during a scanning procedure to provide sub-pixelization of a frame captured using a photodetector array of reduced size and a light collector array configured to concentrate light that passes through the Hadamard mask before it impinges on the photodetector array. The Hadamard mask may include, e.g., a frame beginning pattern corresponding to a start of a frame captured during the scanning procedure and a coded pattern including multiple rows of coded regions arranged in a grid configured to provide sub-pixelization of the frame. More specifically, the Hadamard mask of the present disclosure is configured to resonate in front of the photodetector array to align each of its rows with the photodetector array in a sequential manner. The photodetector array may be configured to sequentially detect light passing through a slit apparatus (e.g., located between the Hadamard mask and the far field environment) and impinging on each of the plurality of rows of the Hadamard mask grid individually. Each photodetector in the photodetector array may have an associated light collector in the light collector array such that light is concentrated before each photodetector, which enables a receiver of the present disclosure to use a photodetector array of reduced size but with increased light efficiency, as compared to known approaches.
[0025] Moreover, due to the challenges associated with forming a light collector with an accurate shape using known methods, e.g., such as wet-etching, the present disclosure provides a molding technique that begins with forming a mold of the light collector(s) using a reductive (e.g., computer numerical control (CNC)) or additive (e.g., three-dimensional (3D) printing) technique that removes layers from or adds layers to a substrate material based on design specifications of a digital file, which enhances the accuracy of the shape of the final product, as compared with known approaches. Once the first mold has been formed, a polymer layer may be formed over the first mold. After curing, the polymer layer forms a reverse mold of the light collector shape. The reverse mold may then be filled with another polymer that is optically clear and is made solid by exposure to ultraviolet (UV) light. A reflective material may then be formed on an outer wall of each three-dimensional light collector in the array to collect light that is directed towards the photodetector. Alternatively, when the light collector shape is a two-dimensional trough, a reflective coating may be formed on either the inner surface of the trough or an outer surface of the trough, the later so long as the polymer that forms the body of the trough is transparent. Using these technique, the accuracy of the shape of each light collector may be increased as compared to known techniques, which enhances the light concentrating efficiency of the light collector, and hence, the light detection efficiency of the photodetector.
[0026] Some exemplary embodiments are described below with reference to a receiver used in LiDAR system(s), but the application of the emitter array disclosed by the present disclosure is not limited to the LiDAR system. Rather, one of ordinary skill would understand that the following description, embodiments, and techniques may apply to any type of optical sensing system (e.g., biomedical imaging, 3D scanning, tracking and targeting, free-space optical communications (FSOC), and telecommunications, just to name a few) known in the art without departing from the scope of the present disclosure.
[0027]
[0028] Transmitter 102 can sequentially emit a stream of pulsed laser beams in different directions within a scan range (e.g., a range of scanning angles in angular degrees), as illustrated in
[0029] In some embodiments of the present disclosure, laser source 106 may include a pulsed laser diode (PLD), a vertical-cavity surface-emitting laser (VCSEL), a fiber laser, etc. For example, a PLD may be a semiconductor device similar to a light-emitting diode (LED) in which the laser beam is created at the diode's junction. In some embodiments of the present disclosure, a PLD includes a PIN diode in which the active region is in the intrinsic (I) region, and the carriers (electrons and holes) are pumped into the active region from the N and P regions, respectively. Depending on the semiconductor materials, the wavelength of incident laser beam 107 provided by a PLD may be greater than 700 nm, such as 760 nm, 785 nm, 808 nm, 848 nm, 905 nm, 940 nm, 980 nm, 1064 nm, 1083 nm, 1310 nm, 1370 nm, 1480 nm, 1512 nm, 1550 nm, 1625 nm, 1654 nm, 1877 nm, 1940 nm, 2000 nm, etc. It is understood that any suitable laser source may be used as laser source 106 for emitting laser beam 107.
[0030] Scanner 108 may be configured to steer a laser beam 109 towards an object 112 (e.g., stationary objects, moving objects, people, animals, trees, fallen branches, debris, metallic objects, non-metallic objects, rocks, rain, chemical compounds, aerosols, clouds and even single molecules, just to name a few) in a direction within a range of scanning angles. In some embodiments consistent with the present disclosure, scanner 108 may include a micromachined mirror assembly (also referred to herein as “scanning mirror assembly”) that is comprised of a plurality of elements. One such element is a scanning mirror, such as a MEMS mirror 110 illustrated in
[0031] In some embodiments, receiver 104 may be configured to detect a returned laser beam 111 returned from object 112. Returned laser beam 111 may be returned from object 112 and have the same wavelength as laser beam 109. Returned laser beam 111 may be in a different direction from laser beam 109. Receiver 104 can collect laser beams returned from object 112 and output electrical signals reflecting the intensity of the returned laser beams. Upon contact, laser beam 109 can be reflected by object 112 via backscattering, e.g., such as Raman scattering and/or fluorescence.
[0032] As illustrated in
[0033] Hadamard mask 130 may include a frame beginning pattern configured to indicate the start of scan associated with a new frame. In certain implementations, the start of the scan may be associated with a new scanning angle of the scanning procedure. Moreover, Hadamard mask 130 may include a coded pattern comprised of a plurality of coded regions arranged in a plurality of rows and/or a grid, as shown in
[0034] During the line-scan, returned laser beam 111 may be collected by lens 114 as laser beam 121, which passes through the slit of the slit apparatus. The light passing through the slit impinges on only the row of the Hadamard mask 130 that is aligned with the slit at that point in time. The beam size of the incoming light passing through Hadamard mask 130 may be larger than the sensitive area of the photodetector array 120. Thus, receiver 104 may include a light collector array 140 with multiple light collectors (e.g., each light collector can be a V-shape collector, a compound parabolic collector (CPC), a conical collector, etc.), which may be configured to enhance the light collection efficiency in front of photodetector array 120. A light collector is a non-imaging concentrator, which may be capable of collecting all or much of the available radiation (both beam and diffuse) that impinges on the light collector in a wide range of angles of incidence and directing it to photodetector array 120. V-shape collectors and CPCs are representatives of these type of non-imaging concentrators. V-shape collectors and CPCs do not have strict requirements for the angle of incidence as in other types of collectors of different trough shapes (e.g., two-dimensional (2D) shapes) and/or solid bodies (e.g., 3D shapes), which makes V-shape collectors and/or CPCs attractive from the point of view of system simplicity and flexibility. Light collector array 140 can be implemented as an array of 2D concentrators (also referred to as “troughs”) or 3D concentrators (e.g., pyramids, CPC, parabocylinders, cones, etc.). When formed as a 3D concentrator, an optically clear material (e.g., such as glass or a polymer) may be used to form the light collector array. A reflective coating may be formed on an inner wall (also referred to as “inner side surface”) or an exterior wall (also referred to as an “exterior side surface”) of the trough. The reflective coating may be formed on the exterior wall of the trough so long as the material used to form the body of the trough is transparent. Moreover, when configured as a 3D light collector, the reflective coating may be formed on the exterior side surface thereof but not on the flat ends to enable the passage and collection of light therein. The reflective surface “traps” light within the trough or 3D concentrator such that light reflects back and forth off of the reflective surface until it is eventually directed outward towards photodetector array 120, e.g., as shown in
[0035] Photodetector array 120 may have a spatial resolution sufficiently matched to the grid size of Hadamard mask 130. Photons from laser beam 121 that pass through the transparent coded regions of Hadamard mask 130 project onto photodetector array 120. Due to the slit apparatus, a single row of the coded pattern may be projected on photodetector array 120 at any given time. In other words, the light received by photodetector array 120 at a particular time is coded by the pattern of Hadamard mask 130 that is aligned with the slit at that time. As Hadamard mask 130 resonates and shifts in space, the encoded pattern aligned with the slit changes over time, therefore changing the encoding of the received light at photodetector array 120. For each frame, photodetector array 120 may receive multiple lines of light signals corresponding to the rows of encoded patterns on Hadamard mask 130 during a line-scanning procedure. After a certain illumination period (e.g., when each of the rows have been scanned for a particular frame), the received lines of light signals may be decoded to generate an image of the far field environment by the signal processor 124. Signal processor 124 may decode the received signals according to the known encodings on Hadamard mask 130 and its timing sequence. By encoding the received signals through Hadamard mask 130 and then decoding the signals, LiDAR system 100 may increase the sub-pixelization of the frame beyond that provided by the pixelization of photodetector array 120.
[0036] Photodetector array 120 may convert the laser beam 121 (e.g., returned laser beam 111) collected by lens 114 into an electrical signal 119 (e.g., a current or a voltage signal). Electrical signal 119 may be generated when photons are absorbed in a photodiode included in photodetector array 120. In some embodiments of the present disclosure, photodetector array 120 may include a PIN detector, a PIN detector array, an avalanche photodiode (APD) detector, a APD detector array, a single photon avalanche diode (SPAD) detector, a SPAD detector array, a silicon photo multiplier (SiPM/MPCC) detector, a SiP/MPCC detector array, or the like.
[0037] LiDAR system 100 may also include one or more signal processor 124. Signal processor 124 may receive electrical signal 119 generated by photodetector array 120. Signal processor 124 may process electrical signal 119 to determine, for example, distance information carried by electrical signal 119. Signal processor 124 may construct a point cloud based on the processed information. The point cloud may include a frame, which is an image of the far field at a particular point in time. In this context, a frame is the data/image captured of the far field environment at each scanning angle. Signal processor 124 may include a microprocessor, a microcontroller, a central processing unit (CPU), a graphical processing unit (GPU), a digital signal processor (DSP), or other suitable data processing devices. By including the slit apparatus, Hadamard mask 130, and light collector array 140 in receiver 104, the frame generated by signal processor 124 may have a larger pixel number than photodetector array 120, thereby reducing the size and cost of the present optical sensing system, e.g., as described in additional detail below in connection with
[0038]
[0039] As mentioned above, receiver 104 may include a slit apparatus 150, such as the one illustrated in
[0040] Referring to
[0041] As seen in
[0042] Depending on the desired sub-pixelization, each row of Hadamard mask 130 may be divided into X first coded regions 206a and Y second coded regions 206b, where X and Y may be the same number or different. Each of first coded regions 206a may be transparent and portions of laser beam 121 that pass through slit 160 may also pass through these first coded regions 206a. On the other hand, second coded regions 206b may be opaque and configured to block the passage of laser beam 121 during the line-scanning procedure. In certain implementations, there may be N rows in coded pattern 204 to provide sufficient information collection at photodetector array 120 and signal processor 124. In certain implementations, the N rows may be equal in number to one or more of the X first coded regions 206a and/or the Y second coded regions 206b. In certain other implementations, the N rows may be different in number than one or more of the X first coded regions 206a and/or the Y second coded regions 206b.
[0043] By scanning through each of the rows in Hadamard mask 130, different parts of laser beam 121 containing different information about the far field may then impinge upon photodetector array 120. Using line-scanning of Hadamard mask 130, a larger amount of information can be collected using a photodetector array 120 of a reduced size. For example, using Hadamard mask 130 and a line-scanning procedure to implement sub-pixelization, the size of photodetector array 120 may be reduced by N fold, as compared with known systems. The line-scanning procedure is described below.
[0044] For example, scanner 108 of
[0045] Frame beginning pattern 202 may be integrated into Hadamard mask 130 such that the start signal 201 (depicted in
[0046] By forming a frame beginning pattern 202 in Hadamard mask 130, signal processor 124 may identify the beginning of a new frame when the signal amplitude meets a threshold level associated with the start of a new frame. Identifying a new frame based on a signal amplitude may reduce the time and computational resources used by signal processor 124 to identify the start of a new frame in the line-scanning procedure, as compared to using a Hadamard mask without frame beginning pattern 202.
[0047] Then, as Hadamard mask 130 resonates, it is shifted downward row-by-row such that each row of coded pattern 204 receives laser beam 121 sequentially, and photodetector array 120 may output an individual signal of signal pattern 203 containing image/data of the far field environment as encoded by the corresponding row of coded pattern 204. Once each of the rows of coded pattern 204 has been scanned (e.g., once laser beam 121 has impinged on each of the rows), scanner 108 may select the next scanning angle and adjust MEMS mirror 110 such that laser beam 109 is directed toward object 112 at the new scanning angle. While at the same time, Hadamard mask 130 oscillates downward such that the frame beginning pattern 202 is re-aligned with slit 160 of slit apparatus 150 for the start of the new frame. The line-scanning procedure then continues in the same or similar manner as described above for the previous frame. The mechanism by which Hadamard mask 130 is made to oscillate will be described below in connection with
[0048] Referring to
[0049]
[0050] Referring to
[0051] Reflective coating is not formed on the input aperture and the output aperture of a three-dimensional CPC 250 such that light (e.g., laser beam 121) can enter and exit, respectively, through the exposed transparent material at either end of the CPC 250. Light that enters the input aperture may reflect back and forth through the transparent material of the CPC 250 and off of the reflective coating formed on the curved exterior side surface thereof, until it is eventually directed out of the output aperture to photodetector 120, as depicted in
[0052] One of the key parameters relating to the light collection is the acceptance angle θ.sub.c, CPC 250. The acceptance angle θ.sub.c, is the angle between the CPC axis and the line connecting the focus of one of the parabolas with the opposite edge of the upper aperture. Referring to
2a′=(2a)sinθ.sub.c (1).
[0053] The light concentration performance of CPC 250 can be expressed as the geometric concentration ratio C.sub.geo shown below in Equation (2):
[0054] Using Equations (1) and (2), one can optimize the design of CPC 250 such that a tradeoff between the desired light concentration performance and overall size of the light collector array can be achieved.
[0055]
[0056] Referring to
[0057] When formed using CNC (also referred to as “reductive manufacturing”), first mold 302 may be formed through a reductive process by which layers and/or portions of a machinable slab, such as a tooling board and/or machining board, are removed. The machinable slab may be formed of metal, wood, plastic, ceramic, polyurethane, urethane, epoxy, carbon-fiber, or any other type of material that can be carved or portions removed using CNC equipment (e.g., drills, lathes, abrasives, etc.). To begin, a computer of the CNC equipment may receive a digital file, such as a computer-aided design (CAD) file, a building information modeling (BIM) file, or any 3D modeling file, that includes the dimensional information associated with light collector array 140 and/or CPC 250. Using the structural and/or dimensional information, the CNC equipment (e.g., a computer coupled to a mechanical machine) may generate a set of commands that are sent to a mechanical machine that removes layers of the machinable slab to eventually form first mold 302.
[0058] On the other hand, when formed using 3D printing (also referred to as “additive manufacturing”), successive layers of a material formed until first mold 302 is created. Each of these successive layers may represent a thinly sliced cross-section of first mold 302. The additive material used for forming each of the layers may include one or more of plastic, polymer, polyurethane, urethane, epoxy, resin, ceramic, metal, wood, or any other material that may be used in additive manufacturing. A computer of the 3D printing equipment may receive a digital file, such as a CAD file, a BIM file, or any 3D modeling file, that includes the dimensional information associated with light collector array 140 and/or CPC 250. Using the structural and/or dimensional information, the 3D printing equipment (e.g., a computer coupled to a mechanical machine) may generate a set of commands that are sent to a printing machine that adds layers of the additive material to eventually form first mold 302.
[0059] At step S404, a second mold 404 of the at least one light collector may be formed based at least in part on the first mold 302. An example of second mold 306 is illustrated at steps (b) and (c) of
[0060] At 406, the hollow space(s) of second mold 306 may be filled with a fluid or semifluid base material 308. An example of base material 308 within the hollow space(s) of second mold 306 is illustrated at step (d) of
[0061] At 408, a cover layer 310 may be formed over second mold 306 and base material 308. Cover layer 310 may be glass, plastic, or any clear solid material. An example of cover layer 310 formed over second mold 306 and base material 308 is illustrated in step (d) of
[0062] At step 410, base material 308 may be cured to form light collector 312. An example of curing base material 308 is illustrated at step (d) in
[0063] At step 412, light collector 312 may be released from second mold 306. An example of light collector 312 released from second mold 306 is illustrated in step (e) of
[0064] At step 414, a reflective coating 314 may be added to the exterior of light collector 312 since light collector 312 is a 3D light collector. However, when light collector 312 is a 2D “trough” light collection (not shown in
[0065] As compared with known approaches, the techniques of
[0066] It is intended that the specification and examples be considered as exemplary only, with a true scope being indicated by the following claims and their equivalents.