Lensless 3-dimensional imaging using directional sensing elements
11882371 ยท 2024-01-23
Assignee
Inventors
- Alexander D. White (Carlsbad, CA, US)
- Parham Porsandeh Khial (Alhambra, CA, US)
- Seyed Ali Hajimiri (La Canada, CA, US)
Cpc classification
H04N5/30
ELECTRICITY
H05K1/189
ELECTRICITY
H04N13/388
ELECTRICITY
H04N25/41
ELECTRICITY
International classification
H01L25/16
ELECTRICITY
H04N25/40
ELECTRICITY
H04N5/30
ELECTRICITY
Abstract
A lens-less 3-D imaging device includes, in part, a multitude of optical receiving elements positioned along a concave or flat surface defining a focal zone of the imaging device. Each optical receiving element has a field of view that overlaps with a field of view of a number of other optical receiving elements. The optical receiving elements may optionally be grating couplers or photo detectors. The optical receiving elements may be disposed on a circuit board. The circuit board may be flexible and include control circuitry configured to form the image in accordance with the received responses of the optical receiving elements and further in accordance with the optical transfer functions of the of optical receiving elements. The circuit boards may include one or more flex sensors or strain gauges adapted to determine their curvatures.
Claims
1. A lens-less 3-D imaging device comprising: a plurality of optical receiving elements positioned along a surface defining a focal zone in which a 3-D image of a target is formed, each of the plurality of optical receiving elements being responsive to light received from a different direction when positioned at a same location, each of the plurality of optical receiving elements having a field of view that overlaps with a field of view of at least a subset of a remaining ones of the plurality of optical receiving elements, wherein at least a first subset of the plurality of optical receiving elements has a Gaussian distribution response.
2. The lens-less 3-D imaging device of claim 1 wherein each of the plurality of optical receiving elements is a transparent dielectric element.
3. The lens-less 3-D imaging device of claim 2 wherein each of the plurality of grating couplers has a same angular view.
4. The lens-less 3-D imaging device of claim 1 wherein each of the plurality of optical receiving elements is a grating coupler.
5. The lens-less 3-D imaging device of claim 1 wherein each of the plurality of optical receiving elements is a photo detector.
6. The lens-less 3-D imaging device of claim 5 wherein each of the plurality of photo detectors has a same angular view.
7. The lens-less 3-D imaging device of claim 1 wherein at least a first subset of the plurality of optical receiving elements has a non-Gaussian distribution response.
8. The lens-less 3-D imaging device of claim 1 wherein the plurality of optical receiving elements are positioned along inner surfaces of an icosahedron.
9. The lens-less 3-D imaging device of claim 8 wherein each of at least a subset of the inner surfaces of the icosahedron comprises a circuit board on which at least a subset of the plurality of receiving elements are disposed.
10. The lens-less 3-D imaging device of claim 9 wherein at least one of the circuit boards comprises control circuitry configured to form the 3-D image in accordance with received responses of the optical receiving elements and further in accordance with optical transfer functions of the of optical receiving elements.
11. The lens-less 3-D imaging device of claim 1 wherein said surface comprises at least one flexible circuit board.
12. The lens-less 3-D imaging device of claim 11 wherein the flexible circuit board comprises one or more flex sensors adapted to determine a curvature of the flexible circuit board.
13. The lens-less 3-D imaging device of claim 11 wherein the flexible circuit board comprises one or more strain gauges adapted to determine a curvature of the flexible circuit board.
14. The lens-less 3-D imaging device of claim 1 wherein said plurality of optical receiving elements are formed in one or more substrates comprising an illumination source.
15. The lens-less 3-D imaging device of claim 1 wherein each optical receiving element is a plasmonic antenna.
16. A method of forming a 3-D image of a target, the method comprising: receiving a response from each of a plurality of optical receiving elements positioned along a surface, each of the plurality of optical receiving elements being responsive to light received from a different direction when positioned at a same location, each of the plurality of optical receiving elements having a field of view that overlaps with a field of view of at least a subset of a remaining ones of the plurality of optical receiving elements; and forming the 3-D image in accordance with the received responses and further in accordance with optical transfer functions of the plurality of optical receiving elements, wherein at least a first subset of the plurality of optical receiving element has a Gaussian distribution response.
17. The method of claim 16 wherein each of the plurality of optical receiving elements is a transparent dielectric element.
18. The method of claim 16 each of the plurality of optical receiving elements is a grating coupler.
19. The method of claim 18 wherein each of the plurality of grating couplers has a same angular view.
20. The method of claim 16 wherein each of the plurality of optical receiving elements is a photo detector.
21. The method of claim 16 wherein each of the plurality of photo detectors has a same angular view.
22. The method of claim 16 wherein the plurality of optical receiving elements are positioned along inner surfaces of an icosahedron.
23. The method of claim 22 wherein each of at least a subset of the inner surfaces of the icosahedron comprises a circuit board on which the plurality of receiving elements are disposed.
24. The method of claim 23 wherein at least one of the circuit boards comprises control circuitry configured to form the 3-D image in accordance with received responses of the optical receiving elements and further in accordance with optical transfer functions of the optical receiving elements.
25. The method of claim 16 wherein said surface comprises at least one flexible circuit board.
26. The method of claim 25 wherein the flexible circuit board comprises one or more flex sensors adapted to determine a curvature of the flexible circuit board.
27. The method of claim 25 wherein the flexible circuit board comprises one or more strain gauges adapted to determine a curvature of the flexible circuit board.
28. The method of claim 16 wherein said plurality of optical receiving elements are formed in one or more substrates comprising an illumination source.
29. The method of claim 16 wherein each optical receiving element is a plasmonic antenna.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
DETAILED DESCRIPTION OF THE INVENTION
(20) A lens-less imaging device, in accordance with one embodiment of the present invention, includes a directionally sensitive receiver array formed by a multitude of receiver elements that have different responses to different directions from which light from a target is received. The receiver elements are positioned along flat or curved surfaces, or straight or curved paths so as to form a volumetric focal zone (referred to hereinafter as focal zone) so as to enable the lens-less imaging device to form a 3-D image of an object positioned in the focal zone.
(21) Because a 3-D imaging device, in accordance with embodiments of the present invention, includes sensors that are sensitive to the direction along which they receive, light, the 3-D imaging device, enables the use of an incoherent and/or stationary illumination sources. For example, illumination may occur from a fixed source assembled on or otherwise integrated in the same substrate in which the pixels are integrated. Furthermore, the ability to image incoherent light enables the capture and formation of imaging of a fluorescent substance with gap between excitation and emission spectra.
(22)
(23) In an incoherent/coherent imaging system, the phasor amplitudes received from different points on a target are uncorrelated since the illumination is spatially incoherent. Equation (1) below shows the relationship between the light intensity of an image of a target and the light intensity emanating from target along the x-direction for a one-dimensional array of pixels:
I.sub.IM(.sub.x)=|H(.sub.x)|.sup.2I.sub.TAR(.sub.x)=H(.sub.x)I.sub.TAR(.sub.x)(1)
(24) In equation (1), I.sub.IM(.sub.x) represents the image light intensity shown as being a function of the Fourier transform of the received light intensity along the x-direction, H(.sub.x) is the optical transfer function providing a mapping between the target and its image, |H(.sub.x)|.sup.2 represents that square of the absolute value of H(.sub.x), and I.sub.TAR(.sub.x) represents the target light intensity shown as being a function of the Fourier transform of the light intensity emanating from the target along the x-direction.
(25) In a two-dimensional space, the optical transfer function may be represented by the following expression:
(26)
(27) In equation (2), h(u, v) represents the point-spread function associated with the imaging system, FT represents the Fourier transform operation, and (u, v) are variables representing positions along the x-y axis.
(28) Using Parseval's identity, it is seen that:
(29)
(30) In equation (3), p and q are variables used in the integration. Accordingly, the optical transfer function H(.sub.x, .sub.y) is the normalized autocorrelation function of the amplitude transfer function (ATF). Geometrically, the optical transfer function is the overlap area of the ATF with a spatially shifted version of the ATF divided by the total area of the ATF.
(31) In accordance with one embodiments of the present invention, because each pixel 10 is sensitive to the light received from a different direction, each pixel captures the incident light differently. The intensity of the light arriving at the angle near the center of pixel 10.sub.i, namely I.sub.im.sub.
I.sub.im.sub.
(32) In equation (4), H.sub.i() represents the optical transfer function of pixel 10.sub.i, I.sub.tar() represents the intensity of the light received from the target, and * denotes the convolution operation.
(33) Since the imaging device has N pixels, the intensity of the light received by the N pixels may be represented by vector {right arrow over (I)}.sub.im() defined as shown below:
{right arrow over (I)}.sub.im()={right arrow over (H)}.sub..Math.()*{right arrow over (I)}.sub.tar()(5)
(34) In Equation (5), each entry in vector {right arrow over (I.sub..Math.m)}() represents the average light intensity received along the direction , {right arrow over (H)}() represents the vector of transfer functions, and {right arrow over (I)}.sub.tar() represents the average light intensity emanating from the target along the direction .
(35) Each vector in equation (5) may be represented by a matrix. Assuming M represents the discretization of the values in equation (5), vector {right arrow over (I)}.sub.im may be represented by a 1N matrix Y, vector {right arrow over (H)}() may be represented by an NM matrix H, and vector {right arrow over (I)}.sub.tar may be represented by an 1M matrix I:
(36)
(37) Accordingly, equation (5) may be shown in a matrix form as:
Y=H.Math.I(6)
(38) Referring to equation (6) because the matrix Y is obtained by the imaging device, in accordance with the present invention, and the transfer functions of the pixels represented by matrix H is also known, as described further below, the image of the target represented by matrix I can be computed.
(39)
(40)
(41)
(42)
(43)
(44)
(45)
(46) In one embodiment, curved path 80 may be a circular path. In another embodiment, curved path 80 may be an elliptical path. In yet other embodiments, curved path 80 may be an irregular curved path. Although the grating couplers 50.sub.i of the embodiment 250 are shown as having the same angular view, in other embodiments, two or more of the grating couplers may have different angular views. Although not shown, in yet other embodiments, an array of plasmonic antennas may be used to form a 3-D imaging device, in accordance with embodiments of the present invention.
(47)
(48)
(49) A lens-less 3D imaging device, in accordance with embodiments of the present invention, provides a number of advantages. For example, a lens-less 3D imaging device, in accordance with embodiments of the present invention, may project a coherent light onto a fluorescent target sample and thereby form an image at the wavelength radiated from the sample. The light radiated from the sample is non-coherent and thus allows for a non-coherent image reconstruction, as described above.
(50) A lens-less 3D imaging device formed using grating couplers, such as that shown in
(51) In accordance with some embodiments of the present invention, an array of pixels or directionally sensitive receiving elements may be tileable to form larger arrays. For example, each sensor or a sensor array may have a hexagonal or square shape that can be joined or tiled with other similar sensors or sensor arrays to form a relatively larger surface of sensing elements adapted capture 3D images. Such sensor or sensor arrays may be fully integrated with a controller or a processing unit (such as a central processing unit (CPU)) adapted to capture analog data, digitize the captured analog data and communicate the digitized data in a distributed or centralized network to perform the computations and processing, as described above, to form the image. The sensor arrays may be powered either internally or externally and may transfer both power and the data to other sensor arrays disposed in the 3-D imaging system. The data may then be transmitted using radio frequency inductive lines, by wires, or wirelessly. Furthermore, a distributed or centralized processing system may be implemented to reconstruct the image using the processing power of the sensing elements.
(52) In accordance with some embodiments of the present invention, an array of pixels or directionally sensitive receiving elements may be disposed on a flexible board/substrate, such as flexible printed circuit board (PCB). The flexible board may be bent to provide a curved surface so as to provide a multitude of receiving elements with otherwise the same angular views, different angular or directional sensitivity. Such flexible array may also be used to form a distributed conformal imaging device, such as on clothing fabric, e.g., a shirt. For example, referring to
(53) Image processing techniques may also be used to compute the curvature of the flexible board. To achieve this, in one embodiment, the curvature is determined by taking one or more images of a known scene/target and varying the curvature until the difference between the target and its image falls below a threshold value. In accordance with another embodiment, a machine or statistical learning algorithm may be used to determine the positions of the receiving elements based on the expectations of how the images should look like in reality.
(54) In yet other embodiments, an array of sensing elements may be formed on a semiconductor substrate that has a CMOS chip integrated therein. The chip may perform all necessary processing and computations to form the 3-D image and can communicate directly with other systems.
(55)
(56)
(57)
(58) In yet other embodiments, each of the pentagonal or hexagonal surfaces may be a printed circuit board (PCB) that includes respectively 5 or 6 directionally sensitive receiving elements, such as a photodiode. For example, PCB 600 shown in
(59) Similarly, for example, PCB 700 shown in
(60) The above embodiments of the present invention are illustrative and not limitative. The embodiments of the present invention are not limited by the number of receiving elements or pixels in the array or the number of array dimensions. The above embodiments of the present invention are not limited by the wavelength or frequency of the light. Other modifications and variations will be apparent to those skilled in the art and are intended to fall within the scope of the appended claims.