RECONFIGURABLE POLARIZATION IMAGING SYSTEM
20220268632 · 2022-08-25
Inventors
Cpc classification
G01J3/0229
PHYSICS
International classification
Abstract
Methods, apparatus and systems that relate to a low-cost reconfigurable polarimetric imaging are described. One example polarization imaging system includes a lens positioned to receive light reflected from one or more objects, and a spectral-polarization filter positioned at an aperture plane of the lens to filter the light received by the lens. The polarization imaging system can further include a sensor positioned to detect the filtered light from the spectral-polarization filter to form a polarization image of the one or more objects. The spectral-polarization filter comprises a first array of multiple spectral filters and a second array of multiple polarizers.
Claims
1. A polarization imaging system, comprising: a first lens or set of lenses positioned to receive light from one or more objects; and a spectral-polarization filter positioned at an aperture stop of the polarization imaging system to filter the received light, the spectral-polarization filter comprising an array of multiple spectral filters and an array of multiple polarizers that are positioned in cascade to modify both spectral content and polarization of the light that enters the spectral-polarization filter; wherein the light that exits the spectral-polarization filter is directed to a sensor positioned to detect filtered light from the spectral-polarization filter at an image plane of the polarization imaging system.
2. The system of claim 1, comprising a second lens or a set of lenses positioned between the spectral-polarization filter and the image plane to direct the filtered light from the spectral-polarization filter to the sensor.
3. The system of claim 1, wherein the multiple polarizers include at least one of a linear, circular, or an elliptical polarizer, and wherein each of the polarizes is configured to change either a degree or a state of polarization of light incident thereon.
4. The system of claim 1, wherein the multiple polarizers include polarizers that are configured to produce different polarization states.
5. The system of claim 1, wherein the multiple spectral filters include at least three bandpass filters.
6. The system of claim 1, wherein the spectral-polarization filter comprises a layer of transparent material positioned between the array of multiple spectral filters and the array of multiple polarizers.
7. The system of claim 6, wherein the transparent material includes a parallel plate glass.
8. The system of claim 1, wherein centers of the array of multiple spectral filters and the array of multiple polarizers are aligned with respect to one another to allow rotation of one array with respect to the other array.
9. The system of claim 1, wherein the polarization imaging system includes the sensor that comprises a spectral filter that allows different spectral ranges of light to pass therethrough.
10. The system of claim 9, wherein a spatial resolution of an image captured by the sensor in the presence of the spectral-polarization filter is unchanged from a spatial resolution of an image captured by the sensor without the spectral-polarization filter.
11. The system of claim 9, wherein the sensor includes a red-green-blue (RGB) filter or an RGB-near-infrared (RGB-NIR) filter.
12. The system of claim 1, wherein one or both of the array of multiple spectral filters or the array of multiple polarizers is removably positioned in the polarization imaging system to allow replacement of one or both of the arrays with another array of multiple spectral filters or multiple polarizers.
13. A polarization imaging system, comprising: a spectral-polarization filter positioned at an entrance lens of the polarization imaging system to filter light received from an object, the spectral-polarization filter comprising an array of multiple spectral filters and an array of multiple polarizers that are positioned in cascade to modify both spectral content and polarization of the light that enters the spectral-polarization filter; and a mount or a bracket configured to hold the spectral-polarization filter at the entrance lens, and to allow one or both of the array of multiple spectral filters or the array of multiple polarizers to be replaced with another array of multiple spectral filters or multiple polarizers, wherein the light that exits the spectral-polarization filter is directed to a sensor positioned to detect filtered light from the spectral-polarization filter at an image plane of the polarization imaging system.
14. A method for polarization imaging, comprising: positioning a spectral-polarization filter at an aperture stop or in front of a lens that is configured to receive light from one or more objects, wherein the spectral-polarization filter comprises a first array of multiple spectral filters and a second array of multiple polarizers; and obtaining a polarization image of the one or more objects using a sensor that is positioned to detect filtered light from the spectral-polarization filter.
15. The method of claim 14, wherein the multiple polarizers include at least one of a linear, circular, or an elliptical polarizer.
16. The method of claim 14, wherein the multiple polarizers include polarizers that are configured to produce different polarization states.
17. The method of claim 14, wherein the multiple spectral filters include at least three bandpass filters.
18. The method of claim 14, further comprising: rotating one or both of the first array of the multiple spectral filters or the second array of the multiple polarizers with respect to each other to obtain different combinations of the multiple spectral filters and the multiple polarizers.
19. The method of claim 14, further comprising: replacing one or both of the first array of the multiple spectral filters or the second array of the multiple polarizers with another array of multiple spectral filters or multiple polarizers to obtain a different combination of the multiple spectral filters and the multiple polarizers.
20. The method of claim 14, wherein each of the multiple polarizers is configured to change either a degree or a state of polarization of light incident thereon.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0007]
[0008]
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
[0019]
[0020]
[0021]
DETAILED DESCRIPTION
[0022] The techniques disclosed herein overcome the shortcomings of prior systems and can be implemented in various embodiments to provide a reconfigurable polarimetric imaging system that uses spectral-polarization filters.
[0023]
[0024]
[0025]
[0026] In some embodiments, the array of polarizers 120 includes polarizers that produce different polarization states. For example, as shown in
[0027] Typically, three bandpass filters are used for the conventional color camera, corresponding to the Red, Green, and Blue (RGB) channels. However, a filter plate with four or more bandpass filters can be implemented for the sensor. For example, in some embodiments, a sensor with Blue (B), Green (G), Red (R), and near infrared (NIR) channels can be constructed as well.
[0028]
[0029] In one experimental setup, a conventional color camera (BFS-U3-51S5C-C, FLIR) with 2448×2048 pixels was used as the detector. A commercial chromatic polarization camera (PHX505-QC, Lucid) with the same number of pixels (2448×2048) was used to compare the performance. The chromatic polarization camera used Sony's IMX250MZR polarization CMOS sensor, in which each of the RGB channels can obtain four images with 0°, 45°, 90°, and 135° linear polarization. Three spectral-polarization filters were prepared to demonstrate the reconfigurability to capture circular, linear and elliptical polarized information as shown in
[0030] It is noted that the image contrast may be slightly lower than the ordinary color camera due to stray light, diffraction, and pupil obscuration caused by the filter boundaries and mechanical mount. To calibrate the setup to minimize the errors from the crosstalk among the three spectral filters, the uniform white light emitting from the integrating sphere was used as the light source. First, the three spectral filters were positioned separately in front of the camera. The exit port of the integrating sphere was imaged and the response ratio in different color channels of the imaging sensor was calculated. The intensity obtained in the camera can be expressed as:
I.sub.R=n.sub.R.sup.RI.sup.R+n.sub.R.sup.GI.sup.G+n.sub.R.sup.BI.sup.B
I.sub.G=n.sub.G.sup.RI.sup.R+n.sub.G.sup.GI.sup.G+n.sub.G.sup.BI.sup.B,
I.sub.B=n.sub.B.sup.RI.sup.R+n.sub.B.sup.GI.sup.G+n.sub.B.sup.BI.sup.B Eq. (1)
[0031] Here, n represents the transmittance ratio. (R, G, B) in the subscript represent the color channel of the imaging sensor, and (R, G, B) in the superscript represent the spectral bandpass filter. I.sup.R, I.sup.G and I.sup.B are the transmission after the spectral-polarization filters, and each transmission has a certain polarized state. I.sub.R, I.sub.G and I.sub.B are the images captured by RGB channels of the color camera, respectively, as, for example, shown in the configuration illustrated in
[0032] Therefore, I.sup.R, I.sup.G, I.sup.B can be obtained by solving Eq. (2), where the error of the crosstalk can be eliminated, as:
[0033] Finally, a linear polarizer was placed in front of the integrating sphere and the polarizer was rotated with a step of 2° and the images were captured with the filter as shown, for example, in
I.sub.cal=(I−I.sub.min)/(I.sub.max−I.sub.min). Eq. (4)
[0034] Here, I.sub.max and I.sub.min are the maximum and minimum values of the normalized averaged intensity. The calibrated normalized averaged intensities are shown in
[0035] One of the advantages of the disclosed polarimetric imaging system, as compared to the commercial chromatic polarization cameras with a focal plane polarizer array, is the high spatial resolution. It is known that, in the chromatic polarization camera, each pixel can only sense one polarization state of one color. Thus, 4×4 pixels are needed to obtain the color and polarization properties of one single object point. Using the disclosed techniques, the spatial resolution of the polarimetric imaging system is the same as conventional color cameras, which means the spatial resolution is two times higher than that of the commercial chromatic polarization cameras.
[0036] As best understood, currently, there is no commercial polarization sensor that can simultaneously capture circular or elliptical polarization images together with linear polarization image. Using the disclosed techniques, however, it is extremely easy to capture different states of polarizations at the same time. The array configuration of the spectral-polarization filter also provides great configurability for different applications.
[0037] In another example experimental setup, a filter as shown in
[0038] Some reflectance imaging experiments have been carried out to further demonstrate the system reconfigurability. Reflectance images of a quarter coin illuminated with linear polarized white light are captured first. Here, filters as shown in
[0039] The depolarization of the reflectance can be assumed as being wavelength independent because the object is made of metal. Therefore, the polarized state in RGB channels can be treated as being uniform. Here, the degrees of linear polarization (DoLP) and the degree of circular polarization (DoCP) are used to measure the polarized properties of the images. DoLP and DoCP are defined as:
[0040]
[0041] Here, I.sub.E(30) and I.sub.E(−30) are the images of two elliptical channels. The calculated DoEP is shown in
[0042] In some cases, circular and elliptical components cannot be simultaneously identified using one single filter. For the object with spectrum-dependent polarization properties, while the polarization properties cannot be estimated accurately from the extracted polarization images at different spectral from a single image, it is easy to take one or two additional images by simply rotating the bandpass filter plate relatively to the polarizer plate to calculate DoLP and DoCP simultaneously. A plastic plate with uniform linearly polarized white light is used to demonstrate the feasibility. Three images were taken using the spectral-polarization filter shown in
[0043] It is thus evident that the disclosed technique herein can be implemented to obtain a simple, low-cost reconfigurable snapshot polarimetric imaging system based on spectral-polarization filtering. To facilitate reconfigurability, the spectral-polarization filter can be positioned at the aperture stop (or at the entrance pupil of the system) using one or more brackets or mounts that allows ready replacement (e.g., swapping in and out) of the spectral or polarization arrays. The mount/bracket can be further designed to facilitate calibration and alignment of the filter with respect to other components of the system. For example, the mount or bracket can be movable in both x-, y- and z-directions, and can be further configured to rotate to provide different combinations of spectral-polarization filtering, as discussed earlier.
[0044] Experimental results demonstrate that, for wavelength-independent applications, the disclosed polarimetric imaging technique can obtain linear, circular or elliptical polarization information in a snapshot depending on the combination of the spectral-polarization filter. For wavelength-dependent applications, the full polarization information for each color channel can also be obtained by changing or rotating the spectral-polarizer filters.
[0045] Compared to the expensive commercial polarization camera with focal plane pixelated linear polarizer array (which can cost over $2,000), the disclosed techniques provide at least two key advantages. The first is that the spatial resolution is higher without instantaneous field-of-view (IFOV) error. In addition, the pixel number can be much higher than that in the commercial polarization cameras. The second advantage is the reconfigurability of the filter. The measurable polarization properties are not limited by the built-in focal plane pixelated linear polarizer array. By replacing the spectral-polarization filter, various wavelength-dependent polarization properties, including circular and elliptical polarization properties, can be measured. This is particularly valuable to measure wavelength-dependent polarization properties with unconventional spectral camera, such as RGB-NIR camera.
[0046]
[0047] In some example embodiments, the multiple polarizers include at least one of a linear, circular, or an elliptical polarizer. In another example embodiment, the multiple polarizers include polarizers that are configured to produce different polarization states. In yet another example embodiment, the multiple spectral filters include at least three bandpass filters. In some example embodiments, each of the multiple polarizers is configured to change either a degree or a state of polarization of light incident thereon.
[0048] In some example embodiments, the method described in
[0049] The disclosed technology can be used for different applications, including but not limited to, imaging, security, underwater imaging, 3D imaging and reconstruction, and other areas of technology that can benefit from a low cost and reconfigurable polarization imaging system.
[0050] One aspect of the disclosed technology relates to a polarization imaging system that includes a first lens or set of lenses positioned to receive light from one or more objects; and a spectral-polarization filter positioned at an aperture stop of the polarization imaging system to filter the received light, the spectral-polarization filter comprising an array of multiple spectral filters and an array of multiple polarizers that are positioned in cascade to modify both spectral content and polarization of the light that enters the spectral-polarization filter; wherein the light that exits the spectral-polarization filter is directed to a sensor positioned to detect filtered light from the spectral-polarization filter at an image plane of the polarization imaging system.
[0051] In some example embodiments, the polarization imaging system comprises a second lens or a set of lenses positioned between the spectral-polarization filter and the image plane to direct the filtered light from the spectral-polarization filter to the sensor. In other example embodiments, the multiple polarizers of the polarization imaging system include at least one of a linear, circular, or an elliptical polarizer, and wherein each of the polarizes is configured to change either a degree or a state of polarization of light incident thereon. In an example embodiment, the multiple polarizers of the polarization imaging system include polarizers that are configured to produce different polarization states. In an example embodiment of the polarization imaging system, the multiple spectral filters include at least three bandpass filters. In yet another example embodiment of the polarization imaging system, the spectral-polarization filter comprises a layer of transparent material positioned between the array of multiple spectral filters and the array of multiple polarizers. In some example embodiments, the transparent material includes a parallel plate glass. In some example embodiments, centers of the array of multiple spectral filters and the array of multiple polarizers are aligned with respect to one another to allow rotation of one array with respect to the other array. In some example embodiments, the polarization imaging system includes the sensor that comprises a spectral filter that allows different spectral ranges of light to pass therethrough. In an example embodiment of the polarization imaging system, a spatial resolution of an image captured by the sensor in the presence of the spectral-polarization filter is unchanged from a spatial resolution of an image captured by the sensor without the spectral-polarization filter. In an example embodiment of the polarization imaging system, the sensor includes a red-green-blue (RGB) filter or an RGB-near-infrared (RGB-NIR) filter. In some example embodiments, one or both of the array of multiple spectral filters or the array of multiple polarizers is removably positioned in the polarization imaging system to allow replacement of one or both of the arrays with another array of multiple spectral filters or multiple polarizers.
[0052] Another aspect of the disclosed technology relates to a polarization imaging system that includes a spectral-polarization filter positioned at an entrance lens of the polarization imaging system to filter light received from an object, the spectral-polarization filter comprising an array of multiple spectral filters and an array of multiple polarizers that are positioned in cascade to modify both spectral content and polarization of the light that enters the spectral-polarization filter; and a mount or a bracket configured to hold the spectral-polarization filter at the entrance lens, and to allow one or both of the array of multiple spectral filters or the array of multiple polarizers to be replaced with another array of multiple spectral filters or multiple polarizers, wherein the light that exits the spectral-polarization filter is directed to a sensor positioned to detect filtered light from the spectral-polarization filter at an image plane of the polarization imaging system.
[0053] While this patent document contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this patent document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
[0054] Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Moreover, the separation of various system components in the embodiments described in this patent document should not be understood as requiring such separation in all embodiments.
[0055] It is understood that the various disclosed embodiments may be implemented individually, or collectively, in devices comprised of various optical components, electronics hardware and/or software modules and components. These devices, for example, may comprise a processor, a memory unit, an interface that are communicatively connected to each other, and may range from desktop and/or laptop computers, to mobile devices and the like. The processor and/or controller can perform various disclosed operations based on execution of program code that is stored on a storage medium. The processor and/or controller can, for example, be in communication with at least one memory and with at least one communication unit that enables the exchange of data and information, directly or indirectly, through the communication link with other entities, devices and networks. The communication unit may provide wired and/or wireless communication capabilities in accordance with one or more communication protocols, and therefore it may comprise the proper transmitter/receiver antennas, circuitry and ports, as well as the encoding/decoding capabilities that may be necessary for proper transmission and/or reception of data and other information. For example, the processor may be configured to receive electrical signals or information from the disclosed sensors (e.g., CMOS sensors), and to process the received information to produce images or other information of interest.
[0056] Various information and data processing operations described herein may be implemented in one embodiment by a computer program product, embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by computers in networked environments. A computer-readable medium may include removable and non-removable storage devices including, but not limited to, Read Only Memory (ROM), Random Access Memory (RAM), compact discs (CDs), digital versatile discs (DVD), etc. Therefore, the computer-readable media that is described in the present application comprises non-transitory storage media. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes
[0057] Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in this patent document.