VOLUMETRIC METAOPTICS FOR MULTI-DIMENSIONAL WAVEFRONT SENSING
20260063474 ยท 2026-03-05
Inventors
- Conner K. Ballew (Pasadena, CA, US)
- Gregory D. ROBERTS (Alhambra, CA, US)
- Andrei Faraon (Pasadena, CA, US)
Cpc classification
International classification
Abstract
Methods and devices enabling simultaneous sorting light based on its wavelength, polarization, and direction of propagation are disclosed. The disclosed device maps different combinations of input light properties to different corresponding pixels on an underlying image sensor array, allowing for compressed sensing of multiple light properties simultaneously. The described devices can be designed using advanced inverse design and topology optimization techniques, including adjoint-based optimization and level-set methods. Exemplary performance results show smooth, predictable behavior for input states between the explicitly optimized states, allowing it to interpolate and classify a continuum of input light properties.
Claims
1. A device for multi-dimensional wavefront sensing, comprising: a three-dimensional (3D) structure configured to receive incident light; and a sensor array disposed underneath the 3D structure, the sensor array comprising multiple pixels; wherein the 3D structure is configured to focus different combinations of wavelength, polarization, and propagation direction of the incident light onto different corresponding pixels or combinations of pixels of the sensor array.
2. The device of claim 1, wherein the 3D structure is configured to maintain wavelength and polarization demultiplexing functionalities across a range of incident angles within an acceptance cone.
3. The device of claim 2, wherein the 3D structure comprises a stack of multiple layers.
4. The device of claim 3, wherein each layer of the stack comprises a first material with a first refractive index and a second material with a second refractive index being different from the first refractive index.
5. The device of claim 4, wherein the first material comprises silicon dioxide (SiO2) and the second material comprises titanium dioxide (TiO2).
6. The device of claim 1, wherein the 3D structure has dimensions of 3 m3 m4 m.
7. The device of claim 1, wherein the sensor array comprises a 33 array of pixels.
8. The device of claim 1, wherein the 3D structure is configured to perform wavelength demultiplexing, polarization sorting, and angle-dependent focusing simultaneously.
9. The device of claim 8, wherein the wavelength demultiplexing is configured to separate at least two distinct wavelengths.
10. The device of claim 8, wherein the polarization sorting is configured to separate at least two polarization states, including orthogonal linear states.
11. The device of claim 8, wherein the angle-dependent focusing is configured to focus at least five different incident angles to five different locations on the sensor array.
12. An optical system for multi-dimensional wavefront sensing, comprising: an array of devices, each device comprising: a three-dimensional (3D) structure configured to receive incident light; and a sensor array disposed underneath the 3D structure, the sensor array comprising multiple pixels; wherein each 3D structure is configured to focus different combinations of wavelength, polarization, and propagation direction of the incident light onto different pixels or combinations of pixels of a corresponding portion of the sensor array.
13. The optical system of claim 12, wherein each 3D structure in the array is identical.
14. The optical system of claim 12, wherein at least some of the 3D structures in the array have different configurations.
15. The optical system of claim 12, wherein the system is configured to perform light field imaging.
16. The optical system of claim 15, further comprising a tunable bandpass filter coupled to the array of devices to enable wavelength-dependent light field imaging.
17. The optical system of claim 12, configured to perform laser beam profiling, the laser beam profiling including classification of wavelength, polarization, and incident angle of the laser beam.
18. The system of claim 12, wherein each 3D structure is optimized using topology optimization based on adjoint-based inverse design.
19.-28. (canceled)
Description
DESCRIPTION OF THE DRAWINGS
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
DETAILED DESCRIPTION
[0027] Two-dimensional (2D) image sensors are the most common detectors for light. A leading optical engineering task is how to best extract the information from the incident optical field using an optical system and a planar image sensor. For example, a black and white camera maximizes the amount of spatial information by performing a one-to-one mapping between the direction of propagation and a pixel on the image sensor, but spectral and polarization information is lost. A line scan multispectral camera maps only one spatial coordinate to a direction on the image sensor while the other direction records the spectrum of the spatial pixel. Various other mappings are used in cameras to image color, polarization, light field, etc.
[0028] Since the information capacity of a 2D image sensor is finite, getting more information about some degrees of freedom for light comes at the expense of information in other degrees of freedom. Also, in general purpose systems with trivial mapping implementations that use conventional optical components like lenses, gratings, and prisms, a single pixel on the image sensor detects a specific combination of single degrees of freedom. For example, a camera may detect the combination of a specific direction, wavelength band, and polarization. Thus, if S spatial directions, W wavelength bands, and P polarizations need to be resolved, then SWP pixels are needed, where P is at most 4 to fully classify polarization through Stokes parameters.
[0029] In some applications, there is prior knowledge about the input light field, in which case it is possible to use mappings that more efficiently utilize the pixels of the sensor. According to embodiments of the present disclosure, an inverse designed volumetric meta-optic device can efficiently map different combinations of wavelengths, directions and polarizations into combinations of pixels on an image sensor. The compressed information can fully classify properties of the incident fields under certain approximations, namely that the wavefronts are monochromatic, locally linear in phase, and linearly polarized. The disclosed devices are based on metaoptics, which describes materials patterned with subwavelength resolution that impart customized transformations to incident light.
[0030]
[0031] According to the teachings of the present disclosure, the 3D structure (101) shown in
[0032] Continuing with the optical system (100A) of
[0033] For the purpose of demonstration, the exemplary optical system, similar to what was is shown in
[0034] The polarization and wavelength splitting functionalities are designed to work for all of the assumed incident angles, which include a normally incident case and non-normal incidences that are 5 degrees tilted from normal (polar angle 0=5) with azimuthal angles {0, 90, 180, 270}. The two design wavelengths are 532 nm and 620 nm. The two polarizations are linear and orthogonal, with one polarized in the xz-plane and the other in the yz-plane. The device is a 3 m3 m4 m stack of 20 layers. Each 200 nm layer is comprised of titanium dioxide (TiO.sub.2, n=2.4) and silicon dioxide (SiO.sub.2, n=1.5), with a minimum feature size of 50 nm. The background material is assumed to be SiO.sub.2.
[0035] Continuing with the same exemplary design as described above, the design of the 3D structure was initially optimized in a narrow wavelength range around 532 nm and 620 nm. However, it was observed that the behaviors of functionalities are preserved and predictable when excited at states in between the states the device was optimized for. For example, as the input wavelength is continuously shifted from 532 nm to 620 nm, the ratio of the 620 nm pixel transmission to the 532 nm pixel transmission monotonically increases, while the imaging and polarization functions remain efficient. This occurs, again as mentioned above, despite the device only being optimized in a narrow wavelength range around 532 nm and 620 nm. Similar behavior was observed in the imaging functionality when excited at input angles that were not explicitly optimized within a 5 cone. The read-out from these pixels can thus be used to infer the state of the light incident on the device so long as the input is assumed to be a monochromatic planewave. We find that this behavior does not depend on the chosen mapping of functionality to specific pixels in the focal plane by analyzing the behavior of devices optimized for 20 unique pixel distributions.
[0036] The performance of the exemplary embodiment described above can be quantified in two ways. First, the performance of the device under the excitation beams that were assumed when optimizing the device can be checked. This is referred to as training modes. Second, the device at different input angles, wavelengths, and polarization states may be studied to analyze its ability to classify states. This is referred to as validation modes.
[0037] According to the teachings of the present disclosure, the disclosed methods may be implemented to co-optimize 20 different training modes featuring unique combinations of wavelength, polarization, and angle of incidence. The transmission to each pixel for each input state is shown in
[0038] The design process optimizes the performance of the device only for the training modes, and it is unclear what the output of the device will be if the excitation parameters are continuously varied. The performance of the device at input states between that of the designed input states is quantified through by simulating the performance at wavelengths in between 532 nm and 620 nm, at a large set of angles within a 10 input angle cone, and at various polarization states.
[0039] Referring to
[0040] Curves (313L, 314L) of
[0041] Continuing with
[0042] The effect of altering the polarization state is predictable since the polarization state of any input excitation can be described by two orthogonal linearly polarized states with a relative amplitude and phase shift between the orthogonal components. As an example, a simple experiment involving a linearly polarized source input into a Wollaston prism would show that as the source is rotated, the output of the Wollaston prism fluidly shifts from one linearly polarized output beam to the other. This behavior is observed in the exemplary design discussed above in the polarizing functionality, where the ratio between the polarizer pixels transmission can be used to infer the relative power of the two orthogonal linear polarization states. However, it would be desirable that the device performance for the wavelength and imaging functionalities is not adversely affected by the polarization states that were not explicitly optimized for. The efficiency of these functionalities may be altered as the cross-polarized output of one beam interferes with the parallel-polarized output of the orthogonally polarized input beam. The amount of cross-polarization is defined by integrating the ratio |E.sub.x|.sup.2/E.sub.y|.sup.2 under yz-polarized illumination over the output plane for all incident angles. The highest amount of cross-polarization is-11.9 dB at 620 nm and 13.6 dB at 532 nm. To verify that the various functionalities are not strongly affected, the results of all functionalities at all possible input polarization states were analyzed by sweeping the relative amplitude and phase of the orthogonal input components, and it was observed that interference effects can alter the transmission to the various pixels by a few percent. According to the teachings of the present disclosure, if a particular design seeks to further minimize cross-polarization, then cross-polarization can be explicitly minimized during the optimization. Doing so will consume some design degrees of freedom, which may detract from the efficiency of the various functionalities, but the optimization will not require more time since the number of electromagnetic simulations per iteration will be unchanged.
[0043] Based on the previously detailed results, the embodiments such as the one shown in
[0044] While classifying the wavelength and input angle states without ambiguity is not significantly affected by the incident polarization state it does require that the incident light be a monochromatic planewave. The planewave assumption is a common assumption employed in Shack-Hartman sensors and plenoptic sensors, and the assumption of monochromaticity can be satisfied with color filters, or if the light fundamentally comes from a narrow-band source such as a laser. Thus, there are numerous applications in which the disclosed methods and devices can be useful. As an example, the 3D structures designed based on the disclosed teachings can be tiled across a sensor array to enhance the functionality of an image sensor. Such an array could be used to accurately classify the properties of a laser beam, including all fundamental properties of wavelength, polarization, and incident angle within the device's acceptance cone. The angle-dependent nature of the device is similar in principle to angle-sensitive CMOS pixels, and could be used for light field imaging since the incident wavefront angle can be computationally determined using the relative intensity of the imaging pixels. If coupled with a device such as a tunable bandpass filter, then a wavelength-dependent light field image can be obtained, with the added functionality of measuring the relative intensity of the two orthogonal linear polarization components for basic polarimetry. The disclosed methods and devices open up new degrees of freedom in computational imaging applications.
[0045] Referring back to the embodiment of
[0046] There could be a large number of pixel permutations. Twenty different pixel distributions were considered and analyzed. Pixel distributions were chosen randomly, but were chosen to be sufficiently different from the original device by satisfying two criteria: 1) all pixels had to be moved from their original location, 2) no pixel could be rotated by 90, 180, or 270 degrees, thus ensuring that devices were not similar by any rotational symmetry. Each device was optimized until the device was more than 15% binary according to the following equation, where B is the binarization, N is the total number of permittivity points in the design region, Eris the permittivity at the Ah point, and Emin and Emax are the smallest and largest values of permittivity allowed in the design
The angular response of each functionality (the plots in
For each functionality, the overlap integral for all combinations of devices was evaluated. Each result is plotted as a scatter point shown in
[0047] With further reference to
[0048] The goal of photonic topology optimization is to find a refractive index distribution that maximizes an electromagnetic figure-of-merit (FoM). According to the teachings of the present disclosure, for highly multi-functional structure, the associated optimization is multi-objective. Each objective is a mapping of an input to a FOM: the input is a planewave with a specific angle, polarization, and wavelength; the FoM is the power transmission through the desired pixel. The general procedure for this optimization is shown in
[0049] The individual FoM gradients are evaluated at every point in the design region using the adjoint method, which entails combining the electric fields in the design region for a forward, step (55), and an adjoint simulation, step (56) to compute the desired gradient. In this case, the forward case simulates the device under the assumed planewave excitation, and the adjoint case simulates a dipole (with a particular phase and amplitude based on the forward simulation) placed at the center of the desired pixel. This choice of sources optimizes the device to focus light to the location of the dipole. However, we record the performance of the device as power transmission through the desired pixel rather than intensity at a point, since power transmission better represents the signal a sensor pixel would record.
[0050] The optimization is performed in two phases: a density-based phase, and a level-set phase. Each phase has a unique update procedure. In the density-based optimization the permittivity of the device is modelled as a grid of grayscale permittivity values between the permittivity of the two material boundaries. This permittivity representation is effectively fictitious (unless an effective index material can be reliably fabricated), and the goal is to converge to a binary device that performs well and is comprised of only two materials.
[0051] While the density-based optimization can converge to a fully binary solution, it is faster to terminate the optimization early and force each device voxel to its nearest material boundary. This thresholding step reduces the device performance, which we recover by further optimizing the device with a level-set optimization. Level-set optimization models the device boundaries as the zero-level contour of a level-set function ((x, y)=0), and thus benefits from describing inherently binary structures. Empirically the final device performance is dependent on initial seed, hence the need for the improved density-based optimization that converges to a near-binary solution. Here we use level-set techniques to simultaneously optimize device performance and ensure the final device obeys fabrication constraints.
[0052] With reference to step (53) of
[0053] According to the teachings of the present disclosure, fabrication restrictions during the level-set optimization are preserved. To that end, a multi-dimensional fabrication penalty function is first analytically computed over the entire device region. In an embodiment, this function includes two types of fabrication constraints: one limits the radius of curvature of the device boundaries, and the other limits the smallest gap size of the device. The terms are integrated over the entire design region, yielding a real number (the fabrication penalty term) that we wish to minimize. The gradient of this fabrication penalty term is computed over the device region using a finite-difference approximation and is subsequently combined with the gradient of the electromagnetic FoM that is computed through the adjoint method, as indicated by step (56) of
[0054]
[0055] The density-based optimization is considered converged when the binarization, which is defined by Eq. 1 is nearly 100%. At various points, the binarization is forced to increase by passing the permittivity through a sigmoidal function and changing the device permittivity to the output of this function. The FoM is then allowed to recover before repeating this discrete push in binarization. At some iteration, e.g. iteration 512 in the case shown in
[0056] With further reference to
[0057]
[0058] In what follows, a breakdown/summary of the optimization algorithm in accordance with the teachings of the present disclosure is provided:
1. Initial Density-Based Optimization:
[0059] The device is initially modeled as a grid of continuous permittivity values between the two material boundaries (e.g., TiO2 and SiO2). [0060] Multiple figures of merit (FoM) functions are defined, corresponding to different desired optical functionalities (e.g., wavelength sorting, polarization sorting, and angle-dependent focusing). [0061] The optimization uses the adjoint method to efficiently compute gradients of the FoMs with respect to the permittivity distribution. [0062] A multi-objective optimization is performed, combining the gradients of different FoMs using a weighted average. [0063] The permittivity distribution is updated iteratively based on the combined gradient.
2. Binarization Process:
[0064] Throughout the density-based optimization, the algorithm periodically pushes the design towards a more binary state. [0065] This is performed by passing the current permittivity distribution through a sigmoidal function. [0066] After each binarization step, the optimization continues to allow the FoM to recover. During this recovery, binarization is forbidden from decreasing using the methods described in
3. Transition to Level-Set Optimization:
[0067] Once the density-based optimization reaches a near-binary state (e.g., around 90% binary), the optimization switches to a level-set approach. [0068] The device structure is now represented by a level-set function (LSF), where the device boundaries are defined by the zero-level contour of the LSF.
4. Level-Set Optimization:
[0069] The LSF is initialized based on the final state of the density-based optimization. [0070] The optimization now updates the LSF, which in turn modifies the device boundaries. [0071] This phase incorporates both electromagnetic performance and fabrication constraints. [0072] Two types of fabrication constraints are included: [0073] Minimum radius of curvature for device boundaries [0074] Minimum gap size between features (e.g. 60 nm) [0075] A fabrication penalty term is computed analytically over the entire design region. [0076] The gradient of this penalty term is combined with the electromagnetic FoM gradient. [0077] The LSF is perturbed based on this combined gradient, optimizing both performance and manufacturability.
5. Iterative Refinement:
[0078] The level-set optimization continues iteratively until the FoM converges and the fabrication penalty term is minimized. [0079] After each update, the LSF is recomputed to ensure it remains a signed-distance function.
[0080] This disclosed methods and devices provide the following benefits: [0081] 1) The simultaneous sorting of wavelength, polarization, and incident angle is an advancement of existing art which is essentially based on sorting only wavelengths and polarization. This enhancement allows for predictable control of all fundamental properties of light within a single component. [0082] 2) The device performance was found to behave well for inputs whose parameters lie between the states the device was trained on. This well-behaved interpolating behavior was true for wavelength, polarization, and incident angle. This has not been disclosed in prior art and the results suggest a promising avenue towards increasing generalizability and computation feasibility of inverse-design. [0083] 3) The importance of mapping specific functions to specific pixels in the focal plane was studied and showed a remarkable insensitivity to this mapping. Previous work in this field involved only four pixels per volumetric device, so very few permutations were available. The present work involves nine pixels and studied 20 non-symmetric permutations.
[0084] The scale of the disclosed optimization method is also substantially larger than prior works. In addition to the increased number of outputs/pixels, the increased functional complexity required a thicker device to realize reasonable efficiencies. This adds to the total number of optimized points within the design volume. At this larger scale, it was empirically found that standard methods of incorporating fabrication constraints failed. Most notably the binarization constraint that restricts the ultimate design to only two materials failed, which is typically enforced through the application of a sigmoidal function to the device gradients. However, this is a soft constraint that operates by scaling gradients and does not strictly enforce binarization at finite sigmoid strengths. To address this, a method that incorporates a hard constraint on binarization is provided. The method identifies the direction of steepest ascent that simultaneously increases binarization by a certain user-set, non-zero amount. This iterative update strategy enforces the design ultimately converges to a binary design.