SPECTRALLY-SCANNED HYPERSPECTRAL ELECTRO-OPTICAL SENSOR FOR INSTANTANEOUS SITUATIONAL AWARENESS
20190323888 ยท 2019-10-24
Inventors
Cpc classification
H04N23/81
ELECTRICITY
G01N21/25
PHYSICS
G01J3/0229
PHYSICS
G01J3/0208
PHYSICS
H04N23/67
ELECTRICITY
H04N23/58
ELECTRICITY
G01J5/085
PHYSICS
G02B27/0068
PHYSICS
G02B26/007
PHYSICS
International classification
Abstract
A spectrally-scanned hyperspectral EO sensor trades the temporal properties of spectral information content for instantaneous situation awareness by capturing an image frame and scanning the spectral scene (wavelength) to build up spectral content. The objective optical system, preferably including a chromatic aberration enhancing device, separates spectral components of the incident radiation. A focus cell is used to adjust a relative axial focus position of the objective optical system with respect to a detector to at least two different axial focus positions to adjust the image position and read out an image frame for a spectrally-weighted component. A processor computes a relative spatial image contrast from a plurality of image frames at different wavelengths as a function of encoded focus cell position. A mechanism may be configured to move the enhancing device in and out of the optical path to form a dual gray-scale and hyperspectral EO sensor. Existing sensors may be retrofit to form the hyperspectral or dual-mode EO sensor.
Claims
1. A spectrally-scanned hyperspectral electro-optic (EO) sensor, comprising an objective optical system that forms an image on an optical axis from incident optical radiation simultaneously collected within a field of view (FOV), said objective optical system separating spectral components of the incident radiation along the optical axis with an axial chromatic aberration of at least f/100 where f is a prime axial focus position, said separation of spectral components providing a change in spatial image contrast as a function of position along the optical axis; a detector spaced along the optical axis that converts incident optical radiation into an electrical signal representative of an entire image frame; and a focus cell configured to temporally adjust a relative axial focus position of the objective optical system with respect to said detector to at least two different axial focus positions, wherein said electrical signal is temporally encoded by the at least two different axial focus positions and a corresponding image frame.
2. The EO sensor of claim 1, wherein said axial chromatic aberration is at least f/30.
3. The EO sensor of claim 1, wherein said objective optical system comprises an uncorrected objective optical system that comprises an objective element formed of a material with dispersion defined by an Abbe number less than 100 without a complementary optical element of a different dispersion and opposite optical power.
4. The EO sensor of claim 3, wherein said objective optical system comprises: a chromatic aberration enhancing device configured to further separate the spectral components of the incident optical radiation in the FOV along the optical axis.
5. The EO sensor of claim 1, wherein said objective optical system comprises: a chromatic aberration enhancing device configured to separate the spectral components of the incident optical radiation in the FOV along the optical axis.
6. The EO sensor of claim 5, wherein said chromatic aberration enhancing device comprises a diffractive optical element.
7. The EO sensor of claim 6, wherein said diffractive optical element comprises a kinoform gray-scale diffractive optical element.
8. The EO sensor of claim 5, wherein said objective optical system comprises an achromatic corrected objective optical system.
9. The EO sensor of claim 8, further comprising a mechanism to move the chromatic aberration enhancing device in and out of an optical path along the optical axis, wherein said focus cell is configured to adjust the relative focus to bring the system into focus at the prime focus position when the enhancing device is out of the optical path, wherein the electrical signal is encoded with a single gray-scale image frame at the prime focus position.
10. The EO sensor of claim 1, wherein said one or more detectors comprise a monochromatic imaging detector whose bandwidth spans the spectral content at the different axial focus positions.
11. The EO sensor of claim 1, in which the temporal adjustment of the relative axial focus position constitutes the only scanning in the sensor.
12. The EO sensor of claim 1, further comprising: a processor configured to compute a relative spatial image contrast metric within an image comprising one or more image frames as a function of encoded focus cell position and the prime focus position for a component of the spectral distribution of the incident optical radiation.
13. The EO sensor of claim 12, wherein at each axial focus position the processor is configured to record the axial focus position, time tag and assign a number to each image frame, assess a spatial image contrast metric for each said image frame and compute the relative spatial image contrast metric from one image frame across all of the image frames recorded.
14. The EO sensor of claim 13, wherein the processor is configured to compute the relative spatial image contrast as a measure of energy on detector (EOD) as a function of focus cell position.
15. The EO sensor of claim 13, wherein the processor is configured to compute the relative spatial image contrast metric by segmenting the image into multiple sub-regions and encoding the sub-regions by measuring a spatial image contrast in each sub-region as a function of the focus cell's axial prime focus position.
16. The EO sensor of claim 13, wherein the processor is configured to compute the relative spatial image contrast metric to estimate a temperature of an object in the sensor FOV.
17. The EO sensor of claim 13, wherein the processor is configured to generate an integrated image estimate of a gray-scale image from the plurality of image frames.
18. An electro-optic (EO) sensor, comprising a corrected objective optical system that forms an image along an optical axis from incident optical radiation simultaneously collected within a field of view (FOV), said objective optical system corrected to reduce separation of spectral components of the incident radiation along the optical axis to an axial chromatic aberration of at most f/2,000 where f is a prime focus position; a chromatic aberration enhancing device configured to separate the spectral components of the incident optical radiation in the FOV along the optical axis with an axial chromatic aberration of at least f/100, said separation of spectral components providing a change in spatial image contrast as a function of position along the optical axis; a mechanism configured to move the chromatic aberration enhancing device in and out of an optical path along the optical axis; a detector spaced along the optical axis that converts incident optical radiation into an electrical signal representative of an entire image frame; and a focus cell configured to temporally adjust a relative axial focus position of the objective optical system with respect to said detector to at least two different axial focus positions, a processor configured to alternately command the mechanism to move the enhancing device out of the optical path, command the focus cell to adjust the relative focus to the prime axial focus position and to process the electrical signal to extract a gray-scale image frame, command the mechanism to move the enhancing device into the optical path, command the focus cell to adjust the relative focus to at least two different axial focus positions and to process the electrical signal, which is temporally encoded by the at least two different axial focus positions and a corresponding image frame, to compute a relative spatial image contrast metric within an image comprising one or more of the image frames as a function of encoded focus cell position and the prime focus for a component of the spectral distribution of the incident optical radiation.
19. A method of retrofitting an existing gray-scale EO sensor to be useful as a hyperspectral EO sensor, said gray-scale EO sensor comprising a corrected objective optical system that forms an image on an optical axis from incident optical radiation simultaneously collected within a field of view (FOV), said objective optical system corrected to reduce the separation of spectral components of the incident radiation along the optical axis to an axial chromatic aberration of at most f/2,000 where f is a prime axial focus position, a broadband detector that converts incident optical radiation into an electrical signal representative of an entire image frame, and a focus cell configured to adjust a relative axial focus position of the objective optical system with respect to said detector to the prime axial focus position, the method comprising: placing a chromatic aberration enhancing device in an optical path along the optical axis, said chromatic aberration enhancing device configured to separate the spectral components of the incident optical radiation in the FOV along the optical axis with an axial chromatic aberration of at least f/100, said distribution of spectral components providing a change in spatial image contrast as a function of position along the optical axis; commanding the focus cell to adjust the relative focus to at least two different axial focus positions; generating an electrical signal, which is temporally encoded by at least two different axial focus positions and a corresponding image frame; and processing the electrical signal to compute a relative spatial image contrast metric within an image comprising one or more image frames as a function of encoded focus cell position and the prime focus for a component of the spectral distribution of the incident optical radiation.
20. The method of claim 19, in which the existing gray-scale EO sensor is useful as a dual-mode gray-scale and hyperspectral EO sensor, further comprising: configuring a mechanical switch to alternately move the chromatic aberration enhancing device in and out of the optical path; commanding the mechanism to move the enhancing device out of the optical path; and generating an electrical signal that is encoded with a gray-scale image frame.
21. The method of claim 19, wherein the existing EO sensor is implemented in a cell phone, wherein the chromatic aberration enhancing device is moveably attached to the cell phone in the optical path to a cell phone camera.
22. The method of claim 20, wherein the existing gray-scale EO sensor includes a filter wheel that includes a clear window section and an optical function section, wherein the chromatic aberration enhancing device is mounted on a section of the filter wheel.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
DETAILED DESCRIPTION OF THE INVENTION
[0029] As objects/targets become increasingly complex and instantaneous situational awareness over the entire FOV is required, it is preferred in many situations that the hyperspectral EO sensor trade the temporal properties of spectral information content for instantaneous situational awareness (i.e. collect an instantaneous 2D image over the scanned spectral scene (wavelength)) rather than scan the spatial scene per convention. To get instantaneous situational awareness we build up spectral content over time and must accept some degradation of individual image frames as well as with the final composite gray-scale image. The trade lies in the acceptance of some spatial resolution degradation due to an image pedestal created from the out of focus spectral components around an image (tightly focused spot) created from the in focus spectral component at any given image frame.
[0030] Objective optical systems are typically formed of one or more optical elements made from glass. The index of refraction of any glass varies with wavelength. As such, the optical elements tend to separate the incident photons by spectral content along the optical axis. This property of refractive optical systems is traditionally referred to as chromatic aberration. Optical designers go to great lengths to correct/minimize chromatic aberration. To achieve this correction, optical designers typically couple glasses with disparate powers and dispersion in a doublet form (negative and positive powered lenses bonded together). This concept has been extended over the years with more complex arrangements to balance multiple wavelengths within the spectrum the optical system is designed for. In the simplest case, a designer can achieve a reduction in transverse axial chromatic aberration from dff/30 to dff/2200, where df is the distance along the optical axis between the prime focus of the blue light and the prime focus of red light in the visible spectrum. This reduction in axial chromatic aberration makes it nearly impossible to perceive changes in optical blur as a function of wavelength. A corrected objective optical system is often referred to as achromatic.
[0031] To implement a hyperspectral EO sensor capable of trading the temporal properties of spectral information content for instantaneous situational awareness, we go against convention and configure the objective optical system to exhibit sufficient chromatic aberration (at least f/100) to separate spectral components of the incident radiation along the optical axis. This may be accomplished in a variety of ways, including adding a chromatic aberration enhancing device (CAED) (e.g. a diffractive optical element) to an achromatic objective optical system or using an uncorrected objective optical system designed to separate spectral components. A focus cell, suitably the focus cell present in the monochromatic EO sensor used to adjust the prime axial focus, is used to temporally adjust a relative axial focus position between the objective optical system and the detector to read-out a full spatial resolution image for a spectrally-weighted component. A processor processes two or more images at different axial focus positions (focus wavelengths) to compute a relative spatial image contrast metric to characterize an object/target in the sensor's FOV. For example, the prime focus position may correspond to a green wavelength. The focus cell may be adjusted to separately capture image frames at red, green and blue focus wavelengths to temporally build the spectral content of the image. The trade in this approach lies in the acceptance of some degradation in the quality of each R, G, B image frame and the composite gray-scale image. This spectrally-scanned hyperspectral EO sensor provides full spatial resolution hyperspectral images at significantly reduced cost and volume compared to the spatially-scanned counterparts by eliminating the mechanical scanning mirror and corresponding optics. The trade-off for this reduced cost/volume and improved instantaneous situational awareness is a decrease in spatial resolution due to the increased blur from out of focus spectrally-weighted components at different detector positions.
[0032] Corrected, uncorrected and chromatic aberration enhanced objective optical systems are illustrated in
[0033] A diffractive optical element uses the wave properties of electromagnetic radiation to modify the propagation of that energy. Due to its dependence on the wave nature of radiation, longer wavelengths are diffracted at larger angles. This diffractive behavior can be used to design a lens-like object that is able to create an image, with the caveat that the properties of that lens change as a function of wavelength. In many optical systems this behavior is utilized to correct for the dispersion found in normal glass lens elements and create a color-corrected optical system. If however, we look at this behavior from another perspective, we can use the same physical behavior to exacerbate axial chromatic aberration. In fact because a diffractive optical element has a focal length inversely proportional to wavelength, a diffractive optical element makes an excellent chromatic aberration enhancing device. There are several different types of diffractive optical elements, ranging from a simple binary amplitude mask (known as a Fresnel zone plate), to a complex phase dependent shape often referred to as a kinoform. In the case of the Fresnel zone plate, concentric circles of alternating fully transparent and fully opaque apertures are designed to create a superposition of the transmitted waves at the desired focal length (again for one particular wavelength).
[0034] As shown in
[0035] Referring now to
[0036] In each case a contour is intended to show the region of the point source image corresponding to 20% of the peak signal (nominally centered). The red contour denotes the 20% peak signal outline for incident electromagnetic radiation in the red region of the visible spectrum (approximately 620-750 nm). The green contour denotes the 20% peak signal outline for incident electromagnetic radiation in the green region of the visible spectrum (approximately 495-570 nm). The blue contour denotes the 20% peak signal outline for incident electromagnetic radiation in the blue region of the visible spectrum (approximately 450-495 nm). The black contour denotes the integration of the entire spectrum and is intended to represent a 20% peak signal contour for a gray-scale image.
[0037] Starting with
[0038] In all of these cases the system only measures the integrated spectrum denoted by the black 20% energy contour for the entire integrated spectral signal. However, as shown in the series of detector positions in
[0039]
[0040] A mechanism 560 is configured to move a chromatic aberration enhancing device (CAED) 570 in and out of an optical path along the optical axis. CAED 570 is configured to induce an axial chromatic aberration of at least f/100 and preferably greater than f/30 to separate spectral components e.g., red 580, green 590 and blue 600 of the incident optical radiation in the FOV along the optical axis thereby providing a change in spatial image contrast as a function of position along the optical axis.
[0041] A focus cell 610 is configured to temporally adjust a relative axial focus position of the objective optical system 510 with respect to detector 540. The focus cell 610 may be a mechanical stage configured to translate either or both of the objective optical system and detector along the optical axis. Detector 540 exhibits a bandwidth that spans the spectral content over the range of axial focus positions.
[0042] A processor 620 such as provided by a computer is configured to issue electrical signals 630 to command mechanism 560 to move CAED 570 in and out of the optical path and electrical signals 640 to command focus cell 610 to adjust the relative axial focus position and to receive electrical signals 650 from detector 520. In a gray-scale mode, processor 620 issues commands to move CAED 570 out of the optical path and to adjust the relative focus to the prime focus position and receives electrical signals is encoded with a single gray-scale image frame. In a hyperspectral mode, processor 620 issues commands to move CAED 570 into the optical path and to temporally adjust the relative focus to at least two different axial focus positions and receives electrical signals encoded with multiple image frame corresponding to different spectrally-weighted components. Processor 620 computes a relative spatial image contrast metric as a function of encoded focus cell position and the prime focus position for a component of the spectral distribution of the incident optical radiation. This processing transforms changes in spatial resolution, due to artificially enhanced chromatic aberration, into a measure of spectral content in the image.
[0043] In general, objective optical system 520 can be any form of imaging optic system, from a single lens or mirror to a multi-element optical system that corrects a variety of standard optical aberrations. The primary function is to transform electromagnetic radiation that is incident to the objective optical system at an angle into a position in the image plane. For an object that is an infinite distance or approximates an infinite distance away from the objective optical system this transformation is governed to first order by a simple relationship: y=f*tan(theta), where y is the displacement of the electromagnetic radiation from the optical axis, f is the focal length of the objective optical system, and theta is the angle of the incident electromagnetic radiation. In the case of an entire imaged scene, the detector dimensions (nominally placed at the prime focus of the objective optical system) define the maximum spatial displacement that can be sensed and due to the standard transformation, the maximum off-axis angle of incident electromagnetic radiation. This maximum angle defines the field of view (FOV) of the system.
[0044] In this dual-mode embodiment, the objective optical system is achromatic (chromatic aberration<f/2000) in order to produce the full-resolution corrected gray-scale image. In a dedicated hyperspectral EO sensor embodiment, the objective optical system may be achromatic with a fixed CAED or may be an uncorrected system with or without a CAED as long as the system chromatic aberration is at least f/100. In a dedicated EO sensor, the processor can integrate the spectrally-weighted image components to produce an estimate of the full-resolution gray-scale image.
[0045] As shown in
[0046] In hyperspectral mode, the processor commands the mechanism to place the CAED into the optical path (step 660) and then commands the focus cell to move the relative axial focus position through a series of two or more image focus planes (step 665). At each focus position, the processor records the image frame and assigns a time tag, frame number and CAED position (step 670) and records the relative axial focus position with a time tag (step 675). The processor computes a spatial image contrast metric for each image frame (e.g. a blur function for point targets) (step 680). After image frames are recorded for the series of focus cell adjustments, the processor computes a relative spatial image contrast metric from each frame across all recorded frames (step 685). The processor may also integrate the image frames (different spectrally-weighted components) to produce an estimate of the gray-scale image.
[0047] The relative spatial image contrast metric transforms changes in spatial resolution, due to artificially enhanced chromatic aberration, into a measure of spectral content in the image. This metric can take many different forms.
[0048] In an embodiment, the processor is configured to compute the relative spatial image contrast metric as a measure of energy on detector (EOD), which is a standard measure of image blur for point source objects, as a function of focus cell position. As shown in
[0049] In another embodiment, the processor is configured to compute the relative spatial image contrast metric by segmenting the image into multiple sub-regions and encoding the sub-regions by measuring a relative image blur in each sub-region as a function of the focus cell's axial prime focus position. As shown in
[0050] In an embodiment, the processor is configured to compute the relative spatial image contrast metric to estimate a temperature of an object in the sensor FOV, assuming the target's spectral emissions are driven by Planck's Blackbody Radiation law.
[0051] In another embodiment, the processor is configured to build (integrate) spectral content from the plurality of image frames to form an estimate of a gray-scale image. This estimate is somewhat degraded (blurred) as compared to the single gray-scale image produced with an achromatic objective optical system.
[0052] A CAED may be permanently, temporarily or switchably mounted to retrofit a system with an existing gray-scale EO sensor to form a hyperspectral EO sensor. The ability to retrofit existing EO sensors is a major advantage over spatially-scanned hyperspectral EO sensors, which cannot be retrofit to existing systems.
[0053] As shown in
[0054] As shown in
[0055] While several illustrative embodiments of the invention have been shown and described, numerous variations and alternate embodiments will occur to those skilled in the art. Such variations and alternate embodiments are contemplated, and can be made without departing from the spirit and scope of the invention as defined in the appended claims.