Spectral imaging with multiple illumination sources
09841322 · 2017-12-12
Assignee
Inventors
- Gabor John Kemeny (Verona, WI, US)
- Gard Anders Groth (Madison, WI, US)
- Christopher Erwin Zueger (Chicago, IL, US)
- Xu Zhai (Madison, WI, US)
- Gina Elaine Stuessy (Middleton, WI, US)
- Natalie Ann Crothers (Wisconsin Dells, WI, US)
- Howland Jones (Rio Rancho, NM, US)
Cpc classification
G01J3/0229
PHYSICS
G01J3/0278
PHYSICS
H04N23/745
ELECTRICITY
G01J3/0254
PHYSICS
H04N23/74
ELECTRICITY
G01J3/10
PHYSICS
H04N23/65
ELECTRICITY
International classification
Abstract
A spectrometric device for optical analysis of material composition, coating thickness, surface porosity, and/or other characteristics uses several monochromatic light sources—e.g., laser diodes—to illuminate a sample, with a camera taking an image of the sample under each source's light, and with the various images then being combined to generate a (hyper)spectral image. To address the difficulty in obtaining uniform illumination intensity across the illuminated sample area with solid-state light sources, the output from the light sources may be supplied to an integrating sphere (preferably after being combined within a fiber combiner), and then to a fiber bundle whose output ends are configured as a ring light (a ring of fiber ends directing light at a common spot). The camera may then focus on the spot, at which the sample may be placed for illumination and imaging.
Claims
1. A spectrometric device for analyzing the composition of a sample, the device including: a. two or more monochromatic light sources, wherein light from each light source is directed to a sample area, b. a fiber combiner extending between two or more combiner input ends and a combiner output end, wherein each light source is optically coupled to one of the combiner input ends, c. an integrating sphere having a sphere input port and a sphere output port, wherein the combiner output end is optically coupled to the sphere input port, d. a camera configured to capture a two-dimensional image of the sample area, and e. a control system configured to: (1) sequentially activate the light sources to emit light, and (2) activate the camera to capture images when the light sources are activated.
2. A spectrometric device for analyzing the composition of a sample, the device including: a. two or more monochromatic light sources, wherein light from each light source is directed to a sample area, b. optical fibers, each of the optical fibers having a fiber input end and a fiber output end, wherein: (1) the fiber input ends receive light from the light sources, and (2) the fiber output ends are: (a) arrayed in a closed path extending about a central passage, and (b) aligned to direct light from the light sources to the sample area, c. a mask: (1) mounted in fixed relationship with the fiber output ends, (2) having an aperture defined therein, wherein the aperture defines at least a portion of the sample area, and (3) having a reference area defined adjacent the aperture, d. a camera configured to capture a two-dimensional image of the sample area, wherein the camera: (1) is situated to capture the image of the sample area through the central passage, and (2) images at least a portion of the reference area when capturing the image of the sample area, e. a measurement head defining a housing maintaining the camera and the output ends of the optical fibers as a unit, f. a rigid spacer tube: (1) removably attached to the measurement head, and (2) having a tube length situated between the mask and the fiber output ends, whereby the spacer tube spaces the fiber output ends from the sample area, g. a control system configured to: (1) sequentially activate the light sources to emit light, and (2) activate the camera to capture images when the light sources are activated.
3. The spectrometric device of claim 1 further including a rigid spacer tube having a tube length situated between the sample area and the fiber output ends, whereby the spacer tube spaces the fiber output ends from the sample area.
4. The spectrometric device of claim 1 further including: a. optical fibers, each of the optical fibers having a fiber input end and a fiber output end, wherein: (1) the fiber input ends receive light from the light sources, and (2) the fiber output ends are: (a) arrayed in a closed path extending about a central passage, and (b) aligned to direct light from the light sources to the sample area, b. a mask: (1) mounted in fixed relationship with the fiber output ends, (2) having an aperture defined therein, wherein the aperture defines at least a portion of the sample area, and (3) having a reference area defined adjacent the aperture, c. wherein the camera images at least a portion of the reference area when capturing the image of the sample area.
5. The spectrometric device of claim 4 further including: a. a measurement head defining a housing maintaining the camera and the output ends of the optical fibers as a unit, b. a rigid spacer tube: (1) removably attached to the measurement head, and (2) having a tube length situated between the mask and the fiber output ends, whereby the spacer tube spaces the fiber output ends from the sample area.
6. The spectrometric device of claim 2 further including a measurement head: a. configured as a gun having a grip and a muzzle, wherein the muzzle includes the camera and the fiber output ends therein, b. flexibly tethered to the control system by the optical fibers.
7. The spectrometric device of claim 2: a. further including an integrating sphere having one or more sphere input ports and a sphere output port, and b. wherein: (1) each light source is optically coupled to one of the sphere input ports, wherein light from the light source is directed into the integrating sphere, and (2) light from the light sources is emitted from the sphere output port.
8. The spectrometric device of claim 1 wherein the integrating sphere further includes: a. a sphere reference port, and b. a detector optically coupled to the sphere reference port, the detector being configured to measure the intensity of light exiting the sphere reference port.
9. The spectrometric device of claim 2: a. further including: (1) a fiber combiner extending between two or more combiner input ends and a combiner output end, (2) an integrating sphere having a sphere input port and a sphere output port, b. wherein: (1) each light source is optically coupled to one of the combiner input ends, and (2) the combiner output end is optically coupled to the sphere input port.
10. The spectrometric device of claim 1: a. further including optical fibers, each of the optical fibers having a fiber input end and a fiber output end, wherein: (1) the fiber input ends are optically coupled to the sphere output port, and (2) the fiber output ends are: (a) arrayed in a closed path extending about a central passage, and (b) aligned to direct light from the light sources to the sample area, b. wherein the camera is situated to capture the image of the sample area through the central passage.
11. The spectrometric device of claim 10: a. further including a mask: (1) situated a fixed distance from the fiber output ends, (2) having an aperture defined therein, wherein the aperture defines at least a portion of the sample area, and (3) having a reference area defined adjacent the aperture, b. wherein the camera images at least a portion of the reference area when capturing the image of the sample area.
12. The spectrometric device of claim 11 further including a rigid spacer ring removably situated between the fiber output ends and the mask.
13. The spectrometric device of claim 1 wherein the control system is further configured to: a. activate the light sources to emit light, and b. activate the camera to capture images, in synchrony with an AC line voltage powering the control system.
14. The spectrometric device of claim 1 wherein the light sources include one or more diode lasers.
15. A spectrometric device for analyzing the composition of a sample, the device including: a. two or more monochromatic light sources; b. an integrating sphere having: (1) an input port receiving light from one or more of the light sources, (2) a sphere output port emitting integrated light from the integrating sphere, c. a fiber combiner extending between: (1) two or more combiner input ends, wherein each light source is optically coupled to one of the combiner input ends, (2) a combiner output end optically coupled to the sphere input port, d. optical fibers, each having: (1) an input end optically coupled to the sphere output port, and (2) an output end aligned to direct light from the integrating sphere to a sample area, e. a camera configured to capture a two-dimensional image of the sample area when the light sources are activated.
16. The spectrometric device of claim 15 wherein: a. the fiber output ends are arrayed in a closed path extending about a central passage, and b. the camera is situated to capture the image of the sample area through the central passage.
17. The spectrometric device of claim 15: a. further including a mask: (1) mounted in fixed relationship with the fiber output ends, (2) having an aperture defined therein, wherein the aperture defines at least a portion of the sample area, and (3) having a reference area defined adjacent the aperture, b. wherein the camera images at least a portion of the reference area when capturing the image of the sample area.
18. The spectrometric device of claim 17 further including: a. a measurement head defining a housing maintaining the camera and the output ends of the optical fibers as a unit, b. a rigid spacer tube: (1) removably attached to the measurement head, and (2) having a tube length situated between the mask and the fiber output ends, whereby the spacer tube spaces the fiber output ends from the sample area.
19. The spectrometric device of claim 17 further including a rigid spacer ring removably situated between the fiber output ends and the mask.
20. The spectrometric device of claim 15 further including a measurement head: a. configured as a gun having a grip and a muzzle, wherein the muzzle includes the camera and the fiber output ends therein, b. flexibly tethered to the control system by the optical fibers.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
DETAILED DESCRIPTION OF PREFERRED VERSIONS OF THE INVENTION
(10) To review the exemplary spectrometric device 100 of
(11) The sphere gain (the efficiency of the integrating sphere 110) is reduced by the total area of the ports 116/118/120 on the sphere 110, as these reduce the available reflective surface. Thus, it is preferable to have the ports 116/118/120 occupy as little of the area of the sphere 110 as possible. To reduce the area occupied by the ports 116/118/120, it is useful to pre-combine the light from at least some of the light sources 102 using the fiber combiner 200 (
(12) As discussed above, apart from the sphere output port 118, the integrating sphere 110 may also include a secondary sphere output port—a sphere reference port 120—optically coupled to a reference detector 122. This is useful because semiconductor light sources 102 such as diode lasers are known to have pulse to pulse variations in light intensity, which limits measurement repeatability and spectrometric data quality. Some laser light sources 102 have built-in reference detectors to measure a signal proportional to the output of the laser, and this signal can be used for calibration and feedback purposes. However, as the number of light sources 102 used by the device 100 increases, it can become more difficult to compare the light output between the sources 102 because the intensity signals from the multiple reference detectors 122 can be difficult to fully normalize owing to their different characteristics: because the different reference detectors 122 may be of different detector materials, may be positioned differently relative to the solid-state light emitting components, may experience different temperatures when in use, etc., the different detectors 122 can behave differently from light source 102 to light source 102. Thus, it can be useful for the integrating sphere 110 to include the sphere reference port 120 and reference detector 122, enabling the device 100 to compare the actual light output from all light sources 102 after homogenization in the integrating sphere 110 (most preferably after encountering the same homogenization, where the light sources 102 all enter a single sphere input port 116 via the fiber combiner 200 of
(13) The light from the sphere output port 118 can then be used to illuminate the sample 10, preferably via an output optical transmitter 114 (an output optical fiber bundle or other light-transmitting element). The preferred approach is to have an output optical fiber bundle 114 wherein the many fibers within the bundle are randomized, and their fiber output ends are arranged to surround the central passage 126 (
(14) During analysis, the best data quality results if the ring light 124 or other illuminator (fiber combiner output end, fiber bundle terminus, sphere output port, etc.), and the camera 104, are maintained at a steady (and optimal) focal distance from the surface of the sample 10. To this end, it is useful if the illuminator 124 and the camera 104 are mounted in fixed relation to each other as a unit, referred to herein as a measurement head (with an example shown at 402 in
(15) Referring again to
(16) Where samples 10 with nonplanar surfaces are to regularly be analyzed, masks and/or spacers having shapes specially configured to closely fit against the nonplanar surface can be devised. As an example,
(17) To further review the operation of the device of
(18) As discussed below in greater detail, the light sources 102 are multiplexed in succession, so that an image is acquired at the wavelength of each light source 102, allowing the data processor 108 to construct a multispectral image over time. A “dark” reference image of the sample 10 is also acquired with all of the light sources 102 turned off, to provide a calibration image which can be used to characterize any ambient broadband light falling on the sample 10 and reflected back to the camera 104. The reference area 304 (
(19) Other components of the device include a power supply 142 connected via power lines 144 to the illumination controller 106, current driver 130, camera 104, and data processor 108 (and its accompanying input and output devices, e.g., an input device 146—such as the trigger 412 of
(20) A preferred version of the device resembled that of
(21) To review the illumination and imaging timing in greater detail,
(22) During measurement, it is important that the camera exposure—and thus the image—is not influenced by ambient light. Assuming ambient light changes slowly over time, the foregoing scheme is effective, as the dark/ambient reference image characterizes the ambient light level on the sample 10. However, where ambient light changes rapidly—for example, where measurements are being taken of a sample 10 under conventional fluorescent lights operating at standard 50-60 hz line voltage—it's useful to compensate for the effect of such background variation. Assuming the measurement scheme of
I.sub.i,j,k=−log {(S.sub.i,j,k−D.sub.i,j)/(R.sub.i,j,k−D.sub.i,j)}
(23) Where I.sub.i,j,k is the corrected absorbance signal at pixel i,j of the image for light source k; S is the sample measurement; R is the light level recorded on the reference area, and D is the dark measurement, with all light sources 102 turned off. Once the corrected signals are calculated for all pixels in all images, a hyperspectral image can be represented by appropriately weighting the intensity at each wavelength:
Y.sub.i,j=B.sub.0+B.sub.1*I.sub.i,j,1+B.sub.2*I.sub.i,j,2B.sub.3*I.sub.i,j,3+ . . . .
Y.sub.i,j can then be displayed for all points in the image, or can be saved or otherwise used.
(24) To illustrate a potential use of the invention, the device 100 was used to analyze the moisture content of fresh lettuce leaves. Test spectra taken from fresh lettuce leaves, and from those that lost moisture from drying, show a peak around 1450 nm which is indicative of the moisture content of the leaves. The test spectra were taken at one-hour time intervals while air was blown over the leaves to dry them, with full 1000-2500 nm spectra being recorded using a push-broom hyperspectral SWIR camera (SWIR-LVDS-100-N25E by Specim Ltd, Oulu, Finland).
(25) The leaves were then analyzed by a device 100 having three lasers 102, one having a wavelength near the moisture peak, and the others having wavelengths at valleys above and below the moisture peak. Using the 1450 nm analytical wavelength and two baseline indicator wavelengths at 1350 and 1550 nm, the image of the moisture content and its distribution can be calculated as follows:
M(%)=B.sub.0+B.sub.1(I.sub.1450−½(I.sub.1350+I.sub.1550)) or M(%)=B.sub.0+B.sub.1*I.sub.1450+B.sub.2*I.sub.1350+B.sub.3*I.sub.1550
(26) Where the optical intensity, I.sub.n, is the absorbance at wavelength n.
(27) To illustrate another potential use of the invention, a device 100 as described above was constructed for determination of resin thickness on the surface of a carbon fiber-resin composite. Resin pockets—that is, resin pooling—on the surface of 3D woven composites is an indicator of wrinkles in the composite material. Wrinkles may affect the structural integrity of the composite part, but without a good method for detecting such wrinkles, it is difficult to study those effects. The existing non-destructive techniques for characterizing resin pockets (e.g., ultrasound methods) are not sensitive enough to identify shallow pools (less than 60 mils). The constructed device 100, used in the near-infrared range, was able to measure surface resin features on composites with much higher sensitivity than prior non-destructive technologies.
(28) When near-infrared spectra of different resin thicknesses are obtained, the different spectra display the same peaks, but the peaks grow more exaggerated as resin thickness (and thus absorbance) increases. By selecting wavelengths that correspond (at least roughly) to these peaks, and using a set of standard calibration samples with known resin thicknesses, a calibration equation was developed for the device 100 whereby the images taken at the different wavelengths were converted into thickness maps. The thickness of a surface resin feature of an unknown sample could then be measured by placing the hand-portable measuring head 402 (
(29) While the device 100 has been described as operating in the near-infrared wavelength range (typically 1000-2500 nm), generally the same components and methods apply to operation in the ultraviolet (200-400 nm), visible (400-800 nm), VNIR (400-1000 nm), and mid-infrared (2500-25000 nm) regions as well.
(30) When constructing a device as described above, performance is enhanced if consideration is given to the materials which the device is intended to analyze, and if the wavelengths (and number of wavelengths) chosen are appropriate for the materials. It is useful to compile a sample calibration set consisting of perhaps 2-100 different samples representing all the variations that are expected to be encountered, with material concentrations ranging between the expected extremes (e.g., in the case of moisture determination, the driest and wettest samples that are expected to be encountered). The samples can then be analyzed using conventional UV-visible, near-infrared, mid-infrared, spectral, or hyperspectral devices. Conventional statistical and chemometric practices, such as Principal Component Analysis, Partial Least Squares, Science-Based Calibration, or Multivariate Curve Resolution, can then be used to determine the component spectra (i.e., the materials present in the samples). These spectra can then in turn be used to help select the optimal wavelengths to be chosen for the device, with the candidate wavelengths being chosen from those for which light sources 102 are available from different manufacturers.
(31) Two exemplary methods that can be used to select the optimal wavelengths, and thus the light sources 102 for use in the device 100, are forward selection and backward elimination. In forward selection, the first wavelength selected from the list of all available light source wavelengths is the one with the strongest correlation with the analyte of greatest interest, or the strongest correlation with a physical feature of interest (such as layer thickness). Fixing this first wavelength, the second best wavelength is selected, the calibration calculations are repeated, the statistical parameters for this new set is established and this procedure is repeated to add new wavelengths. The criteria for selection could be based on the standard error of calibration (SEC) or if there are sufficient number of samples, the standard error of prediction (SEP).
(32) In backward elimination, all available wavelengths are used to establish the correlation between the spectra and the analyte. The wavelength with the weakest contribution to the correlation is eliminated, and the correlation is recalculated. This process is continued until the correlation gets significantly weaker, or when the SEP falls below the desired level.
(33) Regardless of the method chosen, choice of wavelengths (and thus light sources 102) will also require economic and engineering considerations, e.g., cost of the candidate light sources 102, their ease of installation, calibration, and use, and their mechanical, cooling and electrical requirements.
(34) It should be understood that the versions of the invention described above are merely exemplary, and the invention is not intended to be limited to these versions. Rather, the scope of rights to the invention is limited only by the claims set out below, and the invention encompasses all different versions that fall literally or equivalently within the scope of these claims.