UV Raman microscope analysis system
10969338 ยท 2021-04-06
Assignee
Inventors
- Darius Vunck (Largo, FL, US)
- Robert Douglas Waterbury (Largo, FL, US)
- Timothy Molner (Largo, FL, US)
- Ed Dottery (Largo, FL, US)
- Hunter Hardy (Largo, FL, US)
- Ryan Robins (Largo, FL, US)
- Thuyan Conghuyentonnu (Largo, FL, US)
Cpc classification
G01J3/0208
PHYSICS
G01J3/0289
PHYSICS
International classification
Abstract
A method and system for interrogating a target for one or more chemical species of interest using Raman microscopy and spectroscopy. A feature includes the ability to precisely electro-mechanically move and orient a Raman microscope relative to the target with multiple degrees of freedom of movement, including targets with 3-D form factors. This promotes effective detection of minute quantities of chemical species of interest. It also allows effective detection of minute quantities whether the target is static or moving. The method and system can include enhancements. Examples include alternative imaging spectrometers, alternative Raman microscope optical set-ups, and alternative focusing techniques. Others include control of the excitation energy and user controls and options to allow highly adjustable, flexible, and effective detection for a variety of detection applications.
Claims
1. A method of detection of chemical species of interest on a target surface using Raman microscopy and spectroscopy comprising: a. interrogating a target for one or more chemical species of interest using a Raman microscope; and b. precisely electro-mechanically moving and orienting the Raman microscope relative to the target with multiple degrees of freedom of movement, including targets with 3-D form factors; c. further comprising selecting a type of focusing of the Raman microscope, wherein the type of focusing is one of: i. use of a range finder; ii. use of a visual channel comprising a quantification of blurriness in an acquired image related to sharpness of focus; and iii. use of a stereoscopic camera with overlapping field of view.
2. The method of claim 1 further comprising moving the Raman microscope into close proximity to target.
3. The method of claim 1 further comprising moving the Raman microscope across a surface of the target to scan the surface.
4. The method of claim 1 further comprising moving the target during the interrogation.
5. The method of claim 1 further comprising selecting a type of imaging spectroscopy for use with the Raman microscope.
6. The method of claim 1 further comprising selecting a type of optical set-up for the Raman microscope.
7. The method of claim 6 wherein the type of optical set up is selected from: a. a co-axial illumination of the target with collection of Raman scattering from the target; and b. an oblique illumination of the target with collection of Raman scattering along a different optical axis.
8. The method of claim 1 further comprising control of one or more of: a. on/off time of illumination by a laser for anti-particle ablation control; b. defocusing of illumination by a laser for anti-particle ablation control; c. scanning mode comprising one of automated or manual; d. display of field of view of the Raman microscope and other graphic or data content.
9. A Raman microscope analysis system comprising: a. an electro-mechanically controlled XYZ positioner; b. a Raman microscope adapted for collecting Raman scattering mounted on the XYZ positioner; c. an imaging spectrometer operatively optically connected to the Raman microscope for analyzing the collected Raman scattering for Raman content indicative of a chemical species of interest; d. a processor programmed to: i. control the XYZ positioner to adjust the Raman microscope and its orientation into proximity to and relative a target object; ii. illuminate the target with excitation illumination; iii. collect Raman scattering; iv. evaluate the collected Raman scattering for a chemical species of interest; and e. a user interface to select modes of operation of the system.
10. The system of claim 9 wherein the electro-mechanically controlled XYZ positioner comprises a 6-axis articulated arm.
11. The system of claim 9 wherein the Raman microscope comprises: a. a UV laser as an illumination source; b. a microscope objective lens; c. optics to direct collected Raman scattering to the imaging spectrometer.
12. The system of claim 9 wherein the imaging spectrometer comprises a CCD imager.
13. The system of claim 9 further comprising an interrogation space within the reach of the XYZ positioner.
14. The system of claim 13 further comprising one of: a. a platform for supporting a target object in the interrogation space; and b. a conveyor for moving a target object past the interrogation space.
15. The system of claim 9 wherein the Raman microscope comprises one of: a. a co-axial illumination of the target with collection of Raman scattering from the target; and b. an oblique illumination of the target with collection of Raman scattering along a different optical axis.
16. The system of claim 9 wherein the Raman microscope comprises a type of focusing from one of: a. a range finder; b. a visual channel comprising a quantification of blurriness in an acquired image related to sharpness of focus; and c. a stereoscopic camera with overlapping field of view.
17. The system of claim 9 wherein control of the excitation illumination comprises one or more of: a. on/off time of illumination by a laser for anti-particle ablation control; b. defocusing of illumination by a laser for anti-particle ablation control; c. scanning mode comprising one of automated or manual.
18. The system of claim 9 wherein the user interface includes a display of field of view of the Raman microscope and other graphic or data content.
Description
III. BRIEF DESCRIPTION OF THE DRAWINGS
(1) The patent or application file contains at least one drawing or photograph executed in color. Copies of this patent or patent application publication with color drawings(s) will be provided by the Office upon request and payment of the necessary fee.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
IV. DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS OF THE INVENTION
A. Overview
(16) For a better understanding of the invention, non-limiting examples of several different forms and embodiments the invention can take will now be described in detail. It is to be understood that these examples are neither exclusive nor inclusive of all forms and embodiments possible with the invention.
(17) For example, exemplary embodiments discussed below will focus upon detection of explosive such as potassium nitrate (KNO3) as a chemical species of interest. Those skilled in the art understand that the invention can be applied to any number of other chemical species for any number of purposes so long as they can be extracted from Raman scattering. For example, there can be other chemical species of interest to be detected relative to explosives for public, private, security, or military purposes. But there can be non-explosive chemical species of interest that could benefit from aspects of the invention. One example is detection of a pesticide or insecticide on fruit or vegetables.
(18) By further example, exemplary embodiments utilize a particular UV laser as an excitation source. As known to those skilled in the art, a variety of excitation sources are possible. Still further, exemplary embodiments utilize an excitation source that is designed to generate Raman scattering from the target, and isolate an effective Raman signal from a collected portion of that scattering for identifying chemical species of interest with sufficient accuracy, precision, reliability per target and repeatable for a substantial number of targets over a substantial useful life.
B. Generalized Embodiment
(19) With particular reference to
(20) We researched utilizing a UV Raman microscope to enable low level detection (nanograms) of explosive particles. An overall system concept is shown in
(21) 1. Raman Microscope Scanning Method
(22) Classical Raman microscopes are designed to look like a standard optical microscope in which the sample is moved relative to the instrument. This works well for flat samples. However, in this embodiment, the scanning mechanism is for the optical instrument to move relative to the sample with the use of an articulated arm as shown in
(23) 2. Use of Non-Spatial Raman Imaging for Fluorescence Rejection:
(24) The owner of the present application has previously disclosed the details of the concept (application U.S. Ser. No. 16/151,682 filed Oct. 4, 2018, incorporated by reference for background information). Embodiments of the present invention can optionally employ that concept to further minimize fluorescence interference.
(25)
(26) Further aspects of the generalized embodiment follow.
(27) The platform or receiver to support a target 29 can be static (e.g. a tabletop, a bench, a surface, or the like). However, it might also be a conveyor (see diagrammatic depiction in
(28) System 20 includes a user interface with a display 22. It can include a keyboard, touch screen, or other user controls. It also includes support equipment 30. In an enclosure box, as indicated in
(29) It is to be understood that spectrometer 60 could be as is disclosed in detail in any of its embodiments in incorporated by reference co-pending co-owned Ser. No. 16/151,682 or other.
(30) As indicated in
(31) As can be appreciated by those skilled in the art, robotic arm 40 can be controlled in a number of ways. In this embodiment, machine vision subsystem 48, with a digital camera 47 with field of view over the range of relevant positions within barrier 39, could track the distal end of arm 40 and Raman microscope 24 in 3-D space, convert its coordinates to camera space, and inform motion controller 46 and processor 34 of actual physical location in real space. This could allow a human operator at user interface 22 to manually control scanning of the excitation beam 25 relative to target 29. It also could allow, through appropriate machine vision algorithms and software, for there to be an automated scanning of many if not all exposed surfaces of target 29. Furthermore, by appropriate machine vision algorithms, image recognition could be used for the machine vision system to recognize preprogrammed shapes or features of a target and only scan or focus in unrecognized preprogrammed such features.
(32) It can also automatically sense distance from any target 29 within the interrogation zone and the reach of arm 40. This can be by one or more proximity sensors on or associated with arm 40 or the interrogation zone. It could be by a component such as a range finder. It could be by evaluation of imaging of the target (e.g. use of depth information in acquired digital images). Proximity sensing allows automatic or semi-automatic control of how close Raman microscope 24 is relative to any surface of target 29, including down to centimeter and even millimeter scale. This can enhance the ability of the system to focus to very small areas of the target surface and acquire highly magnified field-of-view images that can be effectively evaluated for Raman content.
(33) Such machine vision systems, motion controllers, object trackers, and algorithms for machine vision and motion control are available from a wide variety of commercial sources.
(34) Again, in this embodiment, Raman microscope 24 can be a version as disclosed in incorporated by reference U.S. Ser. No. 16/151,682. As disclosed therein, it uses a technique to obtain high resolution of very small physical space areas to help get good Raman signal for small areas. As such, utilizing the same can enhance and promote microscopic detection of chemical species of interest. This can include micro scale and even nano scale. By using appropriate optics, collected Raman scattering can be digitally imaged at a resolution that helps, on a pixel by pixel basis, isolate very small regions of the field of view from which Raman scattering is collected towards this purpose. It is to be understood, however, that alternative Raman microscopes can be used.
(35) Again, utilizing the above features could allow an efficient and effective interrogation of all exposed surfaces of a three-dimensional target automatically. As can be appreciated, alternatively, just certain portions of a target could be scanned. One example might be, as shown in
(36) Furthermore, system 20 could allow an almost fully automated scanning of a target including three-dimensional target without a human user having to reposition either the target or the Raman microscope.
(37) As indicated in
(38)
(39) In the example of
(40)
(41) It can therefore be seen that the invention achieves at least one or more of its stated objectives. Balancing competing factors such as cost, complexity, speed of detection, accuracy of detection, safety of humans, and the like, the system 20 improves over bench top systems that are static relative to excitation aiming and field of view and require relatively flat surfaces to get any significant chance of accurate and reliable detection. It also takes away some human error when having hand-held manual aiming of the microscope. It furthermore has been shown to have capabilities of effectively and efficiently interrogating a wide variety of targets including those of substantial 3-D form factor with detection of micro and nano scale traces of chemical species of interest. As such, this could be highly beneficial for effective and efficient semi-automated or automated screening such as for security purposes.
C. Enhancement Options
(42) The generalized system of
(43) 1. Optical Design Details
(44) Two optical designs can be used with the system 20, each of which has advantages and disadvantages. They are described below.
(45) In this optional optical set-up for generalized embodiment 20, the UV Raman microscope 24 utilizes a reflective objective with a 25 mm working distance to the target. The output is collimated and spectrally split using dichroic optical elements. A visible portion is directed to an operator camera with its own focus lens to provide a highly magnified view of the target area. The Raman band is directed to a fiber bundle at the focus of another lens.
(46) Approach 1: Coaxial UV Laser Illumination Set-Ups 60A and 60B
(47) With particular reference to
(48) Further details about set-ups 60A and B follow.
(49) With specific reference to
(50) The return scattering 27 would pass into the field of view of lens 74, go back at 73 and reflect off dicrotic 72 at 69 and 65 into lens 64 for focusing on the ends of fiber-optic cable 62A for imaging and Raman content extraction.
(51) Note, moreover, that this set up also allows visible light in the field of view of lens 74 to pass through dicrotic 72 at visible wavelengths at 81 and through lens 82 at 83 to visual band camera 84 (see subsystem 80 of
(52)
(53) Approach 2: Oblique UV Laser Illumination Set-Up 60C
(54) Alternatively, in the set-up 60C as in
(55) Relative Advantages of the Above-Approaches
(56) The coaxial focus (60A or 60B of
(57) The direct focus layout 60C of
(58) Thus,
(59) Unique Focusing Approaches
(60) Ensuring the Raman channel is in focus for a given sample is vital to optimizing return signal in Raman Microscopy. Various techniques that could be used with the generalized embodiment 20 are listed below 1) Use of a Standard Rangefinder a) A standard rangefinder (commercially available and diagrammatically indicated in
(61) With reference to
(62) In mathematics, the Laplace operator or Laplacian is a differential operator given by the divergence of the gradient of a function on Euclidean space. It is usually denoted by the symbols .Math., .sup.2 (where is the nabla operator) or . The Laplacian .Math.f(p) of a function fat a point p, is (up to a factor) the rate at which the average value off over spheres centered at p deviates from f(p) as the radius of the sphere shrinks towards 0. In a Cartesian coordinate system, the Laplacian is given by the sum of second partial derivatives of the function with respect to each independent variable. In other coordinate systems such as cylindrical and spherical coordinates, the Laplacian also has a useful form. Thus, this generation of a value related to blurriness can be used to enhance focusing of the system.
(63) As will be appreciated, an automation of focus could be achieved. The system 20 could be automatically controlled to train or learn optimized focus for a given target location. By this hunt and peck technique enabled by the ability to move the Raman microscope electro-mechanically relative the target over minute (e.g. micrometer scale) increments, it could self-determine and optimize sharpness of image and take Raman measurement there. As uch this could enhance accuracy, precision, and efficiency of detection.
(64) 3) Use of a Stereoscopic Camera a) Using a visual band stereoscopic camera (e.g. camera 84 of subsystem 80) (commercially available), depth of field can be determined. These cameras are a combination of two cameras with predetermined specifications that look at an overlapping field of view. Depth is determined by utilizing the cameras' focal lengths, distance between the two cameras, pixel size, and difference in pixel position between the two camera images. Using this depth, a characteristic equation can be developed to precisely move the focusing optics into position. For any given depth, each focusing stage will have a unique position that will be predetermined. i) Depth is calculated based on the focal length of the two cameras, distance between the two cameras (see stereogram 110 of
(65) 3. Anti-Particle Ablation Control
(66) Using a powerful, the focused laser beam 25/27 of system 20 comes with the need to control the amount of energy on samples (e.g. chemical species of interest) and substrates (e.g. the small target area(s) 28 on target(s) 29) to prevent ablation and damage. This is particularly important for interrogating sensitive samples that easily evaporate or burn off or interrogating samples that reside on expensive or important substrates like an expensive handbag. Techniques that can be used are listed below: 1) Controlling Laser On/Off time a) Custom firmware can precisely control when the laser turns on, and how long it stays on. The laser of system 20 can be controlled with 10 ms precision with capability of control down to 1 ms precision. As shown in Equations (1)-(3) below, energy density functions multiplicatively in relation to laser on time so, by reducing the amount of time the laser is on, a sample by 10x will result in a 10 reduction in energy density.
A.sub.circle=(/4)(diameter).sup.2(eq. 1)
Power density (watts/m.sup.2)=laser power (watts)/area.sub.circle(eq. 2)
Energy density (J/m.sup.2)=power density (watts/m.sup.2)dwell time (s)(eq. 3)
As such, using this technique can enhance and be beneficial in effectiveness of a system 20. 2) Reducing Power Density by defocusing the laser a) Focusing optics of system 20 are designed in such a way to allow for independent control of both the transmit and receive channels. This allows the receive Raman channel (the one which collects the Raman scattering for processing out of it a Raman signal) to remain in optimal focus while allowing the transmit laser (the excitation energy to the target 29) to be defocused to prevent ablation. As shown in the equation (2) above, if Area.sub.(circle) increases, power density decreases. This in turn causes energy density to also decrease.
(67) 4. Novel Control and Operator Feedback for Raman Microscope Chemical Detection:
(68) The Raman Microscope Chemical Detection System disclosed herein provides more intuitive control and feedback via a large touchscreen display (see, e.g., display 22 of
(69) To summarize, the unique features of Raman Microscope Chemical Detection system and application disclosed herein, which can be used individually or in any combination, include at least the following: 1) Antiparticle ablation controls a. Laser on/off time b. Defocusing of the beam to reduce power density 2) Dual scanning mode, automatic and manual 3) Draw input bounding box for scanning via touchscreen 4) Full 360 view plus bird eye view of targeting object 5) Overlay object image with result feedback (display live and save to hard drive) 6) Access detailed information and spectra plots from image result. Other feedback, information, or results can be displayed. See, e.g., ref. nos. 132, 133, 140, 142, 143 and 156.
D. Options and Alternatives
(70) As emphasized above, the exemplary embodiments and their aspects are just a few examples of forms the invention and its aspects can take. For example, variations obvious to those skilled in this technical art will be included within the invention.