Automated airborne particulate matter collection, imaging, identification, and analysis
11624695 · 2023-04-11
Assignee
Inventors
- Richard Lucas (Phoenix, AZ, US)
- Landon Bunderson (Castle Dale, UT, US)
- Nathan Allan (Mapleton, UT, US)
- Kevn Lambson (Lewis, CO, US)
Cpc classification
H04N23/67
ELECTRICITY
B03C3/36
PERFORMING OPERATIONS; TRANSPORTING
G01N1/2202
PHYSICS
H04N23/74
ELECTRICITY
G01N33/0062
PHYSICS
G01N2001/4038
PHYSICS
International classification
B03C3/36
PERFORMING OPERATIONS; TRANSPORTING
G01N33/00
PHYSICS
Abstract
The following is an apparatus and a method that enables the automated collection and identification of airborne particulate matter comprising dust, pollen grains, mold spores, bacterial cells, and soot from a gaseous medium comprising the ambient air. Once ambient air is inducted into the apparatus, aerosol particulates are acquired and imaged under a novel lighting environment that is used to highlight diagnostic features of the acquired airborne particulate matter. Identity determinations of acquired airborne particulate matter are made based on captured images. Abundance quantifications can be made using identity classifications. Raw and summary information are communicated across a data network for review or further analysis by a user. Other than routine maintenance or subsequent analyses, the basic operations of the apparatus may use, but do not require the active participation of a human operator.
Claims
1. A system for capturing images of particulate matter, the system comprising: a deposition surface, wherein the particulate matter is disposed on the deposition surface; an illumination apparatus comprising plurality of sources of electromagnetic radiation; a camera; and a control unit in communication with the camera and the plurality of sources of electromagnetic radiation, wherein the control unit is configured to execute instructions comprising: cycling the plurality of sources of electromagnetic radiation to illuminate the airborne particulate matter with a plurality of different wavelength combinations; and causing the camera to capture a plurality of images of the particulate matter, wherein each of the plurality of images corresponds with one of the plurality of different wavelength combinations emitted by the illumination apparatus.
2. The system of claim 1, wherein the plurality of sources of electromagnetic radiation are disposed in a ring configuration forming a pixel light ring, and wherein the pixel light ring illuminates the deposition surface with the plurality of sources of electromagnetic radiation.
3. The system of claim 2, wherein the pixel light ring further comprises one or more reflective light baffles, and wherein each of the one or more reflective light baffles is configured to increase an amount of light incident on the deposition surface.
4. The system of claim 2, wherein the plurality of images of the particulate matter comprises one or more obliquely lit images, and wherein the one or more obliquely lit images are captured by the camera when an adaxial orientation of the pixel light ring is disposed at an oblique angle relative to the deposition surface.
5. The system of claim 1, wherein the plurality of images of the particulate matter comprises one or more dark-field images.
6. The system of claim 1, wherein the instructions are such that cycling the plurality of sources of electromagnetic radiation comprises individually modulating each of the plurality of sources of electromagnetic radiation; and wherein at least a portion of the plurality of sources of electromagnetic radiation are tuned to emit electromagnetic radiation within a range from 200 nm to 800 nm.
7. The system of claim 6, wherein the plurality of sources of electromagnetic radiation further comprises one or more of: an ultraviolet source tuned to emit electromagnetic radiation within an ultraviolet waveband of the electromagnetic spectrum; or a near infrared source tuned to emit electromagnetic radiation within a near infrared waveband of the electromagnetic spectrum.
8. The system of claim 6, wherein each of the plurality of sources of electromagnetic radiation is tuned to emit electromagnetic radiation within the range from 200 nm to 800 nm.
9. The system of claim 1, wherein the plurality of sources of electromagnetic radiation comprises a red light emitting diode (LED), a green LED, and a blue LED.
10. The system of claim 1, wherein the plurality of images of the particulate matter comprises two or more different images each corresponding with a different adaxial illumination direction for illuminating the deposition surface with the illumination apparatus.
11. The system of claim 1, wherein the plurality of images of the particulate matter comprises two or more different images each corresponding with a different diffuse illumination direction for illuminating the deposition surface with the illumination apparatus.
12. The system of claim 1, wherein the plurality of images of the particulate matter comprises two or more different images each corresponding with a different illumination intensity emitted by the illumination apparatus on to the deposition surface.
13. The system of claim 1, wherein the control unit instructs the camera to capture two or more image frames for each of the plurality of different wavelength combinations.
14. The system of claim 13, wherein the two or more image frames corresponding with the same wavelength combination are averaged into a composite image.
15. The system of claim 14, wherein the composite image comprises reduced noise relative to each of the two or more image frames individually.
16. The system of claim 1, wherein the plurality of images is processed to infer topological features of the particulate matter based at least in part on image capture specifications.
17. The system of claim 16, wherein the image capture specifications comprise one or more of: a wavelength of electromagnetic radiation that was emitted by the illumination apparatus on to the deposition surface when an image was captured; an incident angle of one or more of the plurality of sources of electromagnetic radiation relative to the deposition surface when the image was captured; an intensity of light emitted by the illumination apparatus when the image was captured; or a frequency of electromagnetic radiation emitted by the illumination apparatus when the image was captured.
18. The system of claim 17, wherein the topological features of the particulate matter comprise one or more of a presence of pores within the particulate matter, a presence of furrows within the particulate matter, a presence of septae within the particulate matter, or a presence of mycelia fragments of spores within the particulate matter.
19. The system of claim 1, further comprising a linear focus apparatus comprising: a linear carriage comprising the camera and the plurality of sources of electromagnetic radiation; a screw stepper configured to translate the linear carriage; and a motor controller configured to translate the linear carriage to facilitate focusing of the plurality of images of the particulate matter.
20. The system of claim 19, wherein the control unit issues instructions to incrementally adjust a position of the linear carriage to achieve an optimal focus location for capturing the plurality of images of the particulate matter.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) (Note: this disclosure references components within each figure described below. The naming convention used throughout the specification is first to list the figure number, followed by a decimal point, followed by the specific component number of the given figure, prefaced by the word “Figure” or “Figures”, as the situation demands, and all included within parentheses, e.g., (x). For example, a reference to the illustration of the induction unit would be made as follows: (
(2) The features and advantages of the disclosure will become clearer with the following detailed description in connection with the accompanying drawings, wherein:
(3)
(4) 1: ambient air
(5) 2: induction unit
(6) 3: airborne particulate inlet aperture
(7) 4: weather-resistant enclosure de-emphasized and indicated by a dashed line
(8) 5: air chamber
(9) 6: electrode (may be the anode)
(10) 7: an embodiment of airborne particulate matter
(11) 8: deposition surface (or medium of deposition)
(12) 9: translation or rotation mechanism
(13) 10: spacer tube—part of the perception unit
(14) 11: high-resolution magnified digital camera—part of the perception unit
(15) 12: pixel light ring—part of the perception unit
(16) 13: objective lens—part of the perception unit
(17) 14: linear focus apparatus part of the perception unit
(18) 15: main controller board and on-board computer with integrated Wi-fi communication capability
(19) 16: motor controllers
(20) 17: high-voltage electric field generator unit
(21) 18: filter
(22) 19: power and network cabling
(23) 20: sampling disk and with embedded electrode (may be the cathode). This component bears the deposition surface (
(24) 24: environmental sensors
(25) 26: screw stepper.
(26)
(27) 2: induction unit
(28) 3: airborne particulate inlet aperture
(29) 5: static charge air chamber and electrode
(30) 10: spacer tube
(31) 12: pixel light ring with reflective light baffles
(32) 13: objective lens
(33) 20: sampling disk and with embedded electrode (may be the cathode). This component bears the deposition surface (
(34) 21: cleaning mechanism electrode.
(35)
(36) 2: induction unit
(37) 3: airborne particulate inlet aperture
(38) 5: air chamber
(39) 6: electrode (may be the anode)
(40) 8: deposition surface
(41) 10: spacer tube
(42) 12: light pixel ring with reflective light baffles
(43) 13: objective lens
(44) 18: filter
(45) 20: sampling disk and with embedded electrodes
(46) 22: deposition surface cleaning area
(47) 23: cleaning brush
(48) 25: imaging area.
(49)
(50) 2: induction unit
(51) 3: airborne particulate inlet aperture
(52) 9: translation or rotation mechanism
(53) 10: spacer tube
(54) 12: light pixel ring with reflective baffles
(55) 13: objective lens
(56) 14: focus mechanism comprising a linear rail, a motor and end-stops
(57) 18: fiber
(58) 20: sampling disk and with embedded electrode (may be the cathode). This component bears the deposition surface (
(59) 25: imaging area
(60) 26: screw stepper.
(61)
(62) 1: an airborne particulate (enlarged and not to scale) enters the airborne particulate inlet aperture
(63) 2: electrostatic charge imparted to particulate(s)
(64) 3: particulate(s) deposited on deposition surface
(65) 4: illumination and imaging of particulate(s)
(66) 5: brush, airstream, electrostatic charge, gravity, and filter clean deposition surface.
(67)
(68) 1: collect airborne particulate matter onto the surface of a deposition medium
(69) 2: use an imaging device directed towards the medium of deposition to assess the locations and sizes of acquired particulates within the field of view, may be accomplished through image segmentation
(70) 3: determine the optimal focus location for each particulate using a focus assessment function limited to each particulate's segment boundary
(71) 4: capture one or more images from many different lighting configurations for each particle at the ideal local location
(72) 5: store captured images in a local or remote data repository for identity determination or other analysis.
BEST MODE FOR CARRYING OUT THE INVENTION
(73) The subject matter of this disclosure represents an automated, computerized, electro-mechanical apparatus (
(74) The disclosure is comprised of the following components: a collection system (
(75) The collection system enables the acquisition of airborne particulate matter from the ambient air. An embodiment of this disclosure may utilize an induction unit comprising, but not limited to, a blower fan (
(76) In an embodiment of the disclosure, the collection system may temporarily shut off and discontinue acquisition of airborne particulate matter from the ambient air in the event of inclement weather conditions. Inclement weather may comprise stormy conditions with abnormally high levels of wind that may allow moisture or excessive levels of dust to enter the aperture (
(77) The lighting and imaging system enables the capture, recording, and storage of images of sufficient quality for analyses and identification of the acquired airborne particulate matter. In an embodiment of the disclosure, a motor (
(78) For lighting, an embodiment of this disclosure may use multiple light and electromagnetic radiation sources, individually controlled, and situated in a ring (
(79) In an embodiment of this disclosure, the imaging system may have a linear focus apparatus (
(80) The release and cleaning system enables the evacuation and discharge of the acquired airborne particulate matter front the deposition surface (
(81) In an embodiment of the disclosure, an electric field may be utilized to repel the acquired airborne particulate matter front the deposition surface (
(82) The analysis method of this disclosure (
(83) An embodiment of this disclosure may identify acquired airborne particulate matter in the captured digital images by using image segmentation algorithms, known informally as “blobbing” techniques. Maximally Stable Extremal Regions (MSER) {13} and other algorithms produce a series of regions pertaining to each identified feature. Each identified acquired airborne particulate matter feature may be known as a segment. For segments larger than a configured threshold, the segment's image may be passed into a proximal classifier function which may determine whether the segment is most likely to be a) a single simple object; b) a single compound object; or c) a cluster of objects. If the segment appears to be a cluster, a declustering function utilizing concavity and seam based splitting may iteratively break overlapping segments into a series of masked out sub-segments. The classifier function thus described may be necessary to identify certain airborne particulate matter such as pollen which may have compound features, resulting in concavities.
(84) For each segment (acquired airborne particulate matter features identified by the MSER or similar algorithm), or group of segments if there are multiple acquired airborne particulate matter features located at the same optimal focus location, an embodiment's software may step to said focus position and engage the lighting and imaging system described above. The lighting and capture system involves sequentially turning on LED lights (
(85) In an embodiment of the disclosure, multiple obliquely lit image segments may be used to infer three dimensional (3D) shape characteristics and surface features of the acquired airborne particulate matter. Light transmissibility and reflectivity may also be inferred using this multiple lighting angle approach. To infer 3D features, a software model may be constructed starting with a malleable primitive object, a sphere may be used as a reasonable malleable primitive object. The model may be scaled to match the maximal extent of the aggregate captured image and may then be sculpted inward based on the perimeter shape. Highlights from each directionally lit image may be then used to push or pull portions of the model according to the 3D vector of the particular light. If the object's facing surface is determined to be convex, highlights that appear on the side opposite the light may be treated as being on the far end of the translucent object, thus shaping may be possible on both the facing and opposing sides. Once a 3D representation of the object is constructed, its position may be normalized, a color or texture is applied to it based on the captured image(s) of the acquired airborne particulate matter, and may be rendered with high-contrast lighting. The resulting rendering may be composed with the original image, or may be used for direct observation. Alternatively, the 3D representation may serve as input to a classifier that is suitable for working with 3D models.
(86) An embodiment of this disclosure may implement machine vision to recognize and classify acquired airborne particulate matter via a neural network classifier. Prior to classification, various image pre-processing commonly used in machine vision may be applied, comprising histogram equalization, sharpness enhancement, and edge detection. Neural networks may be generally defined by a set of interconnected input “neurons”. The connections may have numeric weights that can be tuned based on experience, making the neural network adaptive to inputs and thus capable of learning. The characterization algorithms may activate and weight neurons by the pixel values of an individual input image. After initial weighting, the values may be passed to other neurons where they may be transformed b other functions relative to a library of identification criteria and then may be passed on again to other neurons. This process may be iterative and may repeat until the output neuron is activated and classification probabilities are achieved. The resulting probabilities may be further weighed and identification may be achieved using a statistical model of spatial and temporal abundance of the airborne particulate matter, so that a particular acquired airborne particulate matter such as a pollen grain that may be deemed by the classifier to be equally likely to be either of two genera, will be weighted towards the genera that is most likely for that location and time of year,
(87) Segment images and associated analysis data may be, in an embodiment of this disclosure, available online to those authorized to access them. In addition to displaying the images, a human operator may be able to give feedback regarding classification, which feedback and corrections may be used to improve the training of the classifier. The series of segmentation images, comprising the digital imagery or particle topology inputs as well as initial particle determinations, may be used directly or with further processing as inputs to classification software or may be analyzed by a human, either remotely or locally, to produce airborne particulate matter identity determinations. The statistical, spatial and temporal model may also be improved, using data coming from devices, as well as correctional feedback from software users.
(88) In an embodiment of the disclosure, captured images may be processed by the onboard computer (
(89) The disclosure has been described in an illustrative manner, and it is to be understood that the terminology which has been used is intended to be in the nature of words of description rather than of limitation. Obviously, many modifications and variations of the present disclosure are possible in light of the above teachings. For example, the device could include mechanisms to direct air currents strategically or to protect itself from adverse environmental and weather conditions. Embodiments may use various deposition media on which to collect particulates, various methods for positioning the particulates for imaging, and various methods of lighting and imaging specimens. Embodiments may also implement practical variants by allowing users flexibility in the kinds of enclosures and mounting mechanisms.
REFERENCES
(90) 1. Akinbami, L., Asthma prevalence, health care use and mortality, 2003-05. Guide for State Health Agencies in the Development of Asthma Programs; US Department of Health and Human Services, Centers for Disease Control and Prevention. CDC. Available at: www.cdc.gov/nchs/products/pubs/pubd/hestats/asthma/asthma.htm. 2006.
2. Barnett, S. B. L. and T. A. Nurmagambetov, Costs of asthma in the United States: 2002-2007. Journal of Allergy and Clinical Immunoloey, 2011. 127(1): p. 145-152.
3. Lucas, R. W., J. Dees, R. Reynolds, B. Rhodes, and R. W. Hendershot, Cloud-computing and smartphones: Tools for improving asthma management and understanding environmental triggers. Annals of Allergy, Asthma & Immunology, 2015. 114: p. 431-432.
4. Eder, W., M. J. Ege, and E. von Mutius, Current concepts: The asthma epidemic. New England Journal of Medicine, 2006. 355(21): p. 2226-2235.
5. Beggs, P. J., C. H. Katelaris, D. Medek, F. H. Johnston, P. K. Burton, B. Campbell, A. K. Jaggard, D, Vicendese, Bowman, I. Godwin, A. R. Huete, B. Erbas, B. J. Green, R. M. Newnham, E. Newbigin, S. G. Haberle, and J. M. Davies, Differences in grass pollen allergen exposure across Australia. Australian and New Zealand Journal of Public Health, 2015. 39(1); p. 51-55.
6. Anderson, H. R., G. Favarato, and R. W. Atkinson, Long exposure to outdoor air pollution and the prevalence of asthma: meta:-analysis of multi-community prevalence studies. Air Quality Atmosphere and Health, 2013. 6(1): p. 57-68.
7. Brook, R. D., S. Cakmak, M. C. Turner, J. R. Brook, D. L. Crouse, P. A. Peters. A. van Donkelaar, P. J. Villeneuve, O. Brion, M. Jerrett, R. V. Martin, S. Rajagopalan, M. S. Goldberg, C. A. Pope, and R. T. Burnett, Long-Term Fine Particulate Matter Exposure and Mortality From Diabetes in Canada. Diabetes Care, 2013, 36(10): p. 3313-3320.
8. Zhang, Y., L. Bielory, Z. Y. Mi, T. Cai, A. Robock, and P. Georgopoulos, Allergenic pollen season variations in the past two decades under changing climate in the United States. Global Change Biology, 2015. 21(4): p. 1581-1589.
9. Moorman, J., L. Akinbami, C. Bailey, and et al., National Surveillance of Asthma: United States, 2001-2010. National Center for Health Statistics. Vital Health Stat., 2012. 3(35).
10. Zhang, Y., L. Bielory, T. Cai., Z. Mi, and P. Georgopoulos, Predicting onset and duration of airborne allergenic pollen season in the United States. Atmospheric Environment, 2015. 103: p. 297-306.
11. Eggen, B., S. Vardoulakis, D. Hemming, and Y. Clewlow. Pollen forecasting, climate change & public health. in int. Conf On Climate Change Effects. 2013.
12. Myszkowska, D. and R. Majewska, Pollen grains as allergenic environmental factors—new approach to the forecasting of the pollen concentration during the season. Annals of agricultural and environmental medicine: AAEM, 2014. 21(4): p. 68-688.
(91) 13. Wassenberg, J., Bulatov, D., Middelmann, W., Sanders, P.: Determination of Maximally Stable Extremal Regions in Large Images. In: Signal Processing, Pattern Recognition, and Applications. (February 2008).