Automated airborne particulate matter collection, imaging, identification, and analysis
10724935 ยท 2020-07-28
Assignee
Inventors
- Richard Lucas (Phoenix, AZ, US)
- Landon Bunderson (Castle Dale, UT, US)
- Nathan Allan (Mapleton, UT, US)
- Kevn Lambson (Lewis, CO, US)
Cpc classification
H04N23/67
ELECTRICITY
B03C3/36
PERFORMING OPERATIONS; TRANSPORTING
G01N1/2202
PHYSICS
H04N23/74
ELECTRICITY
G01N33/0062
PHYSICS
G01N2001/4038
PHYSICS
International classification
G01N33/00
PHYSICS
B03C3/36
PERFORMING OPERATIONS; TRANSPORTING
Abstract
The following is an apparatus and a method that enables the automated collection and identification of airborne particulate matter comprising dust, pollen grains, mold spores, bacterial cells, and soot from a gaseous medium comprising the ambient air. Once ambient air is inducted into the apparatus, aerosol particulates are acquired and imaged under a novel lighting environment that is used to highlight diagnostic features of the acquired airborne particulate matter. Identity determinations of acquired airborne particulate matter are made based on captured images. Abundance quantifications can be made using identity classifications. Raw and summary information are communicated across a data network for review or further analysis by a user. Other than routine maintenance or subsequent analyses, the basic operations of the apparatus may use, but do not require the active participation of a human operator.
Claims
1. An apparatus to collect and observe airborne particulate matter dispersed in a gaseous medium comprised of: a. a deposition surface onto which the airborne particulate matter will collect; b. an electric field generator unit for attracting and holding the airborne particulate matter to the deposition surface; c. a perception unit for human or machine observation of the airborne particulate matter on the deposition surface; and d. at least one environmental sensor, whereby the at least one environmental sensor or weather data retrieved over a communication network are used to determine control of the apparatus in the event of inclement weather conditions, including the temporary shutting off of the apparatus.
2. The apparatus according to claim 1, wherein the deposition surface is continuous, allowing the observation to occur simultaneous with the collection or after a delay following the collection.
3. The apparatus according to claim 1, wherein a release and cleaning system is employed to remove the airborne particulate matter from the deposition surface after observation; which is comprised of electrical, atmospheric, physical, and gravitational force components acting individually or in combination.
4. The apparatus according to claim 1, wherein an induction unit is used to draw and/or evacuate ambient air into and out of the apparatus.
5. The apparatus according to claim 1, wherein an air flow control unit is used to regulate the rate of air induction into the apparatus relative to an ambient environment external to the apparatus.
6. The apparatus according to claim 1, wherein a perception unit includes magnification components either optical or digital or both for enhanced observation of the airborne particulate matter.
7. The apparatus according to claim 1, wherein a lighting and imaging system is employed to capture, record, store, and/or communicate digital representations of the airborne particulate matter.
8. The apparatus according to claim 1, wherein a plurality of environmental sensors are integrated with the apparatus.
9. The apparatus according to claim 1, wherein the apparatus can have, but does not require, the presence or actions of a human operator except for installation, the continued supply of the requisite electrical power, the continuity of the communication network, and periodic maintenance to the apparatus.
10. An apparatus to collect and observe airborne particulate matter dispersed in a gaseous medium comprised of: a deposition surface onto which the airborne particulate matter will collect; an electric field generator unit for attracting and holding the airborne particulate matter to the deposition surface, wherein the electric field generator unit comprises: a first electrode configured to charge the airborne particulate matter; and a second electrode or first cathode configured to charge the deposition surface with charge opposite to the charge induced on the airborne particulate matter; and a perception unit for human or machine observation of the airborne particulate matter on the deposition surface; and at least one environmental sensor, whereby the at least one environmental sensor or weather data retrieved over a communication network are used to determine control of the apparatus in the event of inclement weather conditions, including the temporary shutting off of the apparatus.
11. The apparatus according to claim 10, wherein the deposition surface is periodically rotated via a controller to align a portion of the deposition surface housing airborne particulate matter with the perception unit or a release and cleaning system.
12. The apparatus according to claim 10, further comprising: a release and cleaning system, wherein the electric charge is reversed via oppositely charged electrodes and the particles are released from the deposition surface.
13. The apparatus according to claim 10, wherein the deposition surface further comprises a rotating disk having an embedded electrode to facilitate charging of the deposition surface.
14. The apparatus according to claim 10, wherein the perception unit further comprises a spacing tube and adjustable carriage to facilitate focusing of the observation of airborne particulate matter on the deposition surface.
15. The apparatus according to claim 10 further comprising: a lighting and imaging system having a plurality of light sources configured to be independently controlled in wavelength output or position.
16. The apparatus according to claim 15, wherein the plurality of light sources comprise a plurality of RGB-LEDs situated in a ring.
17. The apparatus according to claim 15, wherein the plurality of light sources further comprises light baffles to increase the diffused light.
18. An apparatus to collect and observe airborne particulate matter dispersed in a gaseous medium comprised of: a. a deposition surface onto which the airborne particulate matter will collect; b. an electric field generator unit for attracting and holding the airborne particulate matter to the deposition surface; c. a perception unit for human or machine observation of the airborne particulate matter on the deposition surface; and d. a particle identification system for human or machine classification of individual airborne particulate matter collected onto the deposition surface based on the observation made through the perception unit; and e. at least one environmental sensor, whereby the at least one environmental sensor or weather data retrieved over a communication network are used to determine control of the apparatus in the event of inclement weather conditions, including the temporary shutting off of the apparatus.
19. The apparatus of claim 18, wherein the particle identification system further comprises a computer processor configured to perform at least one or a combination of the following: a segmentation function to isolate a location of a particle within a frame of input digital imagery or particle topology; a proximal classification function to determine if each segment of the input digital imagery or particle topology represents a single simple object, a cluster of objects or a single compound object; a declustering function that, if said segment is determined to be a cluster, will iteratively decluster said segment into a series of sub-segments; and a final classification function to determine the most likely particle type assignment for each segment or sub-segment.
20. The apparatus of claim 18, wherein the perception unit is configured to gather image data of the airborne particulate matter, whereby knowledge of the direction, frequency, and intensity of the light source may be stored and used by a software analysis to infer the topology of the airborne particulate matter.
21. The apparatus of claim 20, wherein the inferred topology of the airborne particulate matter is used by the particle identification system to assign a particle type assignment to individual airborne particulate matter.
22. The apparatus of claim 21, wherein the particle type assignment is assigned a weighting against a statistical model derived from a database of spatial and temporal abundance of the airborne particulate matter.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) (Note: This disclosure references components within each figure described below. The naming convention used throughout the specification is first to list the figure number, followed by a decimal point, followed by the specific component number of the given figure, prefaced by the word Figure or Figures, as the situation demands, and all included within parentheses, e.g., (x). For example, a reference to the illustration of the induction unit would be made as follows: (
(2) The features and advantages of the disclosure will become clearer with the following detailed description in connection with the accompanying drawings, wherein:
(3)
(4)
(5)
(6)
(7)
(8)
BEST MODE FOR CARRYING OUT THE INVENTION
(9) The subject matter of this disclosure represents an automated, computerized, electro-mechanical apparatus (
(10) The disclosure is comprised of the following components: a collection system (
(11) The collection system enables the acquisition of airborne particulate matter from the ambient air. An embodiment of this disclosure may utilize an induction unit comprising, but not limited to, a blower fan (
(12) In an embodiment of the disclosure, the collection system may temporarily shut off and discontinue acquisition of airborne particulate matter from the ambient air in the event of inclement weather conditions. Inclement weather may comprise stormy conditions with abnormally high levels of wind that may allow moisture or excessive levels of dust to enter the aperture (
(13) The lighting and imaging system enables the capture, recording, and storage of images of sufficient quality for analyses and identification of the acquired airborne particulate matter. In an embodiment of the disclosure, a motor (
(14) For lighting, an embodiment of this disclosure may use multiple light and electromagnetic radiation sources, individually controlled, and situated in a ring (
(15) In an embodiment of this disclosure, the imaging system may have a linear focus apparatus (
(16) The release and cleaning system enables the evacuation and discharge of the acquired airborne particulate matter from the deposition surface (
(17) In an embodiment of the disclosure, an electric field may be utilized to repel the acquired airborne particulate matter from the deposition surface (
(18) The analysis method of this disclosure (
(19) An embodiment of this disclosure may identify acquired airborne particulate matter in the captured digital images by using image segmentation algorithms, known informally as blobbing techniques. Maximally Stable Extremal Regions (MSER) {13} and other algorithms produce a series of regions pertaining to each identified feature. Each identified acquired airborne particulate matter feature may be known as a segment. For segments larger than a configured threshold, the segment's image may be passed into a proximal classifier function which may determine whether the segment is most likely to be a) a single simple object; b) a single compound object; or c) a cluster of objects. If the segment appears to be a cluster, a declustering function utilizing concavity and seam based splitting may iteratively break overlapping segments into a series of masked out sub-segments. The classifier function thus described may be necessary to identify certain airborne particulate matter such as pollen which may have compound features, resulting in concavities.
(20) For each segment (acquired airborne particulate matter features identified by the MSER or similar algorithm), or group of segments if there are multiple acquired airborne particulate matter features located at the same optimal focus location, an embodiment's software may step to said focus position and engage the lighting and imaging system described above. The lighting and capture system involves sequentially turning on LED lights (
(21) In an embodiment of the disclosure, multiple obliquely lit image segments may be used to infer three dimensional (3D) shape characteristics and surface features of the acquired airborne particulate matter. Light transmissibility and reflectivity may also be inferred using this multiple lighting angle approach. To infer 3D features, a software model may be constructed starting with a malleable primitive object, a sphere may be used as a reasonable malleable primitive object. The model may be scaled to match the maximal extent of the aggregate captured image and may then be sculpted inward based on the perimeter shape. Highlights from each directionally lit image may be then used to push or pull portions of the model according to the 3D vector of the particular light. If the object's facing surface is determined to be convex, highlights that appear on the side opposite the light may be treated as being on the far end of the translucent object, thus shaping may be possible on both the facing and opposing sides. Once a 3D representation of the object is constructed, its position may be normalized, a color or texture is applied to it based on the captured image(s) of the acquired airborne particulate matter, and may be rendered with high-contrast lighting. The resulting rendering may be composed with the original image, or may be used for direct observation. Alternatively, the 3D representation may serve as input to a classifier that is suitable for working with 3D models.
(22) An embodiment of this disclosure may implement machine vision to recognize and classify acquired airborne particulate matter via a neural network classifier. Prior to classification, various image pre-processing commonly used in machine vision may be applied, comprising histogram equalization, sharpness enhancement, and edge detection. Neural networks may be generally defined by a set of interconnected input neurons. The connections may have numeric weights that can be tuned based on experience, making the neural network adaptive to inputs and thus capable of learning. The characterization algorithms may activate and weight neurons by the pixel values of an individual input image. After initial weighting, the values may be passed to other neurons where they may be transformed by other functions relative to a library of identification criteria and then may be passed on again to other neurons. This process may be iterative and may repeat until the output neuron is activated and classification probabilities are achieved. The resulting probabilities may be further weighed and identification may be achieved using a statistical model of spatial and temporal abundance of the airborne particulate matter, so that a particular acquired airborne particulate matter such as a pollen grain that may be deemed by the classifier to be equally likely to be either of two genera, will be weighted towards the genera that is most likely for that location and time of year.
(23) Segment images and associated analysis data may be, in an embodiment of this disclosure, available online to those authorized to access them. In addition to displaying the images, a human operator may be able to give feedback regarding classification, which feedback and corrections may be used to improve the training of the classifier. The series of segmentation images, comprising the digital imagery or particle topology inputs as well as initial particle determinations, may be used directly or with further processing as inputs to classification software or may be analyzed by a human, either remotely or locally, to produce airborne particulate matter identity determinations. The statistical, spatial and temporal model may also be improved, using data coming from devices, as well as correctional feedback from software users.
(24) In an embodiment of the disclosure, captured images may be processed by the onboard computer (
(25) The disclosure has been described in an illustrative manner, and it is to be understood that the terminology which has been used is intended to be in the nature of words of description rather than of limitation. Obviously, many modifications and variations of the present disclosure are possible in light of the above teachings. For example, the device could include mechanisms to direct air currents strategically or to protect itself from adverse environmental and weather conditions. Embodiments may use various deposition media on which to collect particulates, various methods for positioning the particulates for imaging, and various methods of lighting and imaging specimens. Embodiments may also implement practical variants by allowing users flexibility in the kinds of enclosures and mounting mechanisms.
REFERENCES
(26) 1. Akinbami, L., Asthma prevalence, health care use and mortality, 2003-05. Guide for State Health Agencies in the Development of Asthma Programs; US Department of Health and Human Services, Centers for Disease Control and Prevention. CDC. Available at: www.cdc.gov/nchs/products/pubs/pubd/hestats/asthma/asthma.htm. 2006. 2. Barnett, S. B. L. and T. A. Nurmagambetov, Costs of asthma in the United States: 2002-2007. Journal of Allergy and Clinical Immunology, 2011. 127(1): p. 145-152. 3. Lucas, R. W., J. Dees, R. Reynolds, B. Rhodes, and R. W. Hendershot, Cloud-computing and smartphones: Tools for improving asthma management and understanding environmental triggers. Annals of Allergy, Asthma & Immunology, 2015. 114: p. 431-432. 4. Eder, W., M. J. Ege, and E. von Mutius, Current concepts: The asthma epidemic. New England Journal of Medicine, 2006. 355(21): p. 2226-2235. 5. Beggs, P. J., C. H. Katelaris, D. Medek, F. H. Johnston, P. K. Burton, B. Campbell, A. K. Jaggard, D. Vicendese, D. Bowman, I. Godwin, A. R. Huete, B. Erbas, B. J. Green, R. M. Newnham, E. Newbigin, S. G. Haberle, and J. M. Davies, Differences in grass pollen allergen exposure across Australia. Australian and New Zealand Journal of Public Health, 2015. 39(1): p. 51-55. 6. Anderson, H. R., G. Favarato, and R. W. Atkinson, Long-term exposure to outdoor air pollution and the prevalence of asthma: meta-analysis of multi-community prevalence studies. Air Quality Atmosphere and Health, 2013. 6(1): p. 57-68. 7. Brook, R. D., S. Cakmak, M. C. Turner, J. R. Brook, D. L. Crouse, P. A. Peters, A. van Donkelaar, P. J. Villeneuve, O. Brion, M. Jerrett, R. V. Martin, S. Rajagopalan, M. S. Goldberg, C. A. Pope, and R. T. Burnett, Long-Term Fine Particulate Matter Exposure and Mortality From Diabetes in Canada. Diabetes Care, 2013. 36(10): p. 3313-3320. 8. Zhang, Y., L. Bielory, Z. Y. Mi, T. Cai, A. Robock, and P. Georgopoulos, Allergenic pollen season variations in the past two decades under changing climate in the United States. Global Change Biology, 2015. 21(4): p. 1581-1589. 9. Moorman, J., L. Akinbami, C. Bailey, and et al., National Surveillance of Asthma: United States, 2001-2010. National Center for Health Statistics. Vital Health Stat, 2012. 3(35). 10. Zhang, Y., L. Bielory, T. Cai, Z. Mi, and P. Georgopoulos, Predicting onset and duration of airborne allergenic pollen season in the United States. Atmospheric Environment, 2015. 103: p. 297-306. 11. Eggen, B., S. Vardoulakis, D. Hemming, and Y. Clewlow. Pollen forecasting, climate change & public health. in Int. Conf on Climate Change Effects. 2013. 12. Myszkowska, D. and R. Majewska, Pollen grains as allergenic environmental factors-new approach to the forecasting of the pollen concentration during the season. Annals of agricultural and environmental medicine: AAEM, 2014. 21(4): p. 681-688. 13. Wassenberg, J., Bulatov, D., Middelmann, W., Sanders, P.: Determination of Maximally Stable Extremal Regions in Large Images. In: Signal Processing, Pattern Recognition, and Applications. (February 2008)