System and Method for Detecting Coughs from Sensor Data
20230190125 · 2023-06-22
Inventors
- Tom deLaubenfels (Atlanta, GA, US)
- Franco du Preez (Cumming, GA, US)
- Theo Wikus Villet (Kuilsriver, ZA)
- Laurence Richard Olivier (Alpharetta, GA, US)
Cpc classification
A61B5/7282
HUMAN NECESSITIES
International classification
A61B5/0295
HUMAN NECESSITIES
Abstract
A method of detecting coughs using photoplethysmography sensor data is presented. In some embodiments, accelerometry sensor data may also be used in conjunction. A system is presented for the purpose of automatic cough detection, which may also incorporate auxiliary data relevant to the occurrence of coughs. Auxiliary data, may be used to improve cough detection and/or be for contextualization and categorization of detected coughs.
Claims
1. A method to detect the occurrence of coughs, comprising: a. collecting non-invasive signals corresponding to physiological data from a subject; b. processing the collected signals to generate physiological data associated with the subject; and c. detecting, from the physiological data, physical acts of coughing.
2. The method of claim 1, wherein the non-invasive signals are collected by photoplethysmography (PPG) sensors, and wherein the detecting physical act of coughing is done by monitoring blood volume changes captured by the PPG sensors.
3. The method of claim 2, wherein the non-invasive signals further comprises accelerometry signals and the processing further comprises generating accelerometry data.
4. The method of claim 2, wherein the physical act comprises inhalation, exhalation against closed glottis, opening of glottis, or relaxation.
5. The method of claim 4, wherein the identifying data indicating a physical act of coughing is done by signal magnitude thresholding, signal magnitude deviations outside of statistical norms, time-domain analysis methods, frequency-domain analysis methods, signal decompositions, statistical methods, or machine learning methods.
6. The method of claim 2, further comprising, prior to detecting and after processing, incorporating auxiliary data to provide context on conditions under which the non-invasive signals are collected, thus allowing cough detection techniques to be modified or temporarily paused.
7. The method of claim 6, wherein the auxiliary data comprises data relevant to signal quality as a result of varying measurement conditions or a physiological state of the subject.
8. The method of claim 7, wherein the auxiliary data is used to change cough detection techniques to best suit measurement conditions, adjust detection parameters to be more or less sensitive, or pausing detection efforts when measurement conditions are poor or too highly confounded.
9. The method of claim 7, wherein the auxiliary data can be used to contextualize and/or categorize detected coughs.
10. A system for automatically detecting coughs of a subject, comprising: a. sensors configured to collect non-invasive physiological signals associated with the subject; and b. a processor configured to: i. process the non-invasive physiological signals into physiological data related to the subject; ii. detect occurrences of coughs from changes in the physiological data; and iii. generate a cough event output upon detection of a cough.
11. The system of claim 10, in which the cough events comprise: a. a flag or other indication that a cough has been detected; b. a timestamp which marks the point in time at which the cough was detected; and c. a confidence value.
12. The system of claim 10, wherein the cough events further comprises a measurement of cough intensity.
13. The system of claim 10, wherein the sensors comprise a PPG sensor and an accelerometer.
14. A system of claim 10, further comprising an auxiliary data module configured to utilize auxiliary data to generate context of measurement conditions or coughs.
15. The system of claim 14, wherein the processor is configured to modify the detection based on the context of the measurement conditions.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0013]
[0014]
[0015]
DEFINITIONS
[0016] PPG—photoplethysmography
IOT—Internet of things
SpO.sub.2—blood oxygen saturation
DETAILED DESCRIPTION
Principles of Cough Detection Via PPG
[0017] The method of cough detection presented in this disclosure looks for changes in photoplethysmography (PPG) and accelerometry signals which are captured by sensors worn on or placed near the body. This combination of sensors is commonly found in smartwatches and fitness trackers, fingertip pulse oximeters, as well as in some mobile phones and novel body-monitoring devices such as wearable sensor patches. The sensor-carrying device will be referred to as the PPG-enabled device (100), but it should be understood that these different sensor types may not necessarily be bundled in the same device in some embodiments—for example, the PPG-enabled device might be a wearable band placed on the wrist, while accelerometry is captured by another device worn on or placed near the body (such as a mobile phone). Furthermore, because cough-induced changes to PPG signals are typically the more distinct than those in accelerometry signals, accelerometry may be excluded altogether in some embodiments of the presented method. The principles described herein for PPG-based cough detection may be applied to any sensor data which is capable of making measurements of pressure or volume dynamics in the human arterial system and/or associated body tissue.
[0018] PPG is a non-invasive optical technique used to detect volumetric changes in blood circulation. In brief one or more light-emitting diodes are placed at the surface of the skin, in conjunction with one or more photodetectors (photodiodes, CMOS, or other light-detecting sensors) which absorb light reflected by blood and tissue. In some configurations, the light-emitting diodes and photodetectors may be placed with a portion of the body between them, such as a finger. The measurement principles are the same regardless of configuration: oxygenated blood will absorb the emitted light at a different rate than skin, muscle tissue, bone, etc. It is known to those skilled in the art that, as a consequence, certain fluctuations in the quantity of light which reaches the photodetector sensor(s) (having either been reflected by blood/tissue or transmitted through it, depending on the measurement configuration) will correspond to the changing volume of blood in circulation “within range of” the sensor(s). This technique is commonly employed in a wide variety of commercial and medical devices to enable heart rate sensing, blood oxygen saturation, and other measurements. Said devices often include accelerometer sensors in addition to PPG. Besides providing an independent measurement of a subject's motion/activity levels, which is particularly valuable in the context of continuous physiological monitoring (e.g., with smart watches, fitness trackers, and other non-invasive devices), accelerometry measurements can be used to correct for motion-induced artifacts in PPG signals.
[0019]
[0020] The magnitude and duration of PPG fluctuations seen in
[0021] In the examples of
Supporting System for Cough Detection
[0022] This disclosure also presents a system which assists the automatic detection of coughs in the method described, as well as to contextualize and categorize them, in accordance with “Auxiliary” data derived from various sources. In the context of this disclosure, Auxiliary data broadly refers to any data which is relevant to the detection and/or occurrence of coughs in any particular individual (hereafter referred to as the “user”). Auxiliary data can be collected from sensors, or other data collecting services or devices, as discussed below.
[0023] As an example: consider a scenario in which a user is undergoing physical motion, such as that which occurs during walking or other forms of exercise; this knowledge constitutes Auxiliary data and may be obtained via any applicable method, e.g. by monitoring for associated changes in one or more physiological sensors. Pertaining to cough detection, the physical motion might lead to additional variations in either or both the PPG and accelerometry signals which may resemble or confound the cough-induced fluctuations previously described. In such a scenario, the Auxiliary data can act in a de-confounding role by triggering the cessation of automatic cough detection methods for the duration of the confounding motion; this would likely lead to increased specificity of the cough-detection algorithm overall by turning off the algorithm during the walking phase. The same Auxiliary data can act in a supporting role for cough-detection in this scenario: upon the cessation of motion, the system may determine that the user has undergone a period of vigorous activity, and subsequently resume automatic cough detection with an increased sensitivity due to the likelihood of exercise-induced bronchoconstriction.
[0024] Furthermore, the coughs following exercise in this scenario would have an underlying cause which is distinct and relatively benign with respect to causes such as illness, environmental irritants, etc. In light of this, the Auxiliary data may be used to categorize detected coughs accordingly, such that the user can benefit from this knowledge. For example, simple algorithms may be employed which count the frequency of detected coughs occurring during (if the algorithm is not turned off during exercise), or shortly after, an exercise session; a relatively high frequency of exercise-induced coughs might be reported to the user (via, for example, a user interface such as the one will be described forthwith).
[0025] This scenario should be considered exemplary and by no means comprehensive. Other examples of Auxiliary data derived from physiological sensors include, but are not limited to, motion detections, activity/exercise detections, sleep detections, illness/infection presence (e.g., COVID-19, bronchitis, etc.), oxygen saturation, and breathing rate; examples of Auxiliary data derived otherwise include, but are not limited to, user annotations of illness, user disclosures of medical conditions and/or allergies, epidemiology data (e.g. outbreaks of illness in the vicinity of a user), GPS data (e.g. indications that a user has traveled), weather data, air pollution data, and regional pollen data. This disclosure considers any and all applicable Auxiliary data which may be relevant to the detection, contextualization, and categorization of coughs.
[0026] In some embodiments of the proposed system, detected coughs and accompanying Auxiliary data may be aggregated and analyzed on a population-scale. For example, an increased prevalence of detected coughs within a geographical region may indicate the outbreak of a contagious infection. In another example, the increased prevalence may accompany environmental conditions such as high air pollution, wildfire smoke, etc., which are having a detrimental effect on the health of the affected population. The invention claimed in this disclosure includes the use of Auxiliary data in conjunction with cough detection in the manner described in order to provide population-scale insights which may be actionable, e.g. by individuals, public health officials, epidemiologists, government officials, etc.
[0027]
[0028] The principal system modules (105), (106), (107), and (115) may be distributed across the PPG-enabled device (100), Mobile device (101), and Cloud System (102) in any combination. For example: if the PPG-enabled device (100) is a modem smartwatch with ample computing power and a suitable interface, the system modules may well be run directly on the device. In such an embodiment, the Mobile device (101) may be excluded entirely. If, on the other hand, the PPG-enabled device (100) is a low-cost fitness tracker with limited resources and no interface, it may act solely as a sensor platform. In such an embodiment, all remaining functions of the system may be delegated to the Mobile device (101) and Cloud System (102) in the manner most appropriate. It should be noted that the Mobile device (101) and Cloud System (102) are not mandatory in all possible embodiments of the disclosed system; in some embodiments, a suitable PPG-enabled device (100) may act as the sole device in the system when it includes sufficient computing and storage capacity to host all of the principal modules (105), (106), (107), and (115)—however, in such an embodiment certain elements of the disclosed invention may not be possible, e.g. the inclusion of external Auxiliary data (weather, pollution, regional epidemiology, etc.) or the means to aggregate and analyze user cough and Auxiliary data on a population-level scale.
[0029]
[0030] The Cough Detection Module (CDM) (105) receives processed and timestamped PPG and accelerometry sensor data from the PPG-enabled device (100). This data is initially acquired by Physiological sensors (111) (e.g. the PPG photodiodes and photodetectors, as well as the accompanying accelerometers) and is provided a timestamp by an accompanying Timing module (112) which is capable of temporal context. Raw data from 111 and 112 is processed into usable forms (e.g. normalization, outlier removal, secondary transformations such as derivatives, etc) by a Physiological Data Processing Module (115) which subsequently provides data to the CDM (105). In an aspect, the CDM (105) includes a cough detection model (116). The cough detection model 116 can include one or more techniques or algorithms to automatically detect cough signatures within the received sensor data. These techniques may include but not limited to: signal magnitude thresholding, signal magnitude deviations outside of statistical norms, time-domain analysis methods, frequency-domain analysis methods, signal decompositions, statistical methods e.g. autocorrelations, and machine learning methods e.g. recurrent and convolutional neural networks. Where applicable, these techniques may be applied in real time or near-real time to streaming PPG and/or accelerometry data in order to provide continuous detection of coughs; these techniques may also be applied to historical PPG and/or accelerometry data which is aggregated over an arbitrary duration of time and stored in the PPG-enabled device 100, Mobile Device 101, Cloud System 102, or any combination thereof, in order to retroactively detect coughs within some prior period. Under nominal conditions, the detection model will receive sensor data (in real time, near-real time, or in retrospect) and subsequently output detected Cough Events, which consist of a Timestamp, a “Cough Detected” flag, and in some embodiments a Confidence value. The Confidence value may be qualitative and discrete in some embodiments, e.g. low-medium/high, or quantitative and continuous in other embodiments, e.g. on a [0, 1] range. In some embodiments, the Confidence value may represent a statistical likelihood that the detected cough matches known instances of coughing in various control data; in other embodiments it may represent the statistical weight of the true-positive cough class in a detection model. In other embodiments, the Confidence value may be excluded entirely. Cough Events may also include a Cough Intensity measurement in some embodiments (not explicitly depicted in
[0031] In embodiments of the system which include the Auxiliary Data Module (106), the Cough Detection Module (105) may receive a “Detection hold” command from the Auxiliary Data Module (106) in circumstances where cough detection efforts should be temporarily suspended, e.g. during detected periods of intense exercise. The mechanism of the hold may be to restrict sensor data from reaching the detection model via a simple Gate function, as illustrated in
[0032] The Auxiliary Data Module (106) receives as its input a variety of uncategorized Auxiliary data from either the PPG-enabled device (100), Mobile Device (101), Cloud System (102), Internet (103), or any combination thereof. For example, the input data might be processed physiological data derived from various sensors (including PPG and accelerometry), such as motion presence detection, physical activity detection, sleep detection, illness detection, etc., which was computed on any of the aforementioned platforms illustrated in
[0033] Data input to the Auxiliary Data Module (106) is parsed into one of three principal categories: [0034] 1. De-confounding data, which is used primarily to help increase detection efficiency and specificity in the cough detection model via selection of the appropriate technique/algorithm, and/or by pausing detection efforts at appropriate times. Examples include, but are not limited to, sleep or wake state classifications, detections of motion and/or activity, heart rate, and breathing rate. [0035] 2. Supporting data, which is used primarily for the contextualization of detected Cough Events. Examples include, but are not limited to, knowledge or detections of illness in the user, knowledge of pre-existing conditions in a user, knowledge or detections of post-exercise states, and various physiological data such as measured SpO.sub.2 levels. [0036] 3. Environmental data, which is also used primarily for the contextualization of detected Cough Events. Examples include, but are not limited to, weather data, pollution levels, pollen levels, presence of smoke or other environmental hazards, and infectious disease information.
[0037] Parsing is performed primarily by identifying known data types (e.g., sleep/wake data) and/or their sources (e.g., from a sleep/wake detection algorithm). Note that the parsing is not definitive—the objective is merely to 1) streamline the subsequent steps which convert Auxiliary data into actionable modifications to the cough detection model (as explained above), and 2) more easily contextualize and categorize detected Cough Events for the sake of individual user insights and/or aggregated analytics. Once the Auxiliary data has been parsed and broadly categorized, it is passed into a Decision algorithm as shown in
[0042] The Sorting Module (107) receives as inputs Cough Events from the Cough Detection Module (105), as well as the Confidence modifiers and Active state categorizations from the Auxiliary Data Module (106). Confidence modifiers are any set of instructions, mathematical functions, scalars, etc., which change the Confidence values of detected Cough Events based on context provided by relevant Auxiliary data. For example, the Auxiliary data might include knowledge that the user is currently ill, in which case the Confidence of detected Cough Events might subsequently be increased by some factor. As another example, the Auxiliary data might include an algorithm determination that the user has recently conducted intense exercise, as well as prior or learned knowledge (within the context of the disclosed system) that the same user has a propensity for coughing due to exercise-induced bronchoconstriction—this information might also subsequently increase Confidence values by a factor. Active states are, simply, the set of relevant conditions or categories under which detected Cough Events may be contextualized. Examples include, but are not limited to: physiological states such as sleep, fever, or low SpO.sub.2; behavioral states such as post-exercise or detected stress; acute health states such as ongoing illness; environmental states in the user's region such as contagious disease outbreaks, above-normal air pollution, above-normal pollen counts, presence of smoke or other particulates, or weather context; etc.
[0043] Outputs of the Sorting Module (107) are Cough Events with a modified Confidence and added categorization, when applicable. These are returned to, and stored on, any of the system devices illustrated in
[0044] Cough Events, or any summaries or summary metrics thereof, can be displayed to individual users via the User Interface (108). Though not explicitly illustrated in
[0045] Having thus described exemplary embodiments of the present invention, it should be noted by those skilled in the art that the disclosures are exemplary only and that various other alternatives, adaptations, and modifications may be made within the scope of the present invention. Accordingly, the present invention is not limited to the specific embodiments as illustrated herein, but is only limited by the following claims.