Using biometrics to measure, catalog, analyze, predict and/or monitor emergency responder stress to optimize performance and health

Abstract

A platform can include a processor and a memory with instructions that cause the processor to: receive biometric information from a plurality of public safety personnel; analyze the biometric information to calculate a stress index; and use the stress index to define and monitor stress in the public safety personnel.

Claims

1. A platform, comprising: at least one processor; and memory encoding instructions which, when executed by the at least one processor, cause the at least one processor to: receive biometric information from a plurality of public safety personnel; analyze the biometric information to calculate a stress index; and use the stress index to define and monitor stress in the public safety personnel.

2. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to use the stress index to monitor performance in public safety personnel.

3. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to use a vector of indexes to define stress at varying levels of cognitive engagement for the public safety personnel.

4. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to use a longitudinal series of stress indexes to facilitate therapeutic interventions.

5. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to use a Poincare plot and a series of estimated ellipses to provide visual tools to help balance stress, improve performance and optimize performance.

6. The platform of claim 1, further comprising one or more body worn sensors configured to capture the biometric information, including: Heart Rate, Heart Rate Variability, Respirations and Acceleration.

7. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to use Heart Rate Variability calculations captured during controlled reality-based training exercises to determine a personalized stress index.

8. The platform of claim 7, wherein the personalized stress index is used to establish a longitudinal baseline.

9. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to monitor in-the-field performance through the capture of defined biometrics.

10. The platform of claim 1, further comprising instructions which, when executed by the at least one processor, cause the at least one processor to report variations to a Poincare plot to visualize stress.

11. A method for calculating a stress index for a public safety person, the method comprising: receiving biometric information from a plurality of public safety personnel; analyzing the biometric information to calculate a stress index; and use the stress index to define and monitor stress in the public safety person.

12. The method of claim 11, further comprising using the stress index to monitor performance in the public safety personnel.

13. The method of claim 11, further comprising using a vector of indexes to define stress at varying levels of cognitive engagement for the public safety personnel.

14. The method of claim 11, further comprising using a longitudinal series of stress indexes to facilitate therapeutic interventions.

15. The method of claim 11, further comprising using a Poincare plot and a series of estimated ellipses to provide visual tools to help balance stress, improve performance and optimize performance.

16. The method of claim 11, further comprising using one or more body worn sensors configured to capture the biometric information, including: Heart Rate, Heart Rate Variability, Respirations and Acceleration.

17. The method of claim 11, further comprising using Heart Rate Variability calculations captured during controlled reality-based training exercises to determine a personalized stress index.

18. The method of claim 17, further comprising using the personalized stress index to establish a longitudinal baseline.

19. The method of claim 11, further comprising monitoring in-the-field performance through the capture of defined biometrics.

20. The method of claim 11, further comprising: establishing a personal baseline; discovering boundaries of that baseline; and providing different techniques to better endure stress.

Description

DESCRIPTION OF THE DRAWINGS

[0016] FIG. 1 an example platform as described herein.

[0017] FIG. 2 shows an example index including the subject's demographic data (e.g., age, gender, years of experience, biomarkers, etc.), longitudinal biometric readings (HR and HRV), and designed, controlled and evaluated reality-based training.

[0018] FIG. 3 shows an example monitoring loop that analyzes real-time data against the established baseline index to alert the subject and/or authorized recipients of their status, including providing suggested remedies when the readings are out-of-margin.

[0019] FIG. 4 shows an example optimization engine that uses the longitudinal indices to predict a subject's behavior; whereby, corrective actions are prescribed and performance is optimized during stress-induced events.

[0020] FIG. 5 shows an example method for creating and using a stress index.

DETAILED DESCRIPTION

[0021] Through the use of wearable technology and the proper analysis of the data, emergency responder organizations will have the capacity to build both optimized performance and resiliency with its most important assets its personnel.

[0022] Preparedness, performance and prediction are the platform's goals:

[0023] Preparedness=Individual biometric baseline development using: Heart Rate (HR), and Heart Rate Variability (HRV) data in conjunction with biomarkers, demographics (age, gender, years of experience, etc.), and medical history data.

[0024] Performance=Real-time biometric data provide feedback to correct and influence performance (additionally, the capture of real-time data allows for longitudinal analysis to detect trends and understand the onset of chronic conditions).

[0025] Prediction=Baseline profiles balanced against real-time biometrics using the calculated index will prescribe corrective courses of action resulting in optimized performance and resiliency and will assist in the prediction of future behavior.

[0026] The platform 100, as shown in FIG. 1, is an interrelated suite of devices, software tools, analytics and specialty data stores bundled and delivered as a Software as a Service(SaaS). Its purpose is to assist those individuals in critical public service roles who desire to engage the Platform to understand the limits of their performance and to seek interventions to optimize their performance. Further, it is designed to offer benefit if only used once or if used throughout an individual's life of public safety service. This patent application seeks to lay claim to this platform being uniquely used to understand and mitigate the effect of acute and chronic stress in line of duty.

[0027] The platform's core is an objective measure of stress. There are many measures of stress comprising of heart rate monitoring, respiration, blood pressure, biomarkers, galvanic skin response, eye/pupil observations, and others that will can be incorporated into the platform.

[0028] The platform includes one or more devices 102 that measure the various physiological parameters of the individual, such as heart rate, respiration, etc. As noted, the device 102 is typically wearable technology that is worn on the individual, such as a public safety person. In one example, the device 102 is a wristwatch that measures various physiological attributes associated with the individual. Other or multiple devices can be used to gather the physiologic measurements.

[0029] The device 102 communicates over a network 104 to a server 110 of the platform 100. In some examples, the network 104 includes wired or wireless components and leverages various communications schemes, such as Wi-Fi, Bluetooth, cellular, etc. Other configurations are possible.

[0030] The server 110 is one or more devices (and associated databases), such as a server farm that leverages the computing capacity of many devices to receive, analyze, store, and act upon the data from the device 102, along with the data from thousands or millions of other similar devices associated with other individuals. The server 110 can be divided into logical groupings including a stress index, a monitoring loop, and an optimization engine, as described further below.

[0031] These components of the platform 100 are deployed in concert to understand a person's stress capacity, his or her resilience under pressure and to provide feedback and real-time tools to improve and optimize a person's performance under stress. The platform 100 is made up of four major components:

Measuring and Indexing

[0032] This component (see FIG. 2) involves the creation of a custom, personalized stress index 200: the index for individuals in a controlled testing environment using biometrics to measure stress and visual observation to measure performance. This component is generally the first completed it may be the only engagement, or the first of many interactions within the platform 100.

[0033] BaseliningThe baseline stress index can be helpful in guiding those who seek to better their performance under stress. These measurements are made in a lab environment where the number of external, exogeneous factors can be reduced and/or controlled. A subject is outfitted with one or more biosensors. In the case of this index, the key sensors will capture: heart rateEKG/ECG, respirations and acceleration. The individual will then be taken through a number of calibrated stress scenarios 202.

[0034] In each of these simulations, the person's biometric information 204 will be captured and stored. The calibrated scenarios will simulate stressful situations of varying magnitude. Examples include sleep, sedentary activity, active movements (exercise, general mobility), agitation, fight/flight responses, and overwhelming encounters. The simulations may be performed in different sequences and with more repetitions at each level. After the simulations, the data is consolidated, and an index is calculated for each stress level. These respective values then represent that person's baseline.

[0035] As the number of indexes calculated increases and is combined with real-world feedback, the ability to aggregate people into clusters with similar demographics, psychographics and biomarkers 206 will allow inferences to be made on future behavior, which will lead to better performance.

[0036] Longitudinal While the initial baseline can be helpful in assessing stress measures at a specific point in time, more powerful insight comes from measuring a person's stress index at periodic intervals and then analyzing the changes. By putting individuals through the same calibrated stress simulations at periodic intervals, a longitudinal profile will be determined giving these individuals and their counselors a mechanism to assess both gradual and abrupt changes in a person's stress indexes, which could show the effects of age, the tell-tale signs of stress e.g. PTSD, or the effect of life-changing events.

[0037] Monitoring biometric data offers a window into a person's life. Whether the data is cataloged on all aspects of a person's life, or just during times that are relevant, monitoring any changes to the data provides understanding on how the events of daily- and/or work-life contribute to a person's ability to manage stress. The findings will also illustrate the key factors required to improve one's ability to handle stress. The flow of data allows the monitoring process to become intelligent as data is directed to machine learning and other artificial intelligence algorithms that enables the identification of patterns in observable data, and builds models that explain and predict performance without having explicit pre-programmed rules and models.

[0038] The use of intelligent biometric sensors offers law enforcement the unique opportunity to collect data from an individual continuously or periodically. The monitoring loop 300, a component of the platform 100 shown in FIG. 3, facilitates the capture of the biometric data 302, 304; the transmission of the data to the data store; the analysis 306 of the data (where machine learning and other artificial algorithms exist), where results are fed to the visualization engine and back to the user, providing feedback 308, 310; and offers prescriptive measures to assist with real-time or long-term performance optimization.

[0039] The incoming data stream 302, 304from both the real-time monitoring and the controlled indexing and baseliningis directed through the optimization engine 400 (see FIG. 4) on its way to the data store. The engine 400, with access to past data, continuously analyzes the incoming data, detecting patterns and relationships and then extrapolating these relationships forward in time. The prescriptive portion of this process also monitors incoming data and via machine learning is ready with the best alternative or intervention to maximize the performance objective.

[0040] One of the end objectives of the platform is to provide direct feedback to an individual making them aware of insights from the optimization engine that would allow him or her to understand the end state of predicted performance and provide the best interventions (knowing the person's stress characteristics) to alter the course of events to achieve a better result. This portion of the platform initiates a direct connection back to the remote device, e.g., a cellphone running a mobile application, and push a stream of information that is interpreted by the app.

[0041] This information can either trigger an alert, provide haptics, text or text-to-speech that offers pertinent descriptive, predictive and prescriptive information that helps direct a person's actions. Additionally, the data stream back to the individual has a visualization component that provides app delivered tools that facilitate the person's ability to self-discover their current optimal stress performance state.

[0042] Simple reporting could be provided at any time for real-time or historical information. An alert system would send an immediate notice to the individual that their stress level is increasing at a level that is not consistent with their baseline. In addition, a notification could/would be sent to authorized recipients.

[0043] There are various ways to estimate the stress index 200. For one non-limiting example, beat-to-beat heart rate variability (HRV) is caused by a fluctuating balance between sympathetic tone and parasympathetic tone at the sinoatrial node. It is used for markers of autonomic modulation of the heart. The standard methods for analyzing HRV include: statistical (time domain), power spectral (frequency domain) and nonlinear geometrical analysis. Time and frequency domain methods provide a noninvasive, linear means of assessing the regulation of the autonomic system. The model proposed is based on a nonlinear approach.

[0044] The ease of HRV collection and measurement coupled with the fact it is relatively affordable, non-invasive and pain free makes it widely accessible. It is indeed a surrogate measure that can be easily deployed; can be captured with the current generation of biometric sensors; allows personalization for each individual; allows for longitudinally tracking monitor changes; and even though the measure may offer less information in an absolute sense, it will lend itself to further classification along psychographic parameters.

[0045] The Poincare plot provides a qualitatively and quantitatively visual measure of autonomic nervous system activity. The plot of the R-R intervals on a Poincare diagram with ellipse determined by SD1 and SD2 serves two purposes: 1) It provides each individual with a visual aid to adjust their autonomic balance toward improved levels for a current event via supervening interventions in real-time. Visually, this would be sighting-in the current combination of real-time ellipse, SD1 and SD2 into the person's optimal ellipse, SD1 and SD2. 2) The graphic depiction also sets the stage for a showing the effects of machine learning and other artificial intelligence techniques on the iteration toward an adjusted optimal as new information is analytically digested by the platform.

[0046] The above formulae calculate the SD1 and SD2 directly from a specified data set. The formula for the ellipse on the Poincare plot with SD1 representing the major radius and SD2 the minor radius is plotted using the following relationship: [0047] The Formula of a ROTATED Ellipse is:

[00001]$\frac{{\left(\left(X-C_x\right).Math.\cos \left(\right)+\left(Y-C_y\right).Math.\sin .Math..Math.\left(\right)\right)}^2}{{\left(R_x\right)}^2}+\frac{{\left(\left(X-C_x\right).Math.\sin \left(\right)-\left(Y-C_y\right).Math.\cos \left(\right)\right)}^2}{{\left(R_y\right)}^2}=1$ [0048] There: [0049] (C.sub.x, C.sub.y) is the center of the Ellipse. [0050] R.sub.x is the Major-Radius, and R.sub.y is the Minor-Radius. [0051] is the angle of the Ellipse rotation.

[0052] In another non-limiting example, the stress index 200 is calculated by using beat-to-beat heart rate variability (HRV) that is caused by a fluctuating balance between sympathetic tone and parasympathetic tone at the sinoatrial node. It is used for markers of autonomic modulation of the heart. Methods for analyzing HRV include: statistical (time domain), power spectral (frequency domain) and nonlinear geometrical analysis. Time and frequency domain methods provide a noninvasive, linear means of assessing the regulation of the autonomic system.

[0053] A generalized expression of the stress index 200 is as follows:

S=f(PNS, SNS, BvSI, PoSI, Ia)

[0054] Where: [0055] PNS=f(Mean RR, RMSSD, % SD2) [0056] Parasympathetic nervous system (PNS) activity (vagal stimulation) is known to decrease heart rate and increase heart rate variability [0057] SNS=f(Mean RR, RMSSD, % SD1) [0058] Sympathetic nervous system (SNS) activity having the opposite effect on heart rate and heart rate variability, i.e. it increases HR and decreases HRV [0059] BvSI=f(Amo, Mo, MDnMn)=(AMo100%)/(2MoMDMn) [0060] Baevsky's stress index (BvSI)index of cardiovascular system stress and is strongly linked to sympathetic nervous activity [0061] PoiSI==SD1/SD2 [0062] Poincare nonlinear measures [0063] Ia=Individual attributes (e.g. gender, age, height weight, experience, fitness level . . . )

[0064] As the stress index 200 is uniquely calculated to represent a particular individual's stress at a specific stress level:

(t)=(s.sub.1s.sub.2s.sub.3 . . . si.sub.j . . . s.sub.m)

[0065] Further, an individual's stress index at each stress level over time is represented as a two-dimensional matrix:

[00002]$s_i=\left[s_{j,t}\right]=\left[\begin{array}{ccc}{s}_{1,1}& \mathrm{.Math.}& s_{1,m}\\ s_{1,2}& \mathrm{.Math.}& s_{2,m}\\ s_{1,2}& \mathrm{.Math.}& s_{3,m}\\ \mathrm{.Math.}& \mathrm{.Math.}& \mathrm{.Math.}\\ s_{1,m}& \mathrm{.Math.}& s_{n,m}\end{array}\right]$

[0066] Where: [0067] t=index of time [0068] i=index of individual [0069] j=index of calibrated stress (with j=1 representing least stress) [0070] m=number of stress levels [0071] n=number of time periods

[0072] As noted, the Poincare plot analysis is a geometrical and nonlinear method to assess the dynamics of HRV. It is a diagram in which each R-R interval (time between heartbeats) is plotted as a function of the previous R-R interval where the values of each pair of successive R-R intervals define a point in the plot. The Poincare plot is a geometrical representation that permits the visual identification of the presence of non-linear HRV components. The Poincare plot also provides a set of quantitative measures of the autonomic nervous system activity.

[0073] In the Poincare plots, the SD1 width reflects the parasympathetic activity; and the SD2 length reflects the sympathetic modulation. The determination of SD1 and SD2 follows: [0074] Let RR, x and y vectors be defined as

RR(RR.sub.1,RR.sub.2, . . . ,RR.sub.n,RR.sub.n+1),

x(x.sub.1,x.sub.2, . . . ,x.sub.3)(RR.sub.1,RR.sub.2 . . . RR.sub.n) (I)

y(y.sub.1,y.sub.2, . . . ,y.sub.n)(RR.sub.2RR.sub.3, . . . ,RR.sub.n+1),

where RR.sub.1 stands for the ith RR interval, and n is the number of points in the Poincare plot (which is one less than the length of the RR time series). Using the above, the Poibcare plot of RR intervals can be defined as the ordered pairs (points in a plane) (x.sub.i, y.sub.i) (Piskorski and

[00003]$\begin{array}{cc}{d}_i^1=\frac{.Math.\left(x_i-x_C\right)-\left(y_i-y_C\right).Math.}{\sqrt{2}},.Math.d_i^2=\frac{.Math.\left(x_i-x_C\right)+\left(y_i-y_C\right).Math.}{\sqrt{2}},& \left(4\right)\end{array}$ [0075] Consequently, we obtain the followin formulae for SD1.sub.C and SD2.sub.C:

[00004]$\begin{array}{cc}\mathrm{SD}.Math..Math.1_C^2=\frac{1}{n}.Math.\underset{i=1}{\overset{n}{.Math.}}.Math.{\left(d_i^1\right)}^2,& \left(5\right)\\ \mathrm{SD}.Math..Math.2_C^2=\frac{1}{n}.Math.\underset{i=1}{\overset{n}{.Math.}}.Math.{\left(d_i^2\right)}^2.& \left(6\right)\end{array}$

[0076] Other calculated parameters that play an intermediate role in estimating the stress index 200 can include:

TABLE-US-00001 Parameter Units Description RR interval Time elapsed between two successive R-waves of the QRS signal on the electrocardiogram RR [ms] The mean of RR intervals STD RR (SDNN) [ms] Standard deviation of RR intervals HR [beats/min] The mean heart rate Min & Max HR [beats/min] Minimum and maximum HR computed using N beat moving average (default value: N = 5) RMSSD [ms] Square root of the mean squared differences between successive RR intervals NNxx [beats] Number of successive RR interval pairs that differ more than xx ms (default value xx: = 50) pNNxx [%] NNxx divided by the total number of RR intervals HRV triangular The integral of the RR interval histogram divided by the index height of the histogram TINN [ms] Baseline width of the RR interval histogram Spectrum Welch's (or Lomb-Scargle) periodogram and AR spectrum estimates Peak frequency [Hz] VLF, LF, and HF band peak frequencies Absolute power [ms2] Absolute powers of VLF, LF, and HF bands Absolute power [log] Natural logarithm transformed values of absolute powers of VLF, LF, and HF bands Relative power [%] Relative powers of VLF, LF, and HF bands: VLF [%] = VLF [ms2]/total power [ms2] 100% LF [%] = LF [ms2]/total power [ms2] 100% HF [%] = HF [ms2]/total power [ms2] 100% Normalized power [n.u.] Powers of LF and HF bands in normalized units: LF [n.u.] = LF [ms2]/(total power [ms2] VLF [ms2]) 100% HF [n.u.] = HF [ms2]/(total power [ms2] VLF [ms2]) 100% LF/HF Ratio between LF and HF band powers D2 Correlation dimension AMo the mode amplitude presented in percent or the height of the normalized RR interval histogram Mo the median of the RR intervals MxDMn the difference between longest and shortest RR interval values

[0077] Referring now to FIG. 5, an example method 500 for creating and using a stress index is provided with the platforms described herein.

[0078] At operation 510, a baseline is determined. This baseline can be individualized, as described above. In operation 510, an emergency responder wears a device that measures biometrics including heart rate and heart rate variability. The responder is monitored during a set of activities including pre-determined training sessions and real life, on the job responses to incidents over a period of time. The specific time of each session or incident is recorded either by an observer or taken from the call dispatch records to determine the specific start and end time of each event.

[0079] When done in a training environment, performance is also evaluated to determine when the responder's performance is below set standards. The individual responder's biometrics and performance are converted into the index and the index is matched up with the specific event. When this is done over a series of event, a base line stress index is determined for this responder.

[0080] Next, at operation 520, interventions, notifications, and reporting are provided based upon the baseline stress index calculated for the emergency responder. Specifically, at operation 520, the devices worn by the responder allows for real-time monitoring by the responder or by others allowed to view the results and information. When a responder's biometrics are outside of the baseline, either below or above, a notification is given (e.g., a verbal command, a pulse provided by a device, a warning sound, etc.) indicating a range fault.

[0081] In addition, this information is recorded and monitored, which, in turn, is used to forecast or determine possible future faults or difficult events this responder should not handle. A reporting system matches up the specific events (training or on the job) and monitors the responder's stress index level to each of the events to determine if: 1) the baseline is changing over time; 2) if there is a range fault, it allows for incident review to determine if there was a significant event that caused the fault; and 3) with the use of AI, it is possible to predict the types of events that will cause a biometric fault thus increasing the risk of a poor outcome.

[0082] Next, at operation 530, improvements and corrective measures are performed to continually improve the stress index. This is an iterative process, with operations 520 and 530 being repeated. In addition, a responder's index, by activity, can be used to create tailored training programs, whereas trainers know what activities need to be a focus. In addition, the information may also be shared with the appropriate individuals to determine other concerns including a medical condition, a sleep disorder, or a mental health disorder.

[0083] There can be various technical advantages associated with the platforms described herein. For example, the platforms provide a more holistic approach to calculating a stress index for safety personnel. This results in a more efficient system that collects data from disparate sources, meaningfully analyzes that data, and can act on the results.

[0084] More specifically, through the efficient processes described herein, the stress index can be tailored for safety personnel to meet and exceed the challenges of their jobs. In real-time, biometrics can provide feedback to correct and influence performance. And, these measurements can help predict future behavior and prescribe corrective courses of action resulting in optimized performance and resiliency.

[0085] Data extracted from aperiodic and continuous biometric monitoring can be used to measure/understand stress and to and improve individual performance. A customized stress index can be determined for each person at each level of stress. For instance, a stress index can be constructed from heart rate variability (HRV) captured by wearable sensors. A baseline stress index can be determined, optimized for an individual to improve performance in real-time and used less frequently to understand changes in a safety person's baseline over time. The stress index provides an objective measure to customize training for each individual.

[0086] A stress index, in both absolute terms and relative changes to diagnose an individual's stress related conditions, can provide measures to direct prescriptive therapiesestablishing the right mindset, wellness, fitness, behavioral health and specific counseling . . . all of which will different for each individual. Real-time presentation of the stress index can be used as a self-guide for the individual to better handle stress and control their phyco-physiological response. Further, the stress index can be used to predict performance in real-time.

[0087] Changes in the stress index can be used as an early indicator of chronic disorders/conditions like PTSD. Creating a baseline stress index and monitoring that stress index can and will play a major role in both understanding an individual's stress profile, managing that profile for changes over time and getting the individual the right help at the right time.

[0088] In some implementations, the principles described herein are used by an individual (e.g., emergency personnel) to: 1) establish a personal baseline; 2) discover the edges of the individual's baseline; and 3) learn different interventions/techniques to better endure stress, make better decisions, recover from a stressful incident and/or reduce the likelihood of chronic PTSD.

[0089] The example platforms described herein, including the devices used to collect the data, provide the monitoring loop and optimization engine, and calculate the personalized stress index, can be implemented as one or more computing devices. In these examples, the computing devices including at least one processor and non-transitory memory encoding instructions which, when executed by the at least one processor, cause the processor to implement the operations and other functionality described herein.