System for Improving Mine Safety and a Method for Using Same
20210264346 · 2021-08-26
Inventors
Cpc classification
G06Q10/063114
PHYSICS
A61B5/02
HUMAN NECESSITIES
A61B2560/0223
HUMAN NECESSITIES
G06F18/2148
PHYSICS
A61B5/0816
HUMAN NECESSITIES
G08B21/0453
PHYSICS
A61B5/02055
HUMAN NECESSITIES
A61B5/01
HUMAN NECESSITIES
International classification
G06Q10/06
PHYSICS
A61B5/02
HUMAN NECESSITIES
Abstract
A worksite safety system and method is disclosed. The system uses wearable sensors to collect biometric data from workers. The data are used to compute a worker's core body temperature on the basis of an individual profile associating historical biometric data with measured core body temperature. If the computed core body temperature crosses certain thresholds, alert actions are performed.
Claims
1. A method of improving worker safety, comprising: providing a wearable biometric sensor worn by a worker; collecting biometric data measured by the wearable biometric sensor during the course of work performed by the worker; computing, on the basis of the collected biometric data, a physiological value for the worker; comparing the computed physiological value with a computed or predetermined threshold; solely on the basis of the comparison, determining and alert condition, and taking an alert action.
2. The method of claim 1, wherein the physiological value is the worker's core body temperature.
3. The method of claim 2, wherein the biometric data measured includes one or more of: galvanic skin response, blood pressure, respiration rate and blood oxygen saturation.
4. The method of claim 2, wherein the biometric data measured does not include worker skin temperature.
5. The method of claim 2, further comprising computing an individual worker profile correlating historical measured biometric data with historical measured core body temperature, and wherein computing the physiological value for the worker includes using the individual worker profile to compute the physiological value on the basis of newly measured biometric data.
6. The method of claim 5, wherein computing an individual worker profile includes training a neural network.
7. The method of claim 2, wherein taking an alert action comprises directing the worker to do one or more of the following: take a break, change work tasks, use a cooling off device, and leave a work area.
8. The method of claim 2, wherein computing, on the basis of the collected biometric data, a physiological value for the worker, includes computing a projected trajectory for the physiological value over time.
9. The method of claim 2, wherein taking an alert action comprises one or more of: sending an information message, sending a command and taking an automatic action.
10. The method of claim 2, wherein taking an alert action comprises sending a message to individuals other than the worker.
11. The method of claim 1, further including measuring non-biometric environmental parameters, and computing the physiological value, in part, on the basis of the measured non-biometric environmental parameters.
12. The method of claim 1, wherein the alert action is determined on the basis of both measured biometric parameters and measured environmental parameters.
13. A system for improving worker safety, comprising: a wearable biometric sensor, worn by a worker; a network gateway in communication with the wearable biometric sensor; a server in communication with the sensor via a communications fabric and the gateway, the server comprising a programmable processor and non-volatile storage including computer executable instructions capable of causing the programmable processor to: receive biometric data from the wearable biometric sensor; compute a physiological value for the worker; compare the physiological value with a predetermined or computed threshold; on the basis of the comparison, determining an alert condition, and taking an alert action.
14. The system of claim 13, wherein the non-volatile storage includes computer executable instructions representing an individual worker profile correlating historical measured biometric data with historical measured physiological values, and wherein, the physiological value is computed on the basis of this profile.
15. The system of claim 14, wherein the physiological value is the worker's core body temperature, and wherein the received biometric data includes data relating to one or more of the worker's: blood pressure, respiration rate, blood oxygen saturation and galvanic skin response.
16. The system of claim 14, wherein the wearable biometric sensor includes a processor, one or more sensors, a power supply and a wireless communications interface.
17. The system of claim 16, wherein the one or more sensors include sensors for measuring one or more of: blood pressure, respiration rate, blood oxygen saturation and galvanic skin response.
18. A worksite safety system, comprising: a plurality of nodes, each node including a sensor capable of measuring environmental data, a power source and a communications interface, the plurality of nodes including at least one environmental node comprising at least one environmental sensor and at least one personal node worn on a miner, the personal node having a biophysical and biochemical sensor that collects data regarding a worker's physical condition; a gateway; and a server, wherein the plurality of nodes transmits information collected by sensors to the server via the gateway; wherein: the system uses the information collected by sensors to predict trends in the core body temperature of a worker wearing the personal node.
19. The system of claim 18, wherein the worksite is an underground mine, and wherein the plurality of nodes includes a plurality of environmental nodes disposed on the walls, floor or ceiling of an underground mine, and wherein, the nodes wirelessly communicate with one another in a mesh network.
20. The system of claim 18, wherein the plurality of nodes further comprises at least one asset tracking node having an asset tracking sensor.
21. The system of claim 18, wherein the system, if a predicted core body temperature trend crosses a predetermined threshold, causes a mitigation action to be taken.
22. A non-transitory computer usable medium encoded with a computer program product to improve worksite safety and usable with programmable computer processor disposed within a computer, comprising: computer readable program code which causes said programmable computer processor to perform the following steps: collect biometric data collected by the wearable biometric sensor during the course of work performed by the worker; compute, on the basis of the collected biometric data, the core body temperature of the worker; compare the computed physiological value with a computed or predetermined threshold; on the basis of the comparison, determining an alert condition, and taking an alert action.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0012] The technology disclosed herein will be better understood from a reading of the following detailed description taken in conjunction with the drawings in which like reference designators are used to designate like elements, and in which:
[0013]
[0014]
[0015]
[0016]
[0017]
DETAILED DESCRIPTION
[0018] Embodiments of the invention are directed to a system of widely distributed and networked sensors, which monitor both environmental and biological parameters for individual workers in a mining environment. Certain sensors are worn on the person of a miner. Others are in fixed and known locations within and around a mine. Still others are on mine equipment. The sensors are nodes in a mine-wide sensor network and may communicate wirelessly, to both fixed network gateways (in a hub and spoke network configuration), or in a peer-to-peer mesh network configuration with and through other sensors. Data from the sensor network is collected and compared to historical data to detect and predict hazardous conditions, for example, heat stress in a miner. Predictive heuristics are built by training a neural network expert system with sensor data and measured miner body temperature, allowing the system to predict a heat strain event based on collected environmental and miner specific data. The sensor network and neural network (also referred to herein as an “expert system”) are used to enhance mine safety by, for example, providing a lifeline network for evacuation and emergency response, ground stability detection, up-to-the-second geolocation tracking of personnel and equipment, and communication of a higher grade than the current industry standard, as well as detection of heat stress and other hazardous conditions for individuals.
[0019] The technology disclosed herein is described in one or more exemplary embodiments in the following description with reference to the Figures, in which like numbers represent the same or similar elements. Reference throughout this specification to “one embodiment,” “an embodiment,” or similar language means that a feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present technology disclosed herein. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
[0020] The described features, structures, or characteristics of the technology disclosed herein may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are recited to provide a thorough understanding of embodiments of the technology disclosed herein. One skilled in the relevant art will recognize, however, that the technology disclosed herein may be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the technology disclosed herein.
[0021] Referring to
[0022] Module 105 is integrated in a ruggedized, moisture resistant package with additional components on sensor board 135. Sensor board 135 components include additional external sensors 150a-c, DC power supply including a battery 145 and non-volatile memory (i.e., re-writable storage) 140 (e.g., eeprom or “flash” memory, hd card or similar). Sensor board 135 includes an additional, non-illustrated wired I/O interface such as a USB connector. All sensor board 135 components are in electronic communication with all module 105 components via the module's communication fabric 130. External sensors 150a-c may include, by way of example, anemometers, liquid or gas chemical sensors, accelerometers, magnetometers, optical instruments including light sources like LEDs to measure reflectance and transmittance, microphones, thermometers, and/or GPS or other geolocation receivers.
[0023] Sensor 100 may be configured to detect a variety of chemical, bio-physical conditions. Detectable conditions vary according to the sensors (115a-c; 150a-c) selected. Exemplary detectable conditions include: temperature, atmospheric pressure, acceleration, moisture and/or humidity, galvanic skin response, air flow velocity and/or volume, presence of certain gases, and vibration. When sensor 100 is worn next to a worker's skin, in one embodiment, it is configured to detect blood oxygen saturation, blood pressure, respiration rate (through accelerometry), and galvanic skin response.
[0024] One goal of a particular embodiment of a system using the sensor of
[0025] Neural networks are a known method of modeling complex systems, and therefore of predicting the outcomes of such systems on the basis of a large number of variables. Neural network analysis assumes that every input variable may contribute, solely or in complex interaction with other variables, in a particular outcome. Complex systems are, therefore, modeled as a weighted switch fabric, such as the fabric depicted in the schematic neural network of
[0026] With regard specifically to the instant invention, in certain embodiments, measured biometric and other information, along with measured core body temperature information, is processed with artificial neural networks, appropriate statistical techniques (e.g. principal components analysis, discriminant analyses, etc), and related machine learning techniques such as Bayesian Belief Networks among others. Artificial or computational neural networks are machine learning architectures and paradigms that seek to find and analyze patterns in large data sets with methods that are roughly analogous to the way networks of biological neurons process sensory data. Architectures for artificial neural networks (ANN) can be divided between those that perform data classification without a user-provided solution (unsupervised learning, Kohonon networks or self-organizing maps for example) and those that perform either classification or estimation functions with user-provided training solutions (supervised learning, for example variations of feed-forward, fully-connected networks). Learning paradigms are formulas used to adjust connection weights between processing elements in the networks and can be purely mathematical optimization approaches (e.g. conjugate gradient) or can have more biological fidelity (e.g. adaptive resonance theory). The choice of architecture (the way processing elements and processing layers connect to each other) and the learning paradigms (the way data flows through the network and connection weights are changed) are a function of the problem to be solved.
[0027] Data from environmental and biosensors used to predict heat stress conditions may use unsupervised learning to cluster data to determine similarities and dissimilarities in data between individuals that are and are not experiencing discomfort from hot work environments. Data from these sensors will also be correlated with core body temperature measures and other short-term sensors (e.g. core body temperature sensors) using a supervised predictive neural network that can predict oncoming heat stress levels. Data can also be classified using supervised classification networks to determine stage of discomfort related to hot work environments. Networks of ANN can be used to assimilate data from environmental sensors and job task analyses sensors (cameras, kinematic measurements, etc.) to learn the relationship between physiologic states (body temperature, sweat rate, blood pressure, heart rate, brain waves, body mass index, stamina, etc.), environmental states (temperature, humidity, air flow, pollutants), and work states (slow-paced work, fast-paced work, work under loads, etc.). Machine learning algorithms “know” the world that they have been exposed to through the range of data variables used for training. Data are monitored to determine if they are still in the range of the training data and if not, data are collected and networks are re-trained with expanded data sets. The ANN, therefore, can continue to learn and adjust to the work environment.
[0028]
[0029] The worker then swallows an internal core body sensor that can communicate the worker's core body temperature, in real time, with an external computer. One suitable internal sensor is the CorTemp ingestible Bluetooth sensor available from HQInc., of 210 9th Street Dr., West Palmetto, Fla. 34221. When the core body temperature sensor is in position, the worker then puts on a wearable sensor, i.e., the sensor described above in relation to
[0030] When this methodology has been used to build individual profiles for multiple subjects, patterns in the profiles will emerge, i.e., particularly important variables will be isolated, consistent weight patterns in the connection fabric, etc. On the basis of comparison of the individual profiles determined for multiple individuals, a generalized profile can be built that can approximate the heat response of an individual who has not yet gone through the calibration/training set forth above.
[0031] Once an individual worker's profile is calculated according to the method and system of
[0032] Systems according to the invention direct some sort of remedial action in response to determination of an alert condition. Some types of remedial actions are discussed below, but these should not be considered limiting. Any remedial action is within the scope of the invention. Additionally, while some alert conditions are determined on the basis of core body temperature determination, others are determined on the basis of environmental data only, e.g., “get out” notifications in response to a determination that an environment is unsafe.
[0033] Referring still to
[0034] While the method above is described in terms of comparing an instantaneous (i.e., real-time) body temperature determination with thresholds or ranges, the invention is not so limited. Systems operating according to the invention can also compute likely core temperature trajectories based on current measured data, historical data, or a combination of the two. For example, systems according to the invention compute and store core body temperature data over time, resulting in a historical tend for an individual. These data can be used to extrapolate future trends by curve fitting to the already measured data, then extending the curve into the future to predict future core body temperature. Current trends can also be compared to historical trends for an individual to assist in predicting how a current trend is likely to progress. These computed trajectories may also be compared to fixed or dynamically determined thresholds or ranges, and alert events directed in advance of the point in time when heat stress is imminent. Additionally, while the methods described above rely on biometric data to compute core body temperature, other data may be used as well such as: environmental air temperature, air flow, time since last break, and task codes indicating the degree of physical challenge associated with a particular job task. In particular, environmental data may be used to determine the occurrence of an alert condition, independent of the individual biometric data and/or as a supplement to the biometric data. The opposite is also the case in certain embodiments: alert conditions are determined solely by data collected from worn body sensors, without reference to data collected from environmental sensors.
[0035] It is known that people suffer cognitive deficiency as a result of heat stress, even at core body temperature levels below 40-41 degrees, which is generally taken to constitute a heat emergency. Systems according to the invention rely on this observation to provide different types of alerts depending on a worker's core body temperature, with the goal being to remove the element of judgment from a worker as the worker's core body temperature moves closer to an emergent condition. According to this feature of the invention, when low core body temperature thresholds are crossed, a worker may be given a more permissive alert, e.g., a text message saying, “you are getting hot; maybe you should take a water break”, while as higher thresholds are crossed, the alerts are more in the nature of order, e.g., “stop work immediately; supervisor is being informed.”
[0036] While the inventive embodiments described above have been discussed in reference to individual workers, this should not be taken as limiting. Alert conditions can be determined with respect to groups of workers, for example, on the basis of environmental data like air temperature, and/or on the basis of core body temperature determinations from measured data from one or a sub-group of workers. Remedial alert actions are, in these cases, applied to groups of workers.
[0037] It will be appreciated by those of skill in the art that the basic principle of wearable worker sensors and trained, worker-specific neural net profiles, may have applications both beyond the issue of heat stress and beyond the mining environment. All such uses are within the scope of the invention. For example, systems according to the invention may be used to detect general worker impairment or unsafe working conditions. Using the geolocation features described more fully below, workers may be alerted when they have strayed into or near hazardous or out-of-bounds areas within the work environment. Relying on the observation above that cognitive function declines when core body temperature rises, heuristics that detect violations of no-go areas can change as a function of body temperature. For example, the system may maintain virtual “fence” boundaries around hazardous areas like roadways, tramways, areas where heavy equipment is active, blasting areas, pools of water or solvent, areas of bad air, etc. By tracking a worker's position, the worker can be warned away when approaching such areas, notations made in the worker's file, supervisors informed, etc. However, with real-time core temperature data, these fence boundaries can be pushed out, so that someone who is cognitively impaired by heat is warned away from a no-go area sooner and more firmly than someone not so impaired.
[0038] More generally, the sorts of biometric data useful for computing core body temperature may also be used to detect other useful pieces of information about the condition of a worker. For example, fatigue, cognitive impairment, injury or even physical shock may be determined by measuring and analyzing data regarding frequent or repeated violations of no-go areas, uneven or historically uncharacteristic gait, rapid breathing, blood pressure spikes or sweat in the absence of high core body temperature, changes in historical voice patterns (e.g., a worker is asked to repeat a calibrated test phrase, which is compared with historical recorded data), or changes in body position (e.g., worker is hunched over, inverted, or worn sensor is on the ground). Any or all of these data may be measured and analyzed to determine worker impairment, and alerts provided in response.
[0039] Referring now to
[0040] The system 300 comprises one or more gateways 330 and a server 350. As used herein, a gateway 330 is defined as a piece of networking hardware that has the following meaning: a gateway may contain devices such as protocol translators, impedance matching devices, rate converters, fault isolators, or signal translators as necessary to provide system interoperability. It also requires the establishment of mutually acceptable administrative procedures between both networks; and a protocol translation/mapping gateway interconnects networks with different network protocol technologies by performing the required protocol conversions. Moreover, the system 300 comprises the exemplary environmental node 310a that is communicatively connected to the gateway 330 through a communication fabric 320, the exemplary biophysical and biochemical node 310b that is also communicatively connected to the gateway 330 through communication fabric 320, and the exemplary asset tracking node 310c that is also communicatively connected to the gateway 330 through a communication fabric 320. In the system diagram of
[0041] Communication fabric 320 may be any physical communication medium carry signals according to any communications protocol capable of providing data communications between server 350 and nodes 310a-c. Exemplary communications media and standards include: wired (i.e., Ethernet, coaxial cable, optical fiber, powerline modulation) and wireless (WiFi, Bluetooth, UHF, LiFi, Leaker Feeder, etc.). In a preferred embodiment, communication fabric 320 comprises a wired Ethernet LAN including multiple wireless gateways in wireless communication with sensors 310a-c through, for example, Bluetooth or radio communication occurring in accordance with the 802.11 WiFi standards. In certain embodiments, communication fabric 320 is itself at least partially composed of additional nodes communicating in a peer-to-peer fashion through a mesh network. The gateway 330 is communicatively connected to the server 350 via a communication fabric 340, which has the same permissible characteristics as those described above with respect to communication fabric 320.
[0042] For the sake of clarity,
[0043] In certain embodiments, the gateway 330 and the server 350 are each an article of manufacture. Examples of the article of manufacture include: a server, a mainframe computer, a mobile telephone, a smart telephone, a personal digital assistant, a personal computer, a laptop, a set-top box, an MP3 player, an email enabled device, a tablet computer, a web enabled device, or other special purpose computer each having one or more processors (e.g., a Central Processing Unit, a Graphical Processing Unit, or a microprocessor) that are configured to execute Applicants' API to receive information fields, transmit information fields, store information fields, or perform methods.
[0044] By way of illustration and not limitation,
[0045] Environmental nodes 310a comprising environmental sensors are used to monitor environmental parameters of a work area such as but not limited to airflow, air pressure, temperature, relative humidity, ground stability, concentrations of particulate matter, and gases. Environmental nodes preferably include accelerometers, capable of measuring acceleration, which enables the detection of shifting walls, floors and ceilings, and may be useful to detecting or predicting slides or cave ins. Information/data regarding but not limited to identification/contribution of radiant and conductive sources, radon, diesel particulate matter (DPM), silica/coal dust (as appropriate), relative humidity, wind speed, wet bulb temperature, dry bulb temperature, dew point, barometric pressure, and water temperature are collected by the environmental sensors. In certain embodiments, each environmental node is communicatively connected via a communication fabric with each other.
[0046] In certain embodiments, environmental nodes 310a are distributed in fixed locations throughout a work environment, for example, on walls, floors and ceilings. Server, 350, in certain embodiments, has data stored thereon indicating the positions of environmental nodes 310a with respect to a fixed, predetermined coordinate system (e.g., latitude, longitude, altitude). In addition to accelerometry, monitoring the position of environmental nodes over time is useful in detecting and/or predicting shifting or instability in mine surfaces. In certain embodiments, environmental nodes of known positions are used to geolocate other nodes by known methods such as TDOA triangulation. This enables the time varying position of asset tracking and personal nodes to be determined, resulting in data about the position, velocity and acceleration of people and equipment within the mine. Such data may be used in conjunction with virtual fencing data to detect hazardous or inappropriate conditions, provide warnings (e.g., if an individual enters a hazardous or forbidden area, a truck driver exceeds a speed limit, or comes too close to another piece of equipment or wall, etc.), and reconstruct accidents.
[0047] Personal nodes (also referred to herein as bionodes) include biophysical and biochemical sensors (biosensors), and are worn by a mine worker. An exemplary bionode is described above with respect to
[0048] In addition, asset tracking nodes comprising asset tracking sensors are used to collect information/data, such as geolocation tracking of mine equipment and data regarding the operation and condition of such equipment.
[0049] All collected information/data is transferred to gateway 330 via communication fabric 320. Gateway 330 transfers the collected information/data to server 350 via communication fabric 340. Alerts or other commands (programming, updates, voice prompts, messages, etc.) may be transferred from server 350 back down to the nodes via fabrics and gateways in the reverse process. To assist in this communication process, server 350 may further comprise one or more display screens. In certain embodiments, the nodes 310a-c, the gateway 330, and the sensor 350 include wired and/or wireless communication devices which employ various communication protocols including near field (e.g., “Bluetooth”) and/or far field communication capabilities (e.g., satellite communication or communication to cell sites of a cellular network) that support any number of services such as: telephony, Short Message Service (SMS) for text messaging, Multimedia Messaging Service (MMS) for transfer of photographs and videos, electronic mail (email) access, or Global Positioning System (GPS) service, for example. In certain embodiments, at least one of the communication fabrics 320 and 340 comprises the Internet, an intranet, an extranet, a storage area network (SAN), a wide area network (WAN), a local area network (LAN), a virtual private network, a satellite communications network, an interactive television network, or any combination of the foregoing. In certain embodiments, at least one of the communication fabrics contains either or both wired or wireless connections for the transmission of signals including electrical connections, magnetic connections, or a combination thereof. Examples of these types of connections include: radio frequency connections, optical connections, telephone links, a Digital Subscriber Line, or a cable link. Moreover, communication fabrics utilize any of a variety of communication protocols, such as Transmission Control Protocol/Internet Protocol (TCP/IP), for example.
[0050] With respect to data/information storage, in certain embodiments, said collected data/information is encoded in one or more hard disk drives, tape cartridge libraries, optical disks, combinations thereof, and/or any suitable data storage medium, storing one or more databases, or the components thereof, in a single location or in multiple locations, or as an array such as a Direct Access Storage Device (DASD), redundant array of independent disks (RAID), virtualization device, etc. In certain embodiments, said collected data/information is structured by a database model, such as a relational model, a hierarchical model, a network model, an entity-relationship model, an object-oriented model, or a combination thereof. In other embodiments, the said collected data/information is stored on the “Cloud” such as data storage library.
[0051] The results from the neural networks can be used to mitigate heat induced injuries. For example, the results can inform decision making using rule-based decision trees or other decision-making algorithms including graphical dashboards that alert human monitors to conditions that warrant attention or action. Decisions may be to temporarily move a worker to a cooler environment to recover, remove a worker for medical attention, change the work load (driving equipment versus manual operations of equipment), or change the environment (increase air flow, reduce temperature, reduce contaminants).
[0052] While the invention has been described primarily in connection with a mine environment, and particularly, an underground mine environment, the invention has broad applicability to many work environments where heat stress other worker impairments are an issue. Exemplary environments where embodiments of the invention may be advantageously employed include: open bit mines, oil and gas drilling sites, industrial facilities/factory floors, offshore oil rigs, agricultural enterprises, among emergency first responders like fire fighters, and athletics.
[0053] While the preferred embodiments of the present technology have been illustrated in detail, it should be apparent that modifications and adaptations to those embodiments may occur to one skilled in the art without departing from the scope of the present technology.