MENTAL STRESS DETECTION DEVICE AND COMPUTER READABLE MEDIUM
20200054261 ยท 2020-02-20
Assignee
Inventors
Cpc classification
G06F2203/011
PHYSICS
G06F3/015
PHYSICS
A61B5/165
HUMAN NECESSITIES
A61B5/7246
HUMAN NECESSITIES
G06F17/18
PHYSICS
A61B5/16
HUMAN NECESSITIES
International classification
A61B5/16
HUMAN NECESSITIES
G06F17/18
PHYSICS
Abstract
A mental stress detection device (10) includes an index value calculation unit (200) and a correlation calculation unit (300). The index value calculation unit (200) calculates standard deviation (SD.sub.n) of heartbeat intervals (RRI.sub.n), a root mean square (RM.sub.n) of a difference RD.sub.n between temporally-adjacent heartbeat intervals (RRI.sub.n), and a ratio (SD.sub.n/RM.sub.n) between the standard deviation (SD.sub.n) and the root mean square (RM.sub.n). The root mean square (RM.sub.n) correlates with an activity of parasympathetic nerves and the ratio (SD.sub.n/RM.sub.n) correlates with an activity of sympathetic nerves. The correlation calculation unit (300) calculates a moment correlation coefficient (r.sub.n) which is a correlation between the root mean square (RM.sub.n) and (the ratio SD.sub.n/RM.sub.n) and a correlation associated with time.
Claims
1-8. (canceled)
9. A mental stress detection device comprising: processing circuitry to: calculate a first index value, the first index value being an index of an activity state of parasympathetic nerves with elapse of time, and a second index value, the second index value being an index of an activity state of sympathetic nerves with elapse of time, based on a plurality of heartbeat intervals RRI, wherein the processing circuitry calculates a standard deviation SD of the plurality of heartbeat intervals RRI and a root mean square RM of differences RD between heartbeat intervals RRI and calculates a ratio SD/RM between the standard deviation SD and the root mean square RM; and calculate a time corresponding correlation, the time corresponding correlation being a correlation between the first index value and the second index value and being a correlation associated with time, wherein the processing circuitry calculates a correlation between the root mean square RM and the ratio SD/RM as the time corresponding correlation.
10. The mental stress detection device according to claim 9, wherein the processing circuitry determines a level of mental stress based on the time corresponding correlation.
11. The mental stress detection device according to claim 10, wherein: a value of the time corresponding correlation is determined with respect to time, and the processing circuitry determines a level of mental stress through comparison between the value of the time corresponding correlation and a threshold value.
12. The mental stress detection device according to claim 10, wherein the processing circuitry determines a period which does not include a negative correlation in the time corresponding correlation as a period in which mental stress is higher than in other periods.
13. The mental stress detection device according to claim 9, wherein the processing circuitry calculates the first index value and the second index value based on the plurality of heartbeat intervals RRI by using Fourier transformation.
14. The mental stress detection device according to claim 10, wherein the processing circuitry outputs at least one of a determination result and a time corresponding correlation.
15. A non-transitory computer-readable medium storing a mental stress detection program that causes a computer to execute: a process of calculating a first index value, the first index value being an index of an activity state of parasympathetic nerves with elapse of time, and a second index value, the second index value being an index of an activity state of sympathetic nerves with elapse of time, based on a plurality of heartbeat intervals RRI, wherein the process of calculating the first index value and the second index value calculates a standard deviation SD of the plurality of heartbeat intervals RRI and a root mean square RM of differences RD between heartbeat intervals RRI and calculates a ratio SD/RM between the standard deviation SD and the root mean square RM; and a process of calculating a time corresponding correlation, the time corresponding correlation being a correlation between the first index value and the second index value and being a correlation associated with time, wherein the process of calculating the time corresponding correlation calculates a correlation between the root mean square RM and the ratio SD/RM as the time corresponding correlation.
16. The mental stress detection device according to claim 11, wherein the processing circuitry determines a period which does not include a negative correlation in the time corresponding correlation as a period in which mental stress is higher than in other periods.
17. The mental stress detection device according to claim 11, wherein the processing circuitry outputs at least one of a determination result and a time corresponding correlation.
18. The mental stress detection device according to claim 12, wherein the processing circuitry outputs at least one of a determination result and a time corresponding correlation.
19. The mental stress detection device according to claim 16, wherein the processing circuitry outputs at least one of a determination result and a time corresponding correlation.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
DESCRIPTION OF EMBODIMENTS
Embodiment 1
[0019] A mental stress detection device 10 is described with reference to
[0020] ***Description of Configuration***
[0021]
[0022] The mental stress detection device 10 is a computer. The mental stress detection device 10 includes hardware such as a microprocessor 11, a memory 12, and a display 13. The microprocessor 11 is connected to other pieces of hardware via a signal line 11a and controls these other pieces of hardware.
[0023] The microprocessor 11 is an IC (Integrated Circuit) which performs arithmetic operations. Specific examples of the microprocessor 11 include a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit).
[0024] The memory 12 stores a program for realizing the function of the mental stress detection device 10, data generated by the microprocessor 11, and data inputted into the mental stress detection device 10. Specific examples of the memory 12 include a HDD (Hard Disk Drive), an SD (Secure Digital) memory card, a CF (Compact Flash), a NAND flash, a flexible disk, an optical disk, a compact disk, and a DVD (Digital Versatile Disk). The memory 12 may be a portable storage medium.
[0025] The display 13 is controlled by the microprocessor 11. When the microprocessor 11 detects rise of mental stress, the microprocessor 11 displays the detection on the display 13.
[0026] The mental stress detection device 10 includes a heartbeat information output unit 100, an index value calculation unit 200, a correlation calculation unit 300, and a mental stress determination unit 400 as functional components. Functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 are realized by software. A program for realizing the functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 is stored in the memory 12. This program is read and executed by the microprocessor 11. Thus, the functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 are realized.
[0027]
[0028] The pulse wave measurement device 20 measures a pulse wave from an ear lobe 41 or a finger 42 of a person. An LED 21 emits an infrared ray, for example, and a photo transistor 22 detects variation in blood flow. An amplifier 23 amplifies an output of the photo transistor 22. An AD converter 24 is an AD (Analog to digital) converter that converts an analog signal which is an output of the amplifier 23 into a digital signal and outputs the digital signal as the pulse wave signal 25 to the mental stress detection device 10. The pulse wave signal 25 is a signal indicating variation in blood flow. A peak of blood flow is a peak of a pulse wave. Further, a peak of a pulse wave corresponds to a heartbeat and peak time of a pulse wave is heartbeat time.
[0029] Another system 30 receives mental stress detected by the mental stress detection device 10 as a signal and performs logging or the like.
[0030]
[0031] The heartbeat information output unit 100 receives the pulse wave signal 25 indicating a plethysmogram from the pulse wave measurement device 20 and outputs heartbeat time. The heartbeat information output unit 100 receives the pulse wave signal 25 outputted from the AD converter 24 of the pulse wave measurement device 20 and calculates time R.sub.n at which a peak of a pulse wave comes. The time R.sub.n which is peak time of a pulse wave is also time of a heartbeat. The time R.sub.n is referred to below as heartbeat time.
[0032] The index value calculation unit 200 calculates an heartbeat interval RRI.sub.n which is an interval between the heartbeat time R.sub.n and heartbeat time R.sub.n-1 (RRI.sub.n=R.sub.nR.sub.n-1 described later), a standard deviation SD.sub.n which is standard deviation of the heartbeat interval RRI.sub.n, a root mean square RM.sub.n which is a root mean square of differences between adjacent heartbeat intervals RRI.sub.n (RD.sub.n=|RRI.sub.nRRI.sub.n-1| described later), and a ratio SD.sub.n/RM.sub.n which is a ratio between the standard deviation SD.sub.n and the root mean square RM.sub.n. Here, the ratio SD.sub.n/RM.sub.n is sometimes referred to as SD/RM.sub.n or SDRM.sub.n below. The heartbeat interval RRI.sub.n, the standard deviation SD.sub.n, the root mean square RM.sub.n, and the ratio SD.sub.n/RM.sub.n are described later.
[0033] The correlation calculation unit 300 calculates a moment correlation coefficient r.sub.n on the root mean square RM.sub.n and the ratio SD/RM.sub.n outputted from the index value calculation unit 200.
[0034] The mental stress determination unit 400 determines the moment correlation coefficient r.sub.n outputted from the correlation calculation unit 300, and when the mental stress determination unit 400 determines that mental stress is high, the mental stress determination unit 400 performs lighting of the display 13 and notification to another system 30.
[0035] ***Description of Operation***
[0036]
[0037]
[0038]
[0039]
[0040] An outline of the operation of the mental stress detection device 10 is described with reference to
[0041] The pulse wave measurement device 20 is attached to the ear lobe 41 or the finger 42 of a subject. In the following description, it is assumed that the pulse wave measurement device 20 is attached to the ear lobe 41 of a subject. The LED 21 and the photo transistor 22 pinch the ear lobe 41 and the photo transistor 22 catches variation in blood flow of the subject. The amplifier 23 amplifies an output of the photo transistor 22 and the AD converter 24 converts an analog signal outputted from the amplifier 23 into a digital signal. This digital signal is inputted into the microprocessor 11 as the pulse wave signal 25. Mental stress is evaluated by the functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 executed by the microprocessor 11 in software. Display by the display 13 and notification to another system 30 are performed depending on an evaluation result of mental stress.
[0042] An outline of the operations of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 is described.
[0043] (1) The heartbeat information output unit 100 first detects a peak of a pulse wave from the pulse wave signal 25 which is an output of the AD converter 24 and records occurrence time of the peak.
[0044] (2) The index value calculation unit 200 calculates the heartbeat interval RRI.sub.n which is a peak interval, the standard deviation SD.sub.n of the heartbeat interval RRI.sub.n, the root mean square RM.sub.n of a difference RD.sub.n between adjacent heartbeat intervals RRI.sub.n and RRI.sub.n-1, and the ratio SD.sub.n/RM.sub.n, which is a ratio between the standard deviation SD.sub.n and the root mean square RM.sub.n, in response to notification from the heartbeat information output unit 100 at the time of the peak detection. A section for calculating the standard deviation SD.sub.n of the heartbeat interval RRI.sub.n, and the root mean square RM.sub.n of the difference RD.sub.n between adjacent heartbeat intervals is in a range of last in pieces from the latest peak, but the range of approximately m=20 pieces is appropriate. The description of m pieces is given when
[0045] (3) The correlation calculation unit 300 is called by the index value calculation unit 200 and calculates the moment correlation coefficient r.sub.n between the root mean square RM.sub.n and the ratio SD.sub.n/RM.sub.n.
[0046] (4) The mental stress determination unit 400 is called by the correlation calculation unit 300 and evaluates the moment correlation coefficient r.sub.n. The moment correlation coefficient r.sub.n has a value within a range from 1.0 to +1.0 and the moment correlation coefficient r.sub.n is distinguished based on a threshold value. The threshold value is a preset value. The mental stress determination unit 400 determines that mental stress is high when the moment correlation coefficient r.sub.n exceeds the threshold value. An appropriate threshold value is approximately 0.2. When mental stress is high, the mental stress determination unit 400 displays the display 13. Further, the mental stress determination unit 400 transmits the moment correlation coefficient r.sub.n to another system 30.
[0047] The index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 are executed every peak detection by the heartbeat information output unit 100 in response to notification from the heartbeat information output unit 100, that is, notification through a notification process to index value calculation unit (S106). However, the index value calculation unit 200 and the others may be not only executed based on the notification process to index value calculation unit (S106) but also be processes or threads independent from the heartbeat information output unit 100. Alternatively, the index value calculation unit 200 and the others may be executed as subroutines of the heartbeat information output unit 100.
[0048] The operations of the heartbeat information output unit 100 and the others are described in detail below. The heartbeat information output unit 100 is periodically operated based on the set time sleep process (S101) so as to evaluate the pulse wave signal 25 which is outputted by the AD converter 24 in accordance with a sampling cycle. In
[0049] An AD conversion value read and record process (S102) is periodically executed and the pulse wave signal 25 is read and recorded in the measurement value file (F107) every execution of the AD conversion value read and record process (S102).
[0050] In a variation evaluation process (S103), a measurement value recorded in the measurement value file (F107) is referred to and evaluated. The pulse wave signal 25 is evaluated based on a threshold value and a differential value of the pulse wave signal 25 in the variation evaluation process (S103). The variation evaluation process (S103) is executed every time the pulse wave signal 25 is read in, and the measurement value file (F107) is referred to. Variation is evaluated based on an arbitrary algorithm in the variation evaluation process (S103).
[0051] In a peak determination process (S104), whether or not to be a peak of the pulse wave signal 25 is determined based on a result of the evaluation in the variation evaluation process (S103). A time record process (S105) is executed when a peak of the pulse wave signal 25 is determined in the peak determination process (S104). On the other hand, when a peak is not determined, a sleep state starts by the set time sleep process (S101) and continues until the following sampling cycle. When a peak is determined in the peak determination process (S104), peak time is recorded in a peak time file (F108) through the time record process (S105) and the index value calculation unit 200 is notified of the detection of the peak of the pulse wave signal 25 through the notification process to index value calculation unit (S106). When a peak is not determined in the peak determination process (S104), control is returned from the notification process to index value calculation unit (S106) to the set time sleep process (S101). Accuracy in approximately 1/1000 seconds is suitable to determine peak time. A counter value per millisecond from boot of the microprocessor 11 may be employed as long as the counter value has accuracy in approximately 1/1000 seconds.
[0052] Time or a counter value from the boot of the microprocessor 11 is recorded in the peak time file (F108) in the time record process (S105). Further, the notification process to index value calculation unit (S106) is operated from the time record process (S105) and the index value calculation unit 200 is notified of the peak occurrence, and a sleep state starts and continues until the following sampling cycle. In an RRI calculation process (S201), the peak time file (F108) is referred to, a difference between the peak time R.sub.n and the peak time R.sub.n-1 immediately preceding the peak time R.sub.n is obtained as the heartbeat interval RRI.sub.n, and the heartbeat interval RRI.sub.n is recorded in an RRI file (F206) which is a file for the heartbeat interval RRI. That is, the index value calculation unit 200 calculates the heartbeat interval RRI in the RRI calculation process (S201). Peak occurrence time is the heartbeat time R.sub.n. When peak occurrence time, that is, certain heartbeat time is set as R.sub.n, the heartbeat interval RRI.sub.n which is a difference between the heartbeat time R.sub.n and the heartbeat time R.sub.n-1 immediately preceding the heartbeat time R.sub.n is expressed as expression 1.
RRI.sub.n=R.sub.nR.sub.n-1(1)
[0053] In an SD calculation process (S202), the standard deviation SD in a range of the last m pieces of heartbeat intervals RRI is obtained and is recorded in a SD file (F207) which is a file for the standard deviation SD.
[0054] The standard deviation SD.sub.n of the heartbeat interval RRI.sub.n is calculated in the SD calculation process (S202). When calculation is performed for peaks of the last m pieces of pulse waves as illustrated in
[0055] In an RM calculation process (S203), the root mean square RM is obtained for differences between adjacent RRI.sub.n in a range of the last m pieces and is recorded in an RM file (F208) which is a file for recording root mean squares RM.
[0056] In an SD/RM calculation process (S204), the SD file (F207) and the RM file (F208) are referred to and the ratio SD/RM between SD and the RM at the same time is obtained and recorded in a SD/RM file (F209). In a correlation calculation unit calling process (S205), the correlation calculation unit 300 is called. Expression 6 is the ratio SD/RM.sub.n calculated in the SD/RM calculation process (S204) and representing a ratio between the standard deviation SD.sub.n and the root mean square RM.sub.n.
[0057] The root mean square RM.sub.n correlates to an activity of parasympathetic nerves and the ratio SD/RM.sub.n correlates to an activity of sympathetic nerves. The root mean square RM.sub.n is the first index value which is an index of an activity state of parasympathetic nerves with elapse of time. The ratio SD/RM.sub.n is the second index value which is an index of an activity state of sympathetic nerves with elapse of time.
[0058] In a moment correlation coefficient calculation process (S301), the RM file (F208) and the SD/RM file (F209) are referred to so as to calculate the moment correlation coefficient r.sub.n and the moment correlation coefficient r.sub.n is recorded in a correlation coefficient file (F303).
[0059] In a mental stress determination unit calling process (S302), the mental stress determination unit 400 is called.
[0060] The moment correlation coefficient calculation process (S301) is described in detail below. The correlation calculation unit 300 evaluates a correlation between the root mean square RM.sub.n and the ratio SD/RM.sub.n. The root mean square RM.sub.n and the ratio SD/RM.sub.n have a negative correlation in an ordinary condition of a person, while the negative correlation between the root mean square RM.sub.n and the ratio SD/RM.sub.n is lost when mental stress rises. A correlation between the root mean square RM.sub.n and the ratio SD/RM.sub.n in a set section L.sub.n denoted as L.sub.n in expression 9 is evaluated based on the moment correlation coefficient r.sub.n. The number of pieces of L.sub.n is preferably from 20 to 30, but the number is not limited to this. When the section is set to in pieces of peaks, the moment correlation coefficient r.sub.n is expressed as expression 9. The moment correlation coefficient r.sub.n represents a correlation between the root mean square RM.sub.n which is the first index value and the ratio SD/RM.sub.n which is the second index value and represents a time corresponding correlation which is a correlation associated with time. A value of the moment correlation coefficient r.sub.n which is a time corresponding correlation is determined with respect to time. Expression 7 is an expression for obtaining an average of the root mean squares RM.sub.n. Expression 8 is an expression for obtaining an average of the ratios SD/RM.sub.n. Regarding each of expression 7, expression 8, and expression 9, i, m, n, and so forth in the expression of are closed within the expression. In other words,
[0061] i, n, and m in expression 7 are used only in expression 7,
[0062] i, n, and m in expression 8 are used only in expression 8, and
[0063] i, n, and L.sub.n in expression 9 are used only in expression 9.
[0064] In a correlation coefficient evaluation process (S401), a threshold value and the moment correlation coefficient r.sub.n recorded in the correlation coefficient file (F303) are mutually compared and evaluated. The moment correlation coefficient r.sub.n is compared with the threshold value and whether or not mental stress of a person whose heartbeat R.sub.n is measured has risen is determine through the comparison and determination, in the correlation coefficient evaluation process (S401). The threshold value used for determination in the correlation coefficient evaluation process (S401) is set to 0.2.
[0065] In the case of 0.2moment correlation coefficient r.sub.n,
it is determined that mental stress is high in the correlation coefficient evaluation process (S401).
[0066] In the case of 0.2moment correlation coefficient r.sub.n,
it is not determined that mental stress is high in the correlation coefficient evaluation process (S401).
[0067] In a threshold value determination process (S402), an evaluation result obtained through the correlation coefficient evaluation process (S401) is determined. That is, whether it is determined that mental stress is high or it is not determined that mental stress is high through the correlation coefficient evaluation process (S401) is confirmed in the threshold value determination process (S402).
[0068] The display 13 is turned ON in a display ON process (S403) if it is determined that mental stress is high in the threshold value determination process (S402). The display 13 is turned OFF in a display OFF process (S404) if it is not determined that mental stress is high. In an outgoing notification process (S405), another system 30 is notified of the determination result obtained through the threshold value determination process (S402).
[0069] Alternatively, another system 30 may be notified of data recorded in the correlation coefficient file (F303) in the outgoing notification process (S405). Then, another system 30 may execute the operation of the mental stress determination unit 400. That is, the mental stress determination unit 400 is an output unit which is capable of outputting at least one of a determination result obtained through the threshold value determination process (S402) and data of the correlation coefficient file (F303).
[0070]
[0071]
[0072] In an end process (S406), the process from the RRI calculation process (S201) which is executed in response to the notification process to index value calculation unit (S106) is completed.
Advantageous Effect of Embodiment 1
[0073] According to the mental stress detection device 10 of Embodiment 1, the correlation calculation unit 300 calculates the moment correlation coefficient r.sub.n which is a correlation between the root mean square RM.sub.n and the ratio SD/RM.sub.n. Accordingly, mental stress caused by physical movement can be determined.
[0074] Further, since the moment correlation coefficient r.sub.n calculated by the correlation calculation unit 300 is a time corresponding correlation which is associated with time, variation of mental stress which varies in seconds can be followed.
Modification 1
[0075] Embodiment 1 described above has the configuration in which the heartbeat R.sub.n is measured by the pulse wave measurement device 20, but the pulse wave measurement device 20 can be replaced by an electrocardiograph. However, in this case using an electrocardiograph, the number of probes attached on a subject is larger than the case where pulse waves are measured by the pulse wave measurement device 20. Further, it is sometimes difficult to detect the heartbeat interval RRI.sub.n unless an effect of myoelectricity caused by movement of an arm or the like is removed by a filter or the like.
Modification 2
[0076] A DSP incorporated in the pulse wave measurement device 20 may perform the process up to the peak determination process (S104) of the heartbeat information output unit 100. In this case, the pulse wave signal 25 is not a value representing blood flow but is an interruption signal at peak detection timing, and the time record process (S105) is booted by an interruption process. This method does not require the microprocessor 11 to evaluate the pulse wave signal 25 every sampling cycle, being suitably applied to a microprocessor having low throughput.
Modification 3
[0077] In the above-described embodiment, the configuration is described in which an activity level of parasympathetic nerves and an activity level of sympathetic nerves are respectively evaluated based on the root mean square RM.sub.n and the ratio SD/RM.sub.n. Alternatively, the configuration may be employed in which the Fourier transformation is performed with respect to a result of the RRI calculation process (S201) so as to derive activity levels of parasympathetic nerves and sympathetic nerves based on the frequency components and moment correlation coefficients of the two are calculated in the moment correlation coefficient calculation process (S301). However, sections of approximately hundreds times of heartbeat are required so as to obtain beneficial results from the Fourier transformation, so that this configuration is not suitable for grasping variation in activity levels of nerves of a person in short time.
[0078] <***Other Configuration***>
[0079]
[0080] As another modification, the functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 may be realized by a combination of software and hardware. The microprocessor 11 and the processing circuit 910 are collectively called as a processing circuitry. The functions of the heartbeat information output unit 100, the index value calculation unit 200, the correlation calculation unit 300, and the mental stress determination unit 400 are realized by the processing circuitry. The operation of the mental stress detection device 10 may be considered as a mental stress detection program. Further, the operation of the mental stress detection device 10 may be considered as a mental stress detection method.
REFERENCE SIGNS LIST
[0081] 10: mental stress detection device; 11: microprocessor; 11a: signal line; 100: heartbeat information output unit; S101: set time sleep process; S102: AD conversion value read and record process; S103: variation evaluation process; S104: peak determination process; S105: time record process; S106: notification process to index value calculation unit; F107: measurement value file; F108: peak time file; 200: index value calculation unit; S201: RRI calculation process; S202: SD calculation process; S203: RM calculation process; S204: SD/RM calculation process; S205: correlation calculation unit calling process; F206: RRI file; F207: SD file; F208: RM file; F209: SD/RM file; 300: correlation calculation unit; S301: moment correlation coefficient calculation process; S302: mental stress determination unit calling process; F303: correlation coefficient file; 400: mental stress determination unit; S401: correlation coefficient evaluation process; S402: threshold value determination process; S403: display ON process; S404: display OFF process; S405: outgoing notification process; 12: memory; 13: display; 20: pulse wave measurement device; 21: LED; 22: photo transistor; 23: amplifier; 24: AD converter; 25: pulse wave signal; 30: another system; 41: ear lobe; 42: finger; 51: graph; 52: table