HEART RATE MEASUREMENTS USING HEARING DEVICE AND APP

Abstract

A method for monitoring placement of a first physiologic sensor of a hearing device with respect to an ear of a user, the first physiologic sensor configured to monitor a heart rate of the user of the hearing device, includes: obtaining first physiologic sensor data from the first physiologic sensor at the hearing device; obtaining second physiologic sensor data from a second physiologic sensor at an external device, the second physiologic sensor configured to detect the heart rate of the user; performing a comparison based on the first physiologic sensor data from the first physiologic sensor, and the second physiologic sensor data from the second physiologic sensor; and setting a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data if the comparison results in a match, or providing a notification if the comparison does not result in a match.

Claims

1. A method for monitoring placement of a first physiologic sensor of a hearing device with respect to an ear of a user, the first physiologic sensor configured to monitor a heart rate of the user of the hearing device, the method comprising: obtaining first physiologic sensor data from the first physiologic sensor at the hearing device; obtaining second physiologic sensor data from a second physiologic sensor at an external device, the second physiologic sensor configured to detect the heart rate of the user; performing a comparison based on the first physiologic sensor data from the first physiologic sensor, and the second physiologic sensor data from the second physiologic sensor; and setting a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data if the comparison results in a match, or providing a notification if the comparison does not result in a match.

2. The method according to claim 1, wherein the notification indicates that a position of the first physiologic sensor needs adjustment.

3. The method according to claim 1, further comprising, after the notification is provided: receiving further first physiologic sensor data from the first physiologic sensor; performing a comparison based on the further first physiologic sensor data from the first physiologic sensor, and the second physiologic sensor data from the second physiologic sensor.

4. The method according to claim 1, wherein the first physiologic sensor is a photoplethysmographic (PPG) sensor.

5. The method according to claim 4, wherein the first PPG sensor at the hearing device comprises a light emitter and a light detector, and wherein the hearing device comprises a main body having a first window configured to allow passage of light emitted by the light emitter towards a skin of the ear, and a second window configured to allow passage of a reflected light from the skin of the ear towards the light detector.

6. The method according to claim 1, further comprising determining a resting heart rate value of the user based on the reference physiologic sensor data.

7. The method according to claim 1, further comprising detecting first heart rate variability (HRV) data based on the first physiologic sensor data.

8. The method according to claim 7, further comprising detecting second heart rate variability (HRV) data based on the second physiologic sensor data.

9. The method according to claim 8, wherein the performing the comparison comprises comparing the first heart rate variability (HRV) data and the second heart rate variability (HRV) data.

10. The method according to claim 9, wherein the reference physiologic sensor data is set based on the first physiologic sensor data and/or the second physiologic sensor data if the first HRV data matches the second HRV data.

11. The method according to claim 9, wherein the notification is provided if the first HRV data does not match the second HRV data.

12. The method according to claim 1, wherein the hearing device comprises a gyroscope sensor, and wherein the method comprises obtaining a three-dimensional (3D) position of the gyroscope sensor, and setting the 3D position as a reference 3D position of the gyroscope sensor when the reference physiologic sensor data is set.

13. The method according to claim 1, wherein the method is performed by the external device.

14. The method according to claim 1, wherein the external device is a smartphone, and wherein the second physiologic sensor is at the smartphone.

15. The method according to claim 14, wherein the method is performed by the smartphone.

16. The method according to claim 14, wherein the smartphone comprises a camera lens and an LED light source, and wherein the second physiologic sensor is configured to detect a pulse in a fingertip of the user when the user places the fingertip on the camera lens and the LED light source.

17. The method according to claim 1, wherein the method is performed by an electronic device.

18. A non-transitory processor-readable medium storing a set of instructions, an execution of which will cause the method of claim 1 to be performed.

19. An electronic device comprising: a processing unit configured to obtain first physiologic sensor data from a first physiologic sensor at a hearing device, and obtain second physiologic sensor data from a second physiologic sensor configured to detect a heart rate of a user; wherein the processing unit of the electronic device is also configured to perform a comparison based on the first physiologic sensor data from the first physiologic sensor, and the second physiologic sensor data from the second physiologic sensor; and wherein the processing unit is configured to set a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data if the comparison results in a match, or provide a notification if the comparison does not result in a match.

20. The electronic device according to claim 19, wherein the electronic device comprises a smartphone.

21. The electronic device according to claim 19, wherein the second physiologic sensor is at a smartphone.

22. A non-transitory processor-readable medium storing a set of instructions, an execution of which will cause a method to be performed, the method comprising: obtaining first physiologic sensor data from the first physiologic sensor at the hearing device; obtaining second physiologic sensor data from a second physiologic sensor configured to detect a heart rate of a user; performing a comparison based on the first physiologic sensor data from the first physiologic sensor, and the second physiologic sensor data from the second physiologic sensor; and setting a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data if the comparison results in a match, or providing a notification if the comparison does not result in a match.

23. A hearing device comprising: a first physiologic sensor configured to monitor a heart rate of a user of the hearing device; and a communication interface configured to communicate with an electronic device; wherein the hearing device is configured to transmit, via the communication interface, at least a first physiologic sensor data from the first physiologic sensor to the electronic device for monitoring placement of the first physiologic sensor with respect to an ear of the user.

24. The hearing device according to claim 23, wherein the first physiologic sensor comprises a PPG sensor, the PPG sensor comprising a light emitter and a light detector.

25. The hearing device according to claim 24, further comprising a main body having a first window configured to allow passage of light emitted by the light emitter towards a skin of the ear, and a second window configured to allow passage of a reflected light from the skin of the ear towards the light detector.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0098] The above and other features and advantages will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:

[0099] FIG. 1 schematically illustrates an example of a method configured to be performed in an electronic device.

[0100] FIG. 2 schematically illustrates a block diagram of a hearing device with a first physiologic sensor.

[0101] FIGS. 3a and 3b schematically illustrate examples of a system, hearing device, electronic device, external device and method configured to be performed in the electronic device.

[0102] FIGS. 4a, 4b and 4c schematically illustrate an exemplary embodiment where the electronic device is a smartphone, and where the second physiologic sensor comprises a camera lens and an LED light source of the smartphone.

[0103] FIGS. 5a, 5b and 5c schematically illustrate examples of notifications provided regarding adjusting the position of the first physiologic sensor in the ear of the user.

[0104] FIG. 6 schematically illustrates a hearing device comprising a first physiologic sensor, e.g. a PPG sensor.

DETAILED DESCRIPTION

[0105] Various embodiments are described hereinafter with reference to the figures. Like reference numerals refer to like elements throughout. Like elements will, thus, not be described in detail with respect to the description of each figure. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.

[0106] Throughout, the same reference numerals are used for identical or corresponding parts.

[0107] FIG. 1 schematically illustrates an example of a method 100 configured to be performed in an electronic device. The method 100 is for monitoring correct placement of a first physiologic sensor in/on/at an ear of a user. The first physiologic sensor is arranged in a hearing device, such as a hearing aid. The first physiologic sensor in the hearing device is configured for monitoring the heart rate of the user wearing the hearing device. The electronic device and the hearing device are configured to be connected. The method 100 comprises, at the electronic device, receiving 102 first physiologic sensor data from the first physiologic sensor. The method comprises, at the electronic device, receiving 104 second physiologic sensor data from a second physiologic sensor provided in an external device, where the external device is configured for detecting the heart rate of the user using the second physiologic sensor. The method comprises, at the electronic device, comparing 106 the first physiologic sensor data from the first physiologic sensor with the second physiologic sensor data from the second physiologic sensor. The method comprises, at the electronic device, determining 108 whether the first physiologic sensor data match the second physiologic sensor data. The method comprises, at the electronic device, in accordance with a determination that the first physiologic sensor data match the second physiologic sensor data, setting 110 a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data. The method comprises, at the electronic device, in accordance with a determination that the first physiologic sensor data do not match the second physiologic sensor data, providing 112 a notification regarding adjusting the position of the first physiologic sensor in/on/at the ear of the user.

[0108] When the first physiologic sensor data do not match the second physiologic sensor data, then subsequently to providing 112 the notification regarding adjusting the position of the first physiologic sensor, the method comprises receiving 114 further first physiologic sensor data from the first physiologic sensor. The method comprises comparing 106 the further first physiologic sensor data from the first physiologic sensor with the second physiologic sensor data from the second physiologic sensor. The method comprises determining 108 whether the further first physiologic sensor data match the second physiologic sensor data. These steps 106, 108, 112 and 114 may be repeated one or more times until the first physiologic sensor data match the second physiologic sensor data. When determining that the first physiologic sensor data match the second physiologic sensor data; then the method comprises setting the reference physiologic sensor data based on the first physiologic and/or the second physiologic sensor data.

[0109] FIG. 2 schematically illustrates a block diagram of a hearing device 1, such as a hearing aid, with a first physiologic sensor 41. The first physiologic sensor 41 may be configured for being placed in/on/at the ear of a user. The first physiologic sensor 41 may be configured for being placed in the ear canal of the user. The first physiologic sensor 41 may be a PPG sensor. The hearing device 1 comprises a microphone 42, for receiving an input signal and converting it into an audio signal. The audio signal is provided to a processing unit 44 for processing the audio signal and providing a processed output signal for compensating a hearing loss of a user of the hearing device 1. A receiver 46 is connected to an output of the processing unit 44 for converting the processed output signal into an output sound signal, e.g. a signal modified to compensate for a user's hearing impairment. Typically, the receiver 46 comprises a transducer, and the receiver 46 is often referred to as a speaker. The processing unit 44 may comprise elements such as amplifiers, compressors, noise reduction systems, etc. The hearing device 1 comprises the first physiologic sensor 41. The hearing device 1 may further comprise a wireless communication unit 48 for wireless data communication interconnected with an antenna structure 50 for emission and reception of an electromagnetic field. The wireless communication unit 48, such as a radio or a transceiver, connects to the processing unit 44 and the antenna structure 50, for communicating with an electronic device, an external device, or with another hearing device, such as another hearing aid located in/on/at another ear of the user, typically in a binaural hearing system. The hearing device 1 may comprise two or more antenna structures. A first antenna may be for connecting to an electronic device, such as a smart phone of the user. A second antenna may be for connection with another hearing device, such as a hearing aid. A third antenna may be for connecting with an external device comprising a second physiologic sensor, e.g. a chest strap, a pulse watch or a medical heart rate monitor such as attached to the finger of the user, for detecting the heart rate of the user.

[0110] The hearing device 1 may be a behind-the-ear hearing device, and may be provided as a behind-the-ear module. The hearing device 1 may be an in-the-ear hearing device and may be provided as an in-the-ear module. Alternatively, parts of the hearing device 1 may be provided in a behind-the-ear module, while other parts, such as the receiver 46, may be provided in an in-the-ear module.

[0111] FIG. 3a schematically illustrates an example of a system 60, hearing device 1, electronic device 70, external device 80 and method configured to be performed in the electronic device 70. The method is for monitoring correct placement of a first physiologic sensor 41 in/on/at an ear of a user 52. The first physiologic sensor 41 is arranged in a hearing device 1. The first physiologic sensor 41 in the hearing device 1 is configured for monitoring the heart rate of the user 52 wearing the hearing device 1. The electronic device 70 and the hearing device 1 are configured to be connected 54, e.g. wirelessly by means of Bluetooth (BT). The method comprises, at the electronic device 70, receiving first physiologic sensor data from the first physiologic sensor 41. The method comprises, at the electronic device 70, receiving second physiologic sensor data from a second physiologic sensor 56 provided in the external device 80, where the external device 80 is configured for detecting the heart rate of the user 52 using the second physiologic sensor 56. The electronic device 70 and the external device 80 are configured to be connected 54, e.g. wirelessly by means of Bluetooth (BT). The method comprises, at the electronic device 70, comparing the first physiologic sensor data from the first physiologic sensor 41 with the second physiologic sensor data from the second physiologic sensor 56. The method comprises, at the electronic device 70, determining whether the first physiologic sensor data match the second physiologic sensor data. The method comprises, at the electronic device 70, in accordance with a determination that the first physiologic sensor data match the second physiologic sensor data, setting a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data. The method comprises, at the electronic device 70, in accordance with a determination that the first physiologic sensor data do not match the second physiologic sensor data, providing a notification 58 regarding adjusting the position of the first physiologic sensor 41 in/on/at the ear of the user 52.

[0112] A software application, e.g. app, which is installed in the electronic device 70 may be used. The app is started. The app starts listening for and/or requesting for the first physiologic sensor data form the hearing device 1 and the second physiologic sensor data from the external device 80. When the software application receives the first physiologic sensor data and the second physiologic sensor data, the software application may initiate the method described above.

[0113] The second physiologic sensor data may be obtained from a different physical point or part or location on the user's 52 body or skin than where the first physiologic sensor data is obtained. The first physiologic sensor data is obtained in/on/at the ear of the user 52. The second physiologic sensor data may be obtained e.g. at the chest or wrist or finger of the user 52. The first physiologic sensor data and the second physiologic sensor data are configured to be detected simultaneously.

[0114] FIG. 3a illustrates an exemplary embodiment where the external device 80 can be a pulse watch or medical finger sensor which is configured for obtaining physiologic sensor data of the user. The pulse watch is configured to obtain physiologic sensor data from the wrist or the skin of the wrist of the user.

[0115] The external device 80 may be a medical finger sensor which is configured for obtaining physiologic sensor data of the user 52. The medical finger sensor is configured to obtain physiologic sensor data from the finger or the skin of the finger of the user. A medical finger sensor is typically used to measure a patient's heart rate by medical doctors in hospitals.

[0116] The external device 80 may alternatively be a chest strap which is configured to obtain physiologic sensor data from the chest or the skin of the chest of the user. Chest straps and pulse watches are typically used by a user to measure his/her own heart rate when performing sports.

[0117] FIG. 3b shows an exemplary embodiment where the external device 80 may be the electronic device 70, e.g. a smartphone, tablet, pc, computer etc., in which case the electronic device 70 is configured for obtaining the second physiologic sensor data of the user 52.

[0118] When the external device 80 is the electronic device 70, the second physiologic sensor 56 is provided in the electronic device 70. The electronic device 70 may be a smartphone, and the second physiologic sensor 56 may comprise a camera lens and an LED light source, see FIGS. 4a, 4b and 4c, of the electronic device 70, e.g. smartphone. The second physiologic sensor 56 may be configured for detecting the pulse in the user's fingertip, when the user 52 places his/her fingertip on the camera lens and LED light source, see FIGS. 4a, 4b and 4c.

[0119] FIGS. 4a, 4b and 4c schematically illustrate an exemplary embodiment where the electronic device 70 is a smartphone, and where the second physiologic sensor 56 comprises a camera lens 72 and an LED light source 74 of the smartphone 70. The second physiologic sensor 56 is configured for detecting the pulse in the user's 52 fingertip 62, when the user 52 places his/her fingertip 62 on the camera lens 72 and LED light source 74. The second physiologic sensor 56 can thus be provided in the electronic device 70 as the camera 72 of the electronic device 70 and a LED light source 74 of the electronic device 70 are working as e.g. a PPG sensor. The method for detecting the second physiologic sensor data may be as follows. A software application, e.g. app, which is installed in the smartphone 70 is used. The app is started. The app starts listening for and/or requesting for the first physiologic sensor data form the hearing device 1 and the second physiologic sensor data from the electronic device 70. The user 52 places his/her fingertip 62 in the area of the smartphone's 70 camera module 76. The camera module 76 comprising the LED light source 74 and the camera lens 72. The camera module 76 may be placed on the rear side of the smartphone 70. The LED light 74 of the camera module 76 is thereby turned on and thereby illuminating the user's fingertip 62. Through the camera lens 72 the camera module 76 starts recording a video of the illuminated fingertip 62. After recording is finished, a peripheral pulse wave can be extracted from the video signals. Based on the peripheral pulse wave, the heart rate of the user 52 can be determined. Recording may take seconds or minutes, such as less than 5 seconds, less than 10 seconds, less than 20 seconds, less than 40 seconds, less than 1 minute, less than 2 minutes, less than 3 minutes, less than 4 minutes, or less than 5 minutes. The smart phone 70 may be an iPhone 4S. The pulse wave signal may be derived/extracted from a green light spectrum channel of the recorded video signal. Signals may be filtered using a bandpass filter with a lower and upper cut-off frequency of 0.5 and 7 Hz, respectively. The heartbeat detection may be based on a combination of morphology and frequency analysis of the pulse wave and applied to detect all beat-to-beat intervals (BBI). From the extracted BBI time series, indices representing the variability of heart rhythm may be calculated and analysed regarding their ability to discriminate between Atrial fibrillation (AF) and (sinus rhythm) SR. For the analysis, premature beats and other disruptions may be eliminated and corresponding points on the BBI time series may be replaced, using an algorithm for adaptive variance estimation. When the software application receives the first physiologic sensor data and the second physiologic sensor data, the software application may initiate the method 100 described with FIG. 1.

[0120] FIGS. 5a, 5b and 5c schematically illustrates examples of notifications 58, also referred to as 58a, 58b and 58c, provided regarding adjusting the position of the first physiologic sensor in/on/at the ear of the user. The method in the electronic device 70 comprises in accordance with a determination that the first physiologic sensor data do not match the second physiologic sensor data, providing a notification 58 regarding adjusting the position of the first physiologic sensor in/on/at the ear of the user. If the first physiologic sensor data and the second physiologic sensor data do not match, it may be assumed that the first physiologic sensor is not correctly placed in/on/at the ear of the user. A notification 58 in the electronic device 70 may be provided to the user. The notification 58 may comprise instructions to the user for adjusting the position of the first physiologic sensor in/on/at his/her ear. The first physiologic sensor may be implemented in the hearing device, thus the notification to the user may regard adjusting the position of the hearing device, whereby the first physiologic sensor in the hearing device is also adjusted in position relative to the ear of the user. The purpose of the notification 58 is to make the user adjust the position of the first physiologic sensor, such that the first physiologic sensor is placed correctly to monitor the heart rate in the ear of the user.

[0121] The notification 58 may be in the form of a recommendation, an error message, and/or instructions to adjust the position of the first physiologic sensor in the ear and/or adjust the position of the hearing device in the ear. The notification 58 may be instructions to the user to change a fitting member, see FIG. 6, of the hearing device to obtain a better fit of the hearing device in the ear. The notification 58 may be directed to the user or to a hearing care professional (HCP) who is assisting the user with the hearing device. The notification 58 may be instructions 58c in a first user interface of the electronic device 70, e.g. a graphical user interface on the user's smartphone 70, which is connected to the hearing device. The notification 58 may be visual, audio and/or tactile. The notification 58 may comprise visual, audio and/or tactile notifications 58.

[0122] FIG. 5a shows an example of a tactile notification 58a which may be a haptic feedback or a vibration alerting the user that the hearing device, and thereby the first physiologic sensor, is not correctly placed in the ear. The tactile notification 58a may be generated by a tactile output generator in the electronic device 70.

[0123] FIG. 5b) shows an example of an audio notification 58b which may be a sound alerting the user that the hearing device, and thereby the first physiologic sensor, is not correctly placed in the ear. The sound may be a tone or a voice speaking. The audio notification 58b may be transmitted from a loudspeaker in the electronic device 70.

[0124] FIG. 5c) shows an example of a visual notification 58c which may be a text alert stating e.g. “Please adjust position of your hearing device in the ear for improved monitoring of heart rate”. A visual notification 58c may be a text message stating e.g. “Please push your hearing device further into your ear canal”, and/or “Please move your hearing device closer to an ear wall/the concha wall/concha skin”. A visual notification 58c may comprise a picture of the desired orientation of the hearing device, e.g. showing that the end/side/face of the hearing device, where the first physiologic sensor is arranged, should point towards a specific ear wall, e.g. the concha wall or concha skin, in the ear. The visual notification 58c may be displayed in a graphical user interface of the electronic device 70.

[0125] For obtaining reliable first physiologic sensor data and second physiologic sensor data, the user should sit or lie still, i.e. the user should not be moving, when the first physiologic sensor data and the second physiologic sensor data are obtained or measured. Thus, if the first physiologic sensor data does not match the second physiologic sensor data it may be because the user is not sitting still but is moving. Thus, the notification 58 may comprise instructions to the user to sit or lie still.

[0126] FIG. 6 schematically illustrates a hearing device 1 comprising a first physiologic sensor 41 (not shown), e.g. a PPG sensor. The hearing device 1 comprises a behind-the-ear (BTE) unit 82 and an in the ear unit 84. In the BTE unit 82, the microphone(s) 42 and the processing unit 44 (not shown) may be arranged. The BTE unit 82 is configured to be arranged behind the ear of the user. A wire or cable or tube 86 connects the BTE unit 82 with the in the ear unit 84. The in the ear unit 84 may comprise a receiver 46 (not shown). The in the ear unit 84 may comprise a fitting member 85, such as an earpiece or dome. The fitting member 85 may be covering and/or connected to the receiver 46 (not shown). The in the ear unit 84 comprises the first physiologic sensor 41. The first physiologic sensor 41 is configured to be arranged in the ear canal 88 for measuring the first physiologic sensor data. The first physiologic sensor 41 may be a PPG sensor measuring the heart rate of the user. A PPG sensor is an optical sensor comprising a light emitter (LED) and a light detector. The first physiologic sensor 41 comprises a main body 18. The main body 18 comprises window means, such as a first window 8 through which light emitted by a light emitter (LED) is configured to be transmitted and a second window 9 through which a reflection from the light emitted by the light emitter (LED) is configured to be detected by a light detector. The window means 8, 9 may be made of a material which blocks visible light but allows near infrared light. Thus, the main body 18 also comprises the light detector for detecting the reflected light from the skin. Furthermore, the main body 18 may comprise an inertial measurement unit (IMU), such as an accelerometer.

[0127] Although particular features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be made obvious to those skilled in the art that various changes and modifications may be made without departing from the scope of the claimed invention. The specification and drawings are, accordingly to be regarded in an illustrative rather than restrictive sense. The claimed invention is intended to cover all alternatives, modifications and equivalents.

LIST OF REFERENCES

[0128] 1 hearing device [0129] 8 first window [0130] 9 second window [0131] 18 main body [0132] 41 first physiologic sensor [0133] 42 microphone [0134] 44 processing unit [0135] 46 receiver [0136] 48 wireless communication unit [0137] 50 antenna structure [0138] 52 user [0139] 54 wireless connection [0140] 56 second physiologic sensor [0141] 58 notification [0142] 60 system [0143] 70 electronic device [0144] 72 camera lens [0145] 74 LED light source [0146] 76 camera module [0147] 80 external device [0148] 82 behind-the-ear (BTE) unit [0149] 84 in ear unit [0150] 85 fitting member [0151] 86 cable, wire, tube [0152] 88 ear canal [0153] 100 method [0154] 102 receiving first physiologic sensor data from the first physiologic sensor [0155] 104 receiving second physiologic sensor data from a second physiologic sensor [0156] 106 comparing the first physiologic sensor data from the first physiologic sensor with the second physiologic sensor data from the second physiologic sensor [0157] 108 determining whether the first physiologic sensor data match the second physiologic sensor data [0158] 110 setting a reference physiologic sensor data based on the first physiologic sensor data and/or the second physiologic sensor data [0159] 112 providing a notification regarding adjusting the position of the first physiologic sensor in the ear of the user [0160] 114 receiving further first physiologic sensor data from the first physiologic sensor