System and Method for Providing Biofeedback Controls to Various Media Based Upon the Remote Monitoring of Life Signs

Abstract

A system and method for generating biofeedback using feedback signals created by at least one media device. A subject person is monitored to obtain biometric data. The biometric data is used to generate a biometric waveform. The biometric waveform is used to generate control signals. The control signals are used to regulate audio signals, lighting, audiovisual imagery and/or auxiliary devices so that these feedbacks are altered to represent some waveform characteristic embodied by the biometric waveform. The subject person will hear and/or see the feedback and will better be able to control their body and mind.

Claims

1. A method of generating biofeedback using feedback signals created by at least one media device, said method comprising the steps of: monitoring a subject person to obtain a biometric waveform, wherein said biometric waveform has waveform characteristics; utilizing said biometric waveform to generate control signals; and controlling said at least one media device with said control signals, wherein said at least one media device broadcasts said feedback signals as directed by said control signals.

2. The method according to claim 1, wherein said at least one media device is selected from a group consisting of audio devices, lighting devices and audiovisual devices.

3. The method according to claim 1, wherein said at least one media device is an audio device that broadcasts an audio signal that is selectively altered by said control signals to correspond with at least one of said waveform characteristics of said biometric waveform.

4. The method according to claim 1, wherein said at least one media device is an audio device that broadcasts an audio signal with a pitch frequency that is selectively altered by said control signals to correspond with at least one of said waveform characteristics of said biometric waveform.

5. The method according to claim 1, wherein said at least one media device is an audio device that broadcasts an audio signal that is selectively altered in volume by said control signals to correspond with at least one of said wave characteristics of said biometric waveform.

6. The method according to claim 1, wherein said at least one media device is a lighting device that emits light that is selectively altered by said control signals to correspond with at least one of said waveform characteristics of said biometric waveform.

7. The method according to claim 1, wherein said at least one media device is a lighting device that broadcasts light with a color profile that is selectively altered by said control signals to correspond with at least one of said waveform characteristics of said biometric waveform.

8. The method according to claim 1, wherein said at least one media device is a lighting device that broadcasts light with a light intensity that is selectively altered by said control signals to correspond with at least one of said wave characteristics of said biometric waveform.

9. The method according to claim 1, wherein said at least one media device is an audiovisual device that produces imagery that is selectively altered by said control signals to correspond with at least one of said waveform characteristics of said biometric waveform.

10. The method according to claim 1, wherein said wave characteristics of said waveform are selected from a group consisting of wave peaks, wave troughs, wave frequency, wave amplitude and changes thereto for a given period of time.

11. A method of generating biofeedback using feedback signals, said method comprising the steps of: providing a media device that produces said feedback signals, wherein said feedback signals are selected from a group consisting of audio signals, light signals and audiovisual signals; providing a biomonitoring device that can detect biometric data from a person, wherein said biometric data is selected from a group consisting of breathing waveforms and heartbeat waveforms, and wherein said biometric data contains waveform characteristics other than frequency; utilizing said waveform characteristics to generate control signals; controlling said media device with said control signals, wherein said media device broadcasts and alters said feedback signals as directed by said control signals.

12. The method according to claim 11, wherein said media device broadcasts an audio signal that is selectively altered by said control signals to correspond with at least one of said waveform characteristics.

13. The method according to claim 11, wherein said media device broadcasts an audio signal with a pitch frequency that is selectively altered by said control signals to correspond with at least one of said waveform characteristics.

14. The method according to claim 11, wherein said media device broadcasts an audio signal that is selectively altered in volume by said control signals to correspond with at least one of said wave characteristics.

15. The method according to claim 11, wherein said media device emits light that is selectively altered by said control signals to correspond with at least one of said waveform characteristics.

16. The method according to claim 11, wherein said media device broadcasts light with a color profile that is selectively altered by said control signals to correspond with at least one of said waveform characteristics.

17. The method according to claim 11, wherein said media device broadcasts light with a light intensity that is selectively altered by said control signals to correspond with at least one of said wave characteristics.

18. A method of generating biofeedback using feedback signals, said method comprising the steps of: providing a portable electronic device capable of broadcasting said feedback signals, wherein said feedback signals are selected from a group consisting of audio signals, light signals and audiovisual signals; monitoring a subject person with a biomonitor to obtain biofeedback data; using said biofeedback data to generate a waveform, wherein said waveform has waveform characteristics other than frequency; utilizing said waveform to generate control signals; controlling said feedback signals with said control signals to cause said feedback signals to reflect at least one of said waveform characteristics, wherein said media device broadcasts and alters said feedback signals as directed by said control signals.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0009] For a better understanding of the present invention, reference is made to the following description of exemplary embodiments thereof, considered in conjunction with the accompanying drawings, in which:

[0010] FIG. 1 shows an overview schematic of an exemplary embodiment of the present invention biofeedback control system;

[0011] FIG. 2 shows graphs that include a biometric waveform synchronized in time with various audio signals that are controlled by the biometric waveform;

[0012] FIG. 3 shows graphs that include a biometric waveform synchronized in time with various light signals that are controlled by the biometric waveform;

[0013] FIG. 4 shows graphs that include a biometric waveform synchronized in time with audiovisual imagery that is controlled by the biometric waveform;

[0014] FIG. 5 is a block diagram that shows operational details of the biofeedback control system;

[0015] FIG. 6 shows an overview schematic of a first alternate embodiment of the present invention biofeedback control system;

[0016] FIG. 7 shows an overview schematic of a second alternate embodiment of the present invention biofeedback control system; and

[0017] FIG. 8 shows an overview schematic of a third alternate embodiment of the present invention biofeedback control system.

DETAILED DESCRIPTION OF THE DRAWINGS

[0018] The present invention biofeedback control system and method can be can embodied in many ways. A few exemplary embodiments of the monitoring system have been selected for the purposes of description and illustration that show the present invention being used by an individual who wants to meditate. The illustrated embodiments are merely exemplary and should not be considered limitations when interpreting the scope of the appended claims. Furthermore, it should be understood that although intended for meditation, the present invention can be utilized for other purposes, such as entertainment, stress relief, anxiety treatment and to treat a variety of mental health conditions.

[0019] Referring to FIG. 1, an overview of an exemplary biofeedback control system 10 is shown. The biofeedback control system, 10 requires that the breathing waveform and/or the heartbeat waveform of a person be obtained. This can be accomplished in different ways, such as with the use of biomedical sensors. However, in the preferred embodiment, the biofeedback control system 10 includes a monitoring unit 12. The monitoring unit 12 is placed in a room and is directed toward a subject person 14. In the preferred embodiment, the monitoring unit 12 does not contact the subject person 14. Rather, the monitoring unit 12 actively emits scanning signals 16, such as lidar signals or radar signals. The scanning signals 16 are not visible or audible to the subject person 14. In this manner, the scanning signals 16 do not serve as a distraction to the subject person 14 attempting to meditate. Furthermore, the scanning signals 16 are low-energy signals that are harmless to the subject person 14 and any other sensitive electronic equipment, such as a pacemaker, that may be present.

[0020] The monitoring unit 12 emits the scanning signals 16 and receives back reflected signals 18 that reflect from the subject person 14. The monitoring unit 12 has a central processing unit 13 that runs operational software 19. The monitoring unit 12 detects the reflected signals 18 and uses circuitry and processing software to specifically extract biometric data from the reflected signals 18 that are associated with the breathing and/or heartbeat of the subject person 14. The extracted biometric data is then used to generate a biometric waveform 20, that can be either a heartbeat waveform or the illustrated breathing waveform. The methodology used to generate biometric waveforms 20 is disclosed in U.S. Patent Application Publication No. 2019/0139389 to White et al, the disclosure of which is herein incorporated by reference.

[0021] As will be explained, the biometric waveform 20 identified by the monitoring unit 12 is used to produce control signals 30 that control the output of various media devices 22. The control signals 30 are generated in real time with a latency that is unperceivable by the user. In this manner, the control of the media devices 22 seems synchronized with user's biometrics. The media devices 22 include audio devices 24, lighting devices 26 and auxiliary devices 28. The audio devices 24 are devices, such as digital music players and virtual assistant AIs, that broadcast audio signals 25 in the form of music, tones, spoken words, or any other audio. The lighting devices 26 are devices, such as lighting fixtures and LED arrays, that produce light signals 27 in the form of polychromatic, monochromatic, or any other kind of light. The auxiliary devices 28 are electronic devices, such as televisions smartphones, scent infusers or the like that produce other perceptible signals 29. The media devices 22 can be integrated into the monitoring unit 12. If mot, the media devices 22 receive control signals 30 from the monitoring unit 12. This can be done using either cables or by establishing a wireless data link, such as a Bluetooth® data link.

[0022] Referring to FIG. 2 in conjunction with FIG. 1, the biometric waveform 20 being shown is a breathing waveform. It will be understood that a heartbeat waveform can also be used. However, a breathing waveform is illustrated since a person has more conscious control over breathing than they do over their heartbeat. As such, a breathing waveform is more sensitive to biofeedback. From the figures, it can be seen that the exemplary biometric waveform 20 that is identified by the monitoring unit 12 has wave peaks 32 that alternate with wave troughs 34. In the exemplary biometric waveform 20, the wave peaks 32 occur at time positions T1 and T3. The wave troughs 34 occur at time positions T2 and T4. The wave peaks 32 and the wave troughs 34 are connected by ascending wave sections 36 and descending wave sections 38. The ascending wave sections 36 occur between time positions T2 and T3. The descending wave sections 38 occur between time positions T1 and T2. The periodicity of the wave peaks 32 and the wave troughs 34 is determined by the rate of breathing of the subject person 14 at any given moment in time. Typically, the faster the subject person 14 is breathing, the shorter the rise and fall times of the biometric waveform 20. Furthermore, the biometric waveform 20 has an amplitude that corresponds to the vertical distance between the wave peaks 32 and the wave troughs 34. The amplitude of the biometric waveform 20 corresponds to the degree of chest displacement when breathing. Deep breaths have larger amplitudes than do shallow breaths.

[0023] The biometric waveform 20 is used to generate corresponding control signals 30. The control signals 30 are generated and executed in a fraction of a second, so as to provide no perceivable latency to the user. As mentioned, the control signals 30 can be used to control various media devices 22 that produce audio signals 25, light signals 27 and/or perceptible signals 29. In FIG. 2, a first audio signal 25A is shown that is synchronized in time with the biometric waveform 20. The first audio signal 25A can be a tone, music, or any other audible sound. The first audio signal 25A is produced by an audio device 24 that is controlled by the control signal 30 generated by the monitoring unit 12. As can be seen, the first audio signal 25A can be controlled in volume by the control signal 30. The volume can be caused to increase in intensity during times (T2-to-T3) when the biometric waveform 20 is ascending. Likewise, the volume can be caused to decrease in intensity during times (T1-to-T2) when the biometric waveform 20 is descending. The volume of the first audio signal 25A, therefore, peaks in time with the peaks of the biometric waveform 20. The audio signal, therefore, varies with features of the biometric waveform other than just frequency. The features may include inflection points, rise time, fall time, acceleration rate, deceleration rate, pauses in breathing and the like. As such, the subject person 14 meditating will hear the first audio signal 25A as it increases and decreases in volume while the subject person 14 breaths. This provides audio feedback that can help the subject person 14 regulate his/her breathing.

[0024] Also shown in FIG. 2 is a second audio signal 25B that is synchronized in time with the biometric waveform 20. The second audio signal 25B can be a tone or a series of tones, that change in frequency as a function of the biometric waveform 20. The second audio signal 25B is produced by an audio device 24 that is controlled by the control signal 30 generated by the monitoring unit 12. As can be seen, the second audio signal 25B can be controlled in pitch by the control signal 30. The volume can be caused to increase in frequency during times (T2-to-T3) when the biometric waveform 20 is ascending. Likewise, the frequency can decrease during times (T1-to-T2) when the biometric waveform 20 is descending. The frequency of the second audio signal 25B, therefore, peaks in time with the biometric waveform 20. The audio signal, therefore, varies with features of the biometric waveform other than just frequency. As such, the subject person 14 meditating will hear an audio signal that changes in frequency as the subject person 14 breathes. This provides audio feedback that can help the subject person 14 regulate his/her breathing.

[0025] Referring to FIG. 3 in conjunction with FIG. 1, it will be understood that the control signals 30 generated from the biometric waveform 20 can be used to control various lighting devices 26 that produce light signals 27, such as an adjustable light fixture or an array of LEDs. In FIG. 3, a first light signal 27A is shown that is synchronized in time with the biometric waveform 20. As can be seen, the first light signal 27A can be controlled in frequency (i.e. color) by the control signal 30. By way of example, the color can transition from green toward red during times (T2-to-T3) when the biometric waveform 20 is ascending. Likewise, the color can change in frequency to transition back toward green during times (T1-to-T2) when the breathing waveform 20 is descending. The colors of the first light signal 27A therefore change in time with the biometric waveform 20. As such, the subject person 14 meditating will see colors that change as the subject person 14 breathes. This provides visual feedback that can help the subject person 14 regulate his/her breathing.

[0026] FIG. 3 also illustrates a second light signal 27B that is shown that is synchronized in time with the biometric waveform 20. The second light signal 27B can be a polychromatic or monochromatic light that changes in intensity as a function of the biometric waveform 20. The second light signal 27B is produced by the lighting device 26 that is controlled by the control signal 30 generated by the monitoring unit 12. The intensity of the second light signal 27B can be caused to increase during times (T2-to-T3) when the biometric waveform 20 is ascending. Likewise, the intensity can decrease during times (T1-to-T2) when the biometric waveform 20 is descending. The intensity of the second light signal 27B therefore peaks in time with the biometric waveform 20. As such, the subject person 14 meditating will see the changes in intensity as the subject person 14 breathes. This provides visual feedback that can help the subject person 14 regulate his/her breathing.

[0027] Referring to FIG. 4 in conjunction with FIG. 1, it will be understood that the control signal 30 generated from the biometric waveform 20 can be used to control various auxiliary devices 28 such as a smartphone, that produce audio visual signals or other perceptible signals 29. In FIG. 4, the perceptible signal 29 is imagery and sounds that are synchronized in time with the biometric waveform 20. As can be seen, the audiovisual signal 29 can be a video of a scene that changes in time. As illustrated, the video is a skyscape that can change between rainy and sunny. By way of example, the video imagery can transition from rainy toward sunny should the frequency of the biometric waveform 20 slow. Conversely, the video imagery can transition back toward rainy should the frequency of the biometric waveform 20 increase. As such, the subject person 14 meditating will see imagery that changes as that person's respiration rate changes. This provides audiovisual feedback that can help the subject person 14 regulate his/her breathing.

[0028] From the above, it will be understood that audio signals 25, light signals 27 and/or perceptible signals 29 can be varied in a variety of ways by the control signal 30. The control signal 30 can control the audio signals 25, light signals 27 and/or perceptible signals 29 to be time synchronized and amplitude synchronized with the biometric waveform 20. Alternatively, the audio signals 25, light signals 27 and/or perceptible signals 29 can be altered as a function of the frequency (i.e. respiration rate) of the biometric waveform 20 and/or by a rate of change in amplitude (i.e. alterations in deepness of breaths) of the biometric waveform 20.

[0029] Referring to FIG. 5 in conjunction with FIG. 1, it will now be understood that the monitoring unit 12 extracts the biometric waveform 20 from the reflected signals 18 that reflect from the subject person 14. See Block 40. Using the operational software 19, the monitoring unit 12 detects the wave peaks 32 and wave troughs 34 embodied by the biometric waveform 20. See Block 42. With the wave peaks 32 and wave troughs 34 identified, changes in frequency and amplitude over time can be determined. See Block 44. Changes in frequency coincide with changes in respiration rate. Changes in amplitude coincide with changes in the depth of breathing.

[0030] Optionally, range boundaries for the frequency and amplitude of the biometric waveform 20 can be calculated or set. Alternatively, the operational software 19 can calculate a person's average respiration rate and average breathing amplitude through direct measurements over time. These average values can then be used to determine appropriate high/low ranges for the audio signals 25, light signals 27 and/or perceptible signals 29.

[0031] Using the high/low ranges, the monitoring unit 12 generates control signals 30 that are a function of the biometric waveform 20. See Block 48. The control signals 30 are sent to the various media devices 22 that are used by the biofeedback control system 10 in order to operate those media devices 22. See Block 50. The media devices 22 create the audio signals 25, light signals 27 and/or perceptible signals 29 bounded within the selected high/low ranges. In this manner, what might be considered a red line for one user may not be for another user. Rather, the biofeedback control system 10 adjusts to the life signs of the subject person 14.

[0032] In the embodiment of the biofeedback control system 10 described above, the monitoring unit 12 contains the central processing unit 13 that runs the operational software 19. It is the operational software 19 that identifies the biometric waveform 20 and creates the corresponding control signals 30. Referring to FIG. 6, an alternate embodiment of a biofeedback control system 60 is shown. In this embodiment, a monitoring unit 62 is linked to a computing device 64, such as a tablet computer or a smartphone. The monitoring unit 62 contains the circuitry and components needed to broadcast scanning signals 66 and detect reflected signals 68. However, the monitoring unit 62 does not contains a processing unit. Rather, the monitoring unit 62 is controlled by the computing device 64. The computing device 64 receives the data for the reflected signals 68 from the monitoring unit 62. The computing device 64 runs operational software 71 that generates control signals 69 and forwards the control signals 69 to any media devices 22 in use.

[0033] Modern smartphones use depth mapping in order to perform autofocus features. Some smartphones are being equipped with lidar scanners by the manufacturers. Referring to FIG. 7, an alternate embodiment of a biofeedback control system 70 is shown. In this embodiment, no separate monitoring unit is used. Rather a smartphone 72 is used that contains an internal lidar system 74. The lidar system 74 enables the smartphone 72 to generate scanning signals 76 and receive back reflected signals 78. The smartphone 72 processes the reflected signals 78. The smartphone 72 runs operational software 80 that generates the control signals 82 and forwards the control signals 82 to any media devices 22 in use.

[0034] In all prior exemplary embodiments, the biometric waveform was obtained remotely. This need not be a limitation. The biometric waveform can be obtained in active manners, using a variety of sensors. There are many fitness monitors sold in commerce that are capable of detecting heartbeat waveforms and/or biometric waveforms. Such devices typically communicate with software being run on a smartphone, via a Bluetooth® connection. Referring to FIG. 8, an alternate embodiment of a biofeedback control system 90 is shown. In this embodiment, a biomonitor 92 is worn by the person trying to meditate. The biomonitor 92 can detect biometric data in the form of a breathing waveform and/or a heartbeat waveform. Biometric data 93 is then transmitted to a smartphone 94. The biometric data 93 can be transferred using a cable or using a wireless transmission. The smartphone 94 processes the biometric data 93. The smartphone 94 runs operational software 96 that generates the control signals 98 and forwards the control signals 98 to any media devices 22 in use.

[0035] It will be understood that the embodiments of the present invention that are illustrated and described are merely exemplary and that a person skilled in the art can make many variations to those embodiments. All such embodiments are intended to be included within the scope of the present invention as defined by the appended claims.