Contactless cardiopulmonary signal estimation method and apparatus
10470668 ยท 2019-11-12
Assignee
Inventors
- Jung Bin KIM (Seoul, KR)
- Soon Young Eom (Daejeon, KR)
- Joung Myoun Kim (Daejeon, KR)
- Tae Jin Chung (Daejeon, KR)
- Jae Ick Choi (Daejeon, KR)
Cpc classification
A61B5/7246
HUMAN NECESSITIES
A61B5/0205
HUMAN NECESSITIES
A61B5/0816
HUMAN NECESSITIES
International classification
A61B5/0205
HUMAN NECESSITIES
A61B5/08
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
Abstract
A contactless cardiopulmonary signal estimation method and apparatus are provided. A cardiopulmonary signal estimation apparatus may estimate a cardiopulmonary signal of a user from a heartbeat signal and a respiratory signal of the user in response to movement of a chest based on a cardiopulmonary exercise of the user.
Claims
1. A cardiopulmonary signal estimation method performed by a cardiopulmonary signal estimation apparatus, the cardiopulmonary signal estimation apparatus comprising one or more processors configured to execute: program code that transforms a cardiopulmonary signal of a user that includes a heartbeat signal and a respiratory signal to a discrete-time signal, the cardiopulmonary signal being received when a chest of the user moves based on a cardiopulmonary exercise of the user, wherein the cardiopulmonary signal is received from a continuous wave radar sensor measuring movement of the user's chest during cardiopulmonary exercise; program code that estimates a cardiopulmonary signal of the user in a time domain based on the discrete-time signal; program code that estimates the cardiopulmonary signal based on a look-up table generated based on a correlation between the heartbeat signal and the respiration signal of the user due to the movement of the chest, and; program code that adjusts a size of the look-up table when an element of the look-up table indicating a respiration or cardiac case that is unlikely to occur is removed; wherein the one of more processors estimate the cardiopulmonary signal of the user in the time domain by applying the discrete-time signal to a least-squares estimation scheme that uses a brute-force search scheme based on the look-up table generated based on a correlation between the heartbeat signal and the respiratory signal received by movement of the chest.
2. The cardiopulmonary signal estimation method of claim 1, wherein the look-up table is generated based on at least one of a correlation between a respiratory amplitude and a respiration rate of the respiratory signal and a heartbeat amplitude and a heart rate of the heartbeat signal, a correlation between a respiratory amplitude of the respiratory signal and a heartbeat amplitude of the heartbeat signal, and a correlation between a respiration rate of the respiratory signal and a heart rate of the heartbeat signal.
3. The cardiopulmonary signal estimation method of claim 1, wherein a number of elements of the look-up table is minimized based on the correlation between the heartbeat signal and the respiratory signal.
4. A cardiopulmonary signal estimation apparatus, comprising: one or more processors configured to execute: program code that transforms a cardiopulmonary signal of a user that includes a heartbeat signal and a respiratory signal to a discrete-time signal, the cardiopulmonary signal being received when a chest moves based on a cardiopulmonary exercise of the user wherein the cardiopulmonary signal is received from a continuous wave radar sensor measuring movement of the user's chest during cardiopulmonary exercise; program code that estimates a cardiopulmonary signal of the user in a time domain based on the discrete-time signal; program code that estimates the cardiopulmonary signal based on a look-up table generated based on the correlation between the heartbeat signal and the respiration signal of the user due to the movement of the chest; program code that adjusts a size of the look-up table when an element of the look-up table indicating a respiration or cardiac case that is unlikely to occur is removed; wherein the one or more processors estimate the cardiopulmonary signal of the user in the time domain by applying the discrete-time signal to a least-squares estimation scheme that uses a brute-force search scheme based on the look-up table generated based on a correlation between the heartbeat signal and the respiratory signal received by movement of the chest.
5. The cardiopulmonary signal estimation apparatus of claim 4, wherein the look-up table is generated based on at least one of a correlation between a respiratory amplitude and a respiration rate of the respiratory signal and a heartbeat amplitude and a heart rate of the heartbeat signal, a correlation between a respiratory amplitude of the respiratory signal and a heartbeat amplitude of the heartbeat signal, and a correlation between a respiration rate of the respiratory signal and a heart rate of the heartbeat signal.
6. The cardiopulmonary signal estimation apparatus of claim 4, wherein a number of elements of the look-up table is minimized based on the correlation between the heartbeat signal and the respiratory signal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These and/or other aspects, features, and advantages of the invention will become apparent and more readily appreciated from the following description of exemplary embodiments, taken in conjunction with the accompanying drawings of which:
(2)
(3)
(4)
(5)
(6)
(7)
DETAILED DESCRIPTION
(8) Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Exemplary embodiments are described below to explain the present invention by referring to the figures.
(9)
(10) Referring to
(11) The cardiopulmonary signal estimation apparatus 101 may output a signal used to estimate a cardiopulmonary signal in a state in which the cardiopulmonary signal estimation apparatus 101 and the user 102 are separated from each other by a predetermined distance d. The output signal may be reflected from a chest of the user 102 back to the cardiopulmonary signal estimation apparatus 101. In
(12) The cardiopulmonary signal 103 may include a cardiopulmonary signal measured immediately when the output signal arrives at the user 102, and a cardiopulmonary signal having a difference between a distance from an expanded chest of the user 102 to the cardiopulmonary signal estimation apparatus 101 and a distance from a contracted chest of the user 102 to the cardiopulmonary signal estimation apparatus 101. For example, the cardiopulmonary signal estimation apparatus 101 may receive a cardiopulmonary signal having a difference in a distance based on expansion and contraction of the chest.
(13) Additionally, the cardiopulmonary signal estimation apparatus 101 may perform sampling on the received cardiopulmonary signal at regular intervals, may normalize the cardiopulmonary signal, and may transform the normalized cardiopulmonary signal to a discrete-time cardiopulmonary signal. The cardiopulmonary signal estimation apparatus 101 may apply the discrete-time cardiopulmonary signal to a least-squares estimation scheme, and may accurately estimate a cardiopulmonary signal of the user 102 in a time domain.
(14) The cardiopulmonary signal estimation apparatus 101 may sequentially estimate a respiratory signal and a heartbeat signal included in the received cardiopulmonary signal. For example, the cardiopulmonary signal estimation apparatus 101 may set, as noise, the heartbeat signal in the received cardiopulmonary signal, and may estimate the respiratory signal in the received cardiopulmonary signal. The cardiopulmonary signal estimation apparatus 101 may reconstruct the discrete-time cardiopulmonary signal based on the estimated respiratory signal, and may remove the respiratory signal from the cardiopulmonary signal. The cardiopulmonary signal estimation apparatus 101 may estimate the heartbeat signal based on the reconstructed cardiopulmonary signal.
(15) The cardiopulmonary signal estimation apparatus 101 may transform a signal including a cardiopulmonary signal to a discrete-time signal. Additionally, the cardiopulmonary signal estimation apparatus 101 may estimate a cardiopulmonary signal from the discrete-time signal.
(16)
(17) Referring to
(18) The transformer 202 may receive a signal including a Doppler shift amount by movement of a chest based on a cardiopulmonary exercise of a user. The transformer 202 may perform sampling on the received signal at regular intervals, may normalize the signal, and may transform the normalized signal to a discrete-time signal. The estimator 203 may estimate a cardiopulmonary signal of the user from the discrete-time signal. The discrete-time signal may be represented as shown in Equation 1 below.
(19)
(20) In Equation 1, .sub.n denotes a combination of a heartbeat signal and a respiratory signal in a discrete time. denotes all residual phases accumulated in a circuit and a transmission path, and .sub.n denotes a noise component.
(21) The estimator 203 may apply a least-squares estimation scheme to the discrete-time signal. Additionally, the estimator 203 may estimate a cardiopulmonary signal of a user by applying the least-squares estimation scheme to the discrete-time signal. The least-squares estimation scheme may use a brute-force search scheme based on a look-up table generated based on a correlation between a heartbeat signal and a respiratory signal of a user by movement of a chest. The least-squares estimation scheme may be represented as shown in Equation 2 below.
(22)
(23) The least-squares estimation scheme may not require approximation, and accordingly an error occurring in estimation of a cardiopulmonary signal of a user may be minimized. Additionally, in the least-squares estimation scheme, a filter may not be used and accordingly, complexity of an operation may be prevented from being increased and an estimation error may not occur due to use of the filter. In addition, the least-squares estimation scheme may prevent a nonconvergence problem from occurring when a cardiopulmonary signal is estimated based on an algorithm. Furthermore, a solution derived through the least-squares estimation scheme may have a global optimal solution.
(24) Based on the above description, the least-squares estimation scheme may use a brute-force search scheme based on a look-up table. In other words, since the brute-force search scheme requires a large amount of an operation, an operation complexity may increase. To solve the above problem, the brute-force search scheme may be based on the look-up table. To reduce complexity, the brute-force search scheme may minimize a number of elements of the look-up table based on a correlation between estimation parameters, and a cardiopulmonary signal of a user may be searched for based on the minimized number of elements. The number of elements of the look-up table may be minimized based on a correlation between a respiratory signal and a heartbeat signal and accordingly, a size of the look-up table may be adjusted. For example, the look-up table may be written below.
(25) A respiratory signal and a heartbeat signal may be represented by a function of (m.sub.r,m.sub.h,.sub.r,.sub.h), and a number of elements in a set {(m.sub.r,m.sub.h,.sub.r,.sub.h)} may be very limited. For example, a respiration rate of a user may be within a range of 0 beats per minute (bpm) to 100 bpm. The estimator 203 may set a range of respiration rates of a user from 0 bpm to 100 bpm as a measurement range, and may set a measurement resolution to 0.5 bpm. Based on the setting, the respiration rate of the user may have a set of about 200 elements. Similarly, the estimator 203 may set a range of heart rates of a user from 0 bpm to 200 bpm as a measurement range, and may set a measurement resolution to 0.5 bpm. Based on the setting, the heart rate of the user may have a set of about 400 elements.
(26) Each of estimation parameters m.sub.r,m.sub.h,.sub.r,.sub.h used to estimate a cardiopulmonary signal of a user may have elements S.sub.m.sub.
(27) For example, when the elements S.sub.m.sub.
(28) Due to a characteristic of each of a respiratory signal and a heartbeat signal, each of the elements S.sub.m.sub.
(29) Additionally, the estimator 203 may reduce a size of the set {(m.sub.r,m.sub.h,.sub.r,.sub.h)} based on a correlation between the respiratory signal and the heartbeat signal. For example, a value of S.sub.m.sub.
(30) For example, a respiration rate may increase, as a heart rate increases. Additionally, the heart rate may increase, as the respiration rate increases. Furthermore, a user may rarely breathe when a heartbeat is stopped.
(31) Similarly, a respiratory amplitude and a respiration rate of the respiratory signal may correlate with a heart rate amplitude and a heart rate of the heartbeat signal. The estimator 203 may remove elements indicating cases that are unlikely to actually occur from the set of elements {(m.sub.r,m.sub.h,.sub.r,.sub.h)} in the look-up table, based on a correlation between a heartbeat signal and a respiratory signal that are transformed in a time domain. For example, a case of respiration during a cardiac standstill, represented by elements {(m.sub.r,0,.sub.r,0)} may be highly unlikely to occur and accordingly, the elements {(m.sub.r,0,.sub.r,0)} may be removed from the look-up table.
(32) The estimator 203 may significantly reduce complexity for estimating a cardiopulmonary signal by removing an element indicating a case that is not likely to actually occur.
(33)
(34) Referring to
(35) The receiver 302 may receive a signal that is Doppler-shifted and that includes a cardiopulmonary signal, in response to movement of a chest based on a cardiopulmonary exercise of a user. The cardiopulmonary signal may include a heartbeat signal and a respiratory signal of the user.
(36) The transformer 303 may transform the received signal to a discrete-time signal. The transformer 303 may perform sampling on the received signal at regular intervals, may normalize the signal, and may transform the normalized signal to the discrete-time signal.
(37) The first estimator 304 may set, as noise, a heartbeat signal in a cardiopulmonary signal included in the discrete-time signal, and may estimate a respiratory signal in the cardiopulmonary signal. For example, the first estimator 304 may estimate a respiratory signal from a discrete-time signal including a cardiopulmonary signal, based on Equation 3 shown below.
(38)
(39) The first estimator 304 may estimate a respiratory amplitude {circumflex over (m)}.sub.r and a respiration rate {circumflex over ()}.sub.r of a respiratory signal with a vector value. For example, the first estimator 304 may set, as noise, a heartbeat signal in a cardiopulmonary signal included in a discrete-time signal. The heartbeat signal, and the cardiopulmonary signal may be represented by x.sub.n,h(m.sub.h,.sub.h), and x.sub.n(m.sub.r,m.sub.h,.sub.r,.sub.h)=x.sub.n,r(m.sub.r,.sub.r)+x.sub.n,h(m.sub.h,.sub.h), respectively. In this example, the cardiopulmonary signal may include estimation parameters. Additionally, the first estimator 304 may estimate a respiratory signal other than the heartbeat signal set as noise. A magnitude of the heartbeat signal may typically be greater than at least 100 times that of the respiratory signal. Accordingly, the first estimator 304 may estimate a respiratory signal by setting, as noise, a heartbeat signal in a cardiopulmonary signal included in a discrete-time signal, without degradation in performance.
(40) The first estimator 304 may estimate the respiratory signal from the cardiopulmonary signal included in the discrete-time signal, using a brute-force search scheme based on a look-up table generated based on a respiratory amplitude and a respiration rate of the respiratory signal. The look-up table may include a set of elements {(m.sub.r,.sub.r)}. For example, the first estimator 304 may estimate a respiratory signal of a user based on a look-up table including only respiratory signals.
(41) The reconstructor 305 may reconstruct the cardiopulmonary signal based on the estimated respiratory signal. For example, the reconstructor 305 may reconstruct the cardiopulmonary signal based on the estimated respiratory signal, as shown in Equation 4 below, and may remove the respiratory signal from the cardiopulmonary signal.
{tilde over (x)}.sub.n=x.sub.n,h+{circumflex over (x)}.sub.n,r=m.sub.k sin(.sub.h.sub.Tn)+{circumflex over (m)}.sub.r sin({circumflex over ()}.sub.r.sub.Tn)[Equation 4]
(42) In Equation 4, .sub.t denotes a sampling interval, and {circumflex over (m)}.sub.r denotes an amplitude of the respiratory signal estimated based on Equation 3. Additionally, {circumflex over ()}.sub.r denotes a frequency component of the respiratory signal estimated based on Equation 3. The reconstructor 305 may reconstruct the cardiopulmonary signal based on the amplitude and frequency component of the estimated respiratory signal, and may remove the respiratory signal from the cardiopulmonary signal.
(43) The second estimator 306 may estimate the heartbeat signal based on the reconstructed cardiopulmonary signal. The estimated heartbeat signal may be represented as shown in Equation 5 below.
(44)
(45) The second estimator 306 may estimate a heartbeat amplitude {circumflex over (m)}.sub.h and a heart rate {circumflex over ()}.sub.h of the heartbeat signal, based on the respiratory amplitude and the respiration rate of the respiratory signal estimated by the first estimator 304.
(46) The second estimator 306 may estimate the heartbeat signal, using a brute-force search scheme based on a look-up table. A size of the look-up table may be adjusted based on a correlation between the heartbeat amplitude of the heartbeat signal and the respiratory amplitude of the respiratory signal and a correlation between the heart rate of the heartbeat signal and the respiration rate of the respiratory signal.
(47) The cardiopulmonary signal estimation apparatus 301 may sequentially estimate the respiratory signal and the heartbeat signal and accordingly, a size of the look-up table may be minimized. For example, when the respiratory signal and the heartbeat signal are sequentially estimated, the cardiopulmonary signal estimation apparatus 301 may reduce complexity for estimating the heartbeat signal, because a number of elements of the look-up table required to be compared when a brute-force search scheme is applied, is reduced to a value of (S.sub.m.sub.
(48)
(49)
(50) Referring to
(51)
(52) Referring to
(53) In operation 502, the cardiopulmonary signal estimation apparatus may estimate a cardiopulmonary signal of the user in a time domain from the discrete-time signal. To estimate a heartbeat signal and a respiratory signal, the cardiopulmonary signal estimation apparatus may apply a brute-force search scheme of a least-squares estimation scheme. The cardiopulmonary signal estimation apparatus may estimate the cardiopulmonary signal of the user by applying a heartbeat signal and a respiratory signal in the discrete-time signal to the brute-force search scheme.
(54) The cardiopulmonary signal estimation apparatus may adjust a size of a look-up table based on a correlation between the respiratory signal and the heartbeat signal. The cardiopulmonary signal estimation apparatus may change the size of the look-up table adaptively based on a situation in which a cardiopulmonary signal is required to be estimated. In an example, when an amplitude of respiration of a user is provided in advance through advance invention, the cardiopulmonary signal estimation apparatus may remove an element used to estimate a value of the amplitude from the look-up table.
(55) In another example, when monitoring of a cardiopulmonary signal is required to observe a change in a physical condition of people, the cardiopulmonary signal estimation apparatus may remove a portion of or all of elements corresponding to an emergency situation from the look-up table.
(56) Accordingly, the cardiopulmonary signal estimation apparatus may maximize a performance of an estimator required depending on circumstances by adaptively changing the size of the look-up table. For example, when quick estimation is required rather than accurate estimation, the cardiopulmonary signal estimation apparatus may minimize the size of the look-up table, and may maximize a performance of an estimator required depending on circumstances, that is, quick estimation. An element used to determine the size of the look-up table may include, for example, a resolution, an estimation mode (for daily life and/or for hospital), existence or nonexistence of advance information, and the like. The estimator may be used to estimate a cardiopulmonary signal of a user.
(57)
(58) Referring to
(59) In operation 602, the cardiopulmonary signal estimation apparatus may transform the received signal to a discrete-time signal.
(60) In operation 603, the cardiopulmonary signal estimation apparatus may set, as noise, a heartbeat signal in a cardiopulmonary signal included in the discrete-time signal, and may estimate a respiratory signal in the cardiopulmonary signal included in the discrete-time signal. For example, the cardiopulmonary signal estimation apparatus may set, as noise, a heartbeat signal having a magnitude greater than at least 100 times that of a respiratory signal. Additionally, the cardiopulmonary signal estimation apparatus may estimate a respiratory signal other than the heartbeat signal set as noise.
(61) In operation 604, the cardiopulmonary signal estimation apparatus may remove the respiratory signal from the cardiopulmonary signal in the discrete-time signal, based on the estimated respiratory signal. To remove the respiratory signal from the cardiopulmonary signal in the discrete-time signal, the cardiopulmonary signal estimation apparatus may reconstruct the cardiopulmonary signal in the discrete-time signal based on an amplitude and a frequency component of the estimated respiratory signal.
(62) In operation 605, the cardiopulmonary signal estimation apparatus may estimate the heartbeat signal based on the reconstructed cardiopulmonary signal.
(63) The cardiopulmonary signal estimation apparatus may estimate the cardiopulmonary signal of the user based on the estimated respiratory signal and the estimated heartbeat signal. The cardiopulmonary signal estimation apparatus may estimate the cardiopulmonary signal using a brute-force search scheme based on a look-up table generated based on a correlation between a respiratory amplitude and a respiration rate of the respiratory signal and a heartbeat amplitude and a heart rate of the heartbeat signal (*a correlation between a respiratory amplitude of the respiratory signal and a heartbeat amplitude of the heartbeat signal, and a correlation between a respiration rate of the respiratory signal and a heart rate of the heartbeat signal. The cardiopulmonary signal estimation apparatus may sequentially estimate the respiratory signal and the heartbeat signal and accordingly, a number of elements in the look-up table used to estimate the cardiopulmonary signal may be minimized to a value of (S.sub.m.sub.
(64) According to embodiments, a cardiopulmonary signal estimation apparatus may sequentially estimate a respiratory signal and a heartbeat signal and accordingly, it is possible to greatly reduce complexity of estimation. Additionally, the cardiopulmonary signal estimation apparatus may have an efficient estimation performance corresponding to an ideal performance of an estimator.
(65) Additionally, according to embodiments, a cardiopulmonary signal estimation apparatus may directly estimate a cardiopulmonary signal of a user in a time domain and accordingly, an approximation process may not be required, thereby reducing an error. In addition, because the cardiopulmonary signal estimation apparatus may not use a filter to estimate a cardiopulmonary signal, an estimation error may not occur and complexity may be prevented from being increased due to use of the filter. Moreover, a global optimal solution may be derived.
(66) The above-described embodiments of the present invention may be recorded in non-transitory computer-readable media including program instructions to implement various operations embodied by a computer. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts.
(67) Although a few exemplary embodiments of the present invention have been shown and described, the present invention is not limited to the described exemplary embodiments. Instead, it would be appreciated by those skilled in the art that changes may be made to these exemplary embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.