Wearable Wireless Multisensor Health Monitor with Head Photoplethysmograph
20170296070 · 2017-10-19
Assignee
Inventors
- Stephan W. Wegerich (Geneva, IL, US)
- Robert Matthew Pipke (Oak Park, IL, US)
- Thaddeus Meizelis (Plainfield, IL, US)
Cpc classification
A61B5/02416
HUMAN NECESSITIES
F16M13/04
MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
A61B5/349
HUMAN NECESSITIES
A61B5/02055
HUMAN NECESSITIES
A61B5/053
HUMAN NECESSITIES
A61B5/6803
HUMAN NECESSITIES
A61B5/0024
HUMAN NECESSITIES
A61B5/0205
HUMAN NECESSITIES
A61B5/0245
HUMAN NECESSITIES
A61B5/01
HUMAN NECESSITIES
International classification
A61B5/0205
HUMAN NECESSITIES
A61B5/00
HUMAN NECESSITIES
A61B5/1455
HUMAN NECESSITIES
Abstract
Ambulatory monitoring of human health is provided by a multi-component multi-sensor wireless wearable biosignal acquisition system comprising a torso device and a peripheral device communicating wirelessly, and a mobile phone for receiving collected data and uploading it over cellular network or WiFi to a remote computer for multivariate analysis. Biosignals include EKG and PPG, from which a determination of pulse transit time can be made.
Claims
1. A system for monitoring human health comprising: a wearable torso device comprising a first firmware-programmed microprocessor, a first internal memory, and at least one analog-to-digital converter, disposed to continuously measure at least an electrocardiographic signal from at least two electrodes; a peripheral device in wireless connectivity with said torso device, comprising a second firmware-programmed microprocessor, a second internal memory, and having at least one light source and a light sensitive element arranged with respect to said light source for quantitatively measuring light from said light source that has passed through subcutaneous tissue when said peripheral device is positioned on skin, thereby providing a photoplethysmographic signal that is communicated to the torso device wirelessly; wherein by means of automatic execution of firmware in said first and second microprocessors said peripheral device is disposed to accumulate data packets of photoplethysmographic signal in a first circular buffer in said first internal memory and periodically transmit at least one data packet to said torso device and upon acknowledgement that the transmitted packet was received by said torso device, to remove the transmitted packet from said first circular buffer; said torso device is disposed to store said data packets received from said peripheral device in a second circular buffer in said second internal memory, maintain a count of packets received, and remove packets from said second circular buffer upon processing each packet with matched electrocardiographic signal data; and when the wireless connectivity is interrupted for an extended period said peripheral device is disposed to overwrite an unsent packet with a new packet on a first-in-first-out basis when said first circular buffer is full while said torso device is disposed to generate a packet of null data for matching and processing with electrocardiographic signal data and to increment said packet counter, when said second circular buffer is empty, in order to maintain synchronization of said photoplethysmographic signal with said electrocardiographic signal.
2. The system according to claim 1, further comprising a mobile phone disposed to receive wireless transmissions of data from said torso device inclusive of data from said peripheral device.
3. The system according to claim 1 further comprising a headband disposed to hold the peripheral device against a forehead, and said peripheral device comprises an enclosure that is curved to conform to the curvature of the human forehead.
4. The system according to claim 1 wherein said peripheral device further comprises an enclosure with a concave well disposed to be attached against skin over the mastoid process of a wearer with a double-sided adhesive.
5. The system according to claim 1 wherein said peripheral device further comprises an enclosure containing said first microprocessor and said first internal memory; a sensor nodule containing said light source and said light sensitive element, connected to said enclosure by a flexible electrical cable; and an opaque adhesive patch adapted to cover said nodule and adhere to skin circumferentially around said nodule.
6. The system according to claim 5 wherein said peripheral enclosure is hook-shaped so as to be adapted to hang over the ear of a wearer.
7. The system according to claim 1 wherein: said peripheral device further comprises a first oscillator clock at a first frequency; said torso device further comprises a second oscillator clock at a second frequency selected to be intentionally and slightly different from said first frequency such that the count of samples of electrocardiographic signal collected by said torso device differs by one sample from the count of samples of photoplethysmographic signal collected by said peripheral device after a selected period of time; said second microprocessor under execution of firmware eliminates a sample from the one of the set of the electrocardiographic signal and the photoplethysmographic signal that has an additional sample, in order to deterministically correct for clock drift between said first and second clocks.
8. A system for monitoring human health comprising: a wearable torso device comprising a first firmware-programmed microprocessor, a first internal memory, a first radio and at least one analog-to-digital converter, disposed to measure at least an electrocardiographic signal from at least two electrodes; a peripheral device comprising an enclosure containing a second firmware-programmed microprocessor, a second internal memory, and a second radio; a sensor nodule connected to said enclosure by a flexible electrical cable and containing at least one light source and a light sensitive element arranged with respect to said light source for quantitatively measuring light from said light source that has passed through subcutaneous tissue when said sensor nodule is positioned on skin, to measure a photoplethysmographic signal; and an opaque adhesive patch adapted to cover said nodule and adhere to skin circumferentially around said nodule; and a mobile phone disposed to receive via wireless transmission said electrocardiographic signal and said photoplethysmographic signal.
9. The system according to claim 8, wherein said peripheral device is configured to wirelessly transmit said photoplethysmographic signal to said torso device, and said torso device is configured to transmit the combination of said photoplethysmographic signal and said electrocardiographic signal to said mobile phone.
10. The system according to claim 9, wherein: said peripheral device further comprises a first oscillator clock at a first frequency; said torso device further comprises a second oscillator clock at a second frequency selected to be intentionally and slightly slower than said first frequency such that the count of samples of electrocardiographic signal collected by said torso device is less by one sample from the count of samples of photoplethysmographic signal collected by said peripheral device after a selected period of time; said second microprocessor under execution of firmware eliminates a sample from the photoplethysmographic signal, in order to deterministically correct for clock drift between said first and second clocks.
11. A method for monitoring a physiological status of a human: acquiring a photoplethysmographic signal from the mastoid process of the human using a wearable PPG sensor; acquiring an electrocardiographic signal from the torso of the human using a wearable ECG sensor; wirelessly receiving said photoplethysmographic signal and said electrocardiographic signal in a mobile phone; uploading said signals from said mobile phone to a remote analysis server; determining in said remote analysis server time differences between a first repeating landmark in said electrocardiographic signal and a subsequent second repeating landmark in said photoplethysmographic signal to provide a time series of time differences; and assessing in said remote analysis server a physiological status of the human based on a multivariate residual-based model that uses said time differences as a variable.
12. The method according to claim 11 wherein said first landmark is a QRS complex of said electrocardiographic signal and said second landmark is an inflexion point of said photoplethysmographic signal indicative of blood pulse arrival, to yield time differences indicative of a pulse transit time.
13. The method according to claim 11 wherein said first landmark is a QRS complex of said electrocardiographic signal and said second landmark is an inflexion point of said photoplethysmographic signal from decreasing light transmission to increasing light transmission, yielding time differences indicative of a diastolic relaxation rate.
14. The method according to claim 11, wherein said wearable PPG sensor has a microprocessor clock speed that is slightly different from the a microprocessor clock speed of said wearable ECG sensor, such that the count of samples of electrocardiographic signal collected by said wearable ECG sensor differs by one sample from the count of samples of photoplethysmographic signal collected by said wearable PPG sensor after a selected period of time, and further comprising the step of eliminating a sample from the one of the set of the electrocardiographic signal and the photoplethysmographic signal that has an additional sample, in order to deterministically correct for clock drift between said ECG sensor and said PPG sensor.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as the preferred mode of use, further objectives and advantages thereof, is best understood by reference to the following detailed description of the embodiments in conjunction with the accompanying drawings, wherein:
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0027] The remote health monitoring system of the present invention is effective for remote patient health monitoring in the at-home, ambulatory environment. It is intended to be worn comfortably and innocuously by a patient under clothing and in the course of normal, daily living without significant hindrance to mobility or activity. It is designed to be worn by the patient for many hours each day, every day. It is designed with sufficiently lightweight batteries such that it should be recharged on a daily basis. It continuously monitors multiple biosignals noninvasively, and wirelessly transmits data to a remote server, to enable monitoring, analysis and proactive alerting of incipient health issues for the patient. It may advantageously be used in monitoring chronically ill patients, such as heart failure patients, who can experience unexpected exacerbations of their condition leading to the need for emergency acute medical treatment.
[0028] The monitoring apparatus comprises at least three components. A first component is a device mounted on the torso (“torso device”), under clothing, and connected to at least four electrodes in contact with the skin of the torso. A second component is a device worn at the periphery of the body (“peripheral device”), especially on the head, which primarily serves to acquire photoplethysmogram (PPG) signals. A third component is a mobile phone that receives data from the devices and uploads data to remote computers for multivariate analysis. Additional peripheral devices can be employed, for example at the wrist, hand or ankle. In a preferred embodiment, the peripheral device is mounted on the forehead or over the mastoid process behind the ear.
[0029] These components form a wireless multivariable sensor ensemble for continuous or semi-continuous biosignal collection for a determination of human health status. Biosignals that are collected include electrocardiogram (ECG or EKG) from two or more electrodes on the torso; trans-thoracic bioimpedance (BIOZ) voltage collected from two electrodes on the torso; 3-axis accelerometer signals (ACT) from a 3-axis accelerometer semiconductor device mounted in relation to the torso device as well as from a second such accelerometer mounted in relation to the peripheral device; a photoplethysmogram signal (PPG) for at least one light wavelength, and preferably at least two different wavelengths, obtained from the tissue at the location of the peripheral device; skin temperature obtained from one or both of the skin under the torso device or peripheral device; and air temperature preferably obtained from an outward-facing sensor on the peripheral device. Preferably, biosignals are collected at sampling rates of at least approximately 250 Hz to sufficiently characterize important aspects and landmarks of the biosignal waveforms having physiological significance, while balancing with power requirements of higher sampling rates. However, accelerometer signals can be acquired at about 100 Hz.
[0030] In an embodiment of the invention, the biosignals can be acquired as described below: [0031] Electrocardiograph. Two leads are connected to the torso, one at approximately the position of conventional EKG lead V5 and the other in a mirror position on the opposite side of the rib cage. EKG is captured at a sampling rate of 250 Hz, using an ADS1294R chip from Texas Instruments. [0032] Photoplethysmograph. PPG is captured using conventional two-color (red and infra-red) reflectance pulse oximetry. Each color is switched on/off at 250 Hz and shone into the skin of the patient at either the forehead or at the mastoid process behind the ear. An adjacent photodetector picks up reflected light having passed through the capillary bed. [0033] Bioimpedance. The principle of bioimpedance is to measure the opposition to current flow in tissue when a high-frequency current is injected. Fluid filled compartments of the body conduct the current better, while air space, lipids and most carbon-chain-based tissue structures have low or no conductivity. A high frequency (64 kHz) micro-current (˜29 μA) is injected between two electrodes placed at the left and right lower rib cage, lateral to each of the EKG electrodes and spaced between ¼ and ½ inch from them. The bioimpedance electrodes are located further toward the side of the body than the EKG electrodes. The EKG electrodes detect the resultant voltage, which is high-pass filtered and compared with the injected excitation current to yield the impedance across the torso from side to side. This signal fluctuates both with arterial blood flow and with respiratory activity. Body movement also results in redistribution of conductive pathways (primarily fluid) amongst tissues and creates substantial motion artifact. [0034] Acceleration. A three-axis accelerometer is mounted on the printed circuit board of the torso module. It is sampled at about 100 Hz to provide voltage signals characterizing both motion acceleration and orientation in the earth's gravitational field for the X-, Y- and Z-axes of the module. Hence it is important that the torso module be attached or positioned tightly on the body so that its orientation mirrors the orientation of the patient. Three signals are obtained. These signals can be combined to generate a single scalar gross activity, and the 3-dimensional orientation. [0035] Temperature. A 10 Kohm 2-wire passive device (thermistor) coupled to thermally conductive pads against the skin or open to ambient air is sampled at 1 Hz.
[0036] Both the torso device and the peripheral device comprise a microprocessor, firmware memory for storing program code, internal memory for storing and buffering data, analog-to-digital converters for each channel of sensor data collected, a radio for paired bi-directional wireless transmission and reception of data and commands, and a power source. In a preferred embodiment, data collected by the peripheral device is wirelessly transmitted to the torso device, where it is combined by the microprocessor of the torso device with data collected from the torso device sensor channels. The radios used between the peripheral device and the torso device can be selected from a variety of bi-directional point-to-point pairing radios employing frequencies in the industrial, scientific and medical (ISM) radio bands, preferably around 915 MHz, and capable of emulating a serial port protocol. The torso device has a second radio, by way of example a Bluetooth standard radio, for communicating data and commands with a mobile phone. Preferably, the radio link between the torso device and the mobile phone employs the serial port profile (SPP) of the Bluetooth communication protocol standard. In this configuration, data is generally transmitted by the peripheral device to the torso device, where biosignals are synchronized in time, and then the torso device communicates the unified data to the mobile phone over a separate radio interface.
[0037] In another embodiment, the two devices and the mobile phone can form a multi-nodal network, for example using the Personal Area Network (PAN) profile of the Bluetooth communication protocol standard. In this event, the data collected by the peripheral device is transmitted directly to the mobile phone, where it is synchronized with the data transmitted from the torso device. An advantage of this configuration is that data can still be collected from the peripheral device even when the torso device fails. However, this configuration is not as energy efficient and may require larger batteries because of the use of the relatively energy-expensive Bluetooth radio standard at both body worn devices.
[0038] Extraction of vital sign features from biosignal data can be performed in the central processing unit (CPU) of the mobile phone, whereupon the mobile phone stores and forwards vital sign feature data to a remote computer for analysis when the mobile phone has data connectivity, preferably over the internet, via digital cellular transmission or via internet-connected WiFi access point. Alternatively, the mobile phone can upload the raw biosignal data to the remote computer, where vital sign feature extraction can be performed prior to multivariate analysis. The advantage of uploading raw biosignals is that they can be stored and reprocessed at a subsequent time with additional algorithms as they arise, whereas if features are calculated locally on the mobile phone and only the features are uploaded, there is no opportunity for reprocessing the biosignals. However, the advantage of uploading only features is that typically features require much less bandwidth than uploading raw biosignals, as can be understood from the discussion of feature extraction below. In a preferred embodiment, the mobile phone software is configurable to upload biosignal data, calculate and upload feature data, or to do both, depending on mobile phone processor capacity, local memory and cellular bandwidth.
[0039] Features extracted from the biosignals are generally at a much lower data rate, e.g., 2 Hz or less. Features can also be statistically summarized at regular intervals, such as once per minute or one per quarter minute. Features preferably extracted according to the invention are described as follows: Instant heart rate can be obtained by identifying the QRS complex of each heartbeat and using the time difference of successive QRS complexes. Instant heart rate can be time-stamped with the time of the QRS peak of one of the two beats involved in the time difference; can be sampled at 1 Hz by assigning the instant heart rate for the nearest QRS peak to the 1 Hz trigger; or can be averaged over a moving window to provide a different periodic rates. Heart rate variability can be computed from the variability exhibited in a time window of instant heart rates. Respiration rate can be obtained by inflexion point identification on trans-thoracic bioimpedance, which oscillates with thoracic expansion and contraction associated with breathing, and time-differencing the matching inflexion points of the signal.
[0040] Alternatively, a spectral analysis can be performed over a time window (typically 15 seconds or more) of a low-bandpass filtered bioimpedance to identify power peaks within a physiologically plausible range of breathing frequencies, typically 8-40 breathes per minute, to identify the time window averaged respiratory rate. In yet another alternative, the oscillating envelop of ECG signal magnitude can be spectrally analyzed to identify respiratory rate. A measure of respiratory effort that can be associated with classic gas exchange parameters like Tidal Volume can be obtained from the magnitude of the dominant power peak in the spectral analysis of bioimpedance described above at the frequency determined for respiratory rate. General bodily activity can be calculated from the RMS amplitude of the three axes of accelerometer, preferably on the torso device. Differential temperature can be determined from the difference of skin temperature from either the torso device or the peripheral device with the ambient temperature from the peripheral device. Blood oxygenation, and particularly saturation of peripheral oxygen (SpO2), can be determined from the differential absorption of two wavelengths of light as determined from the amplitudes of the oscillatory components of transmitted PPG signals from red and infrared light emitting diode sources in the peripheral device. Pulse transit time can be determined as a function of the time difference between the QRS complex of the ECG signal from the torso device and the next inflexion point of the PPG signal from the peripheral device indicative of blood pulse arrival. A measure of diastolic relaxation rate can be determined from the inflexion point of the PPG signal associated with the a reversal from decreasing light transmission to increasing light transmission, as blood inflow to the capillary bed under surveillance begins to fall behind blood ebb, and the time interval between that inflexion point and the inflexion point associated with blood pulse arrival time, or the QRS complex of the ECG signal. A measure of pulse pressure index can be obtained by differencing that measure of diastolic relaxation with the pulse transit time. Posture can be obtained from the 3-axis accelerometer as a function of the three individual voltages representing the three axes as a map to known orientations in the gravitational field.
[0041] Turning to
[0042] Turning to
[0043]
[0044] A more detailed view of an ear-worn version of the peripheral device 105 depicted in
[0045]
[0046] Turning to
[0047]
[0048] Turning to
[0049] The chest belt harness 115 can be seen in detail in
[0050] The adhesive harness 210 can be seen in detail in
[0051] An important aspect of the present invention is the capability to independently measure with distinct wireless devices biosignals that must be accurately combined to produce new vital sign features. In particular, the determination of pulse transit time, diastolic relaxation time and pulse pressure index depend on accurate time differentials between landmarks on the ECG signal obtained from the torso device and landmarks on the PPG signal from the peripheral device. Synchronizing biosignals across devices that do not share a common electrical connection can be challenging: Even the most accurate of onboard oscillator crystals used for time counters or onboard clocks can drift, especially with differences in temperature; lost radio packets need to be accounted for to avoid the signals getting out of step; devices must be resynchronized with each power cycle or battery discharge. At the same time, the need to minimize battery size in order to keep device size small imposes a constraint on unfettered use of device radios for hyper-frequent synchronization of onboard timers. Radio drop-outs also poses the risk of lost data, which can negatively impact signal processing to find landmarks in the biosignal wave form.
[0052] In order to meet these challenges, in a preferred embodiment the peripheral device maintains a circular buffer of data packets, each packet comprising a predetermined number of samples of biosignal data. The torso device also maintains a “receive” buffer of packets it receives from the peripheral device, from which it works to combine data with biosignals it has collected from its sensors. Samples are grouped into packets in order to cut down on the time that the radio must be turned on to transmit, since the radio can efficiently transmit large packets of many samples much faster than the actual sampling rate of the biosignal. Thus, the radio can send a large packet of data and then be placed into an energy conserving mode until the next packet needs to be sent.
[0053] Upon peripheral device power-up, the circular buffer is first filled with a predetermined number of packets, and only after this packet count is attained is the radio first turned on to send all these packets to the torso device at once. The receipt of each packet sent must generally be acknowledged by the torso device, and only then will be removed from the circular buffer of the peripheral device. This initial burst of packets serves to fill the “receive” buffer of the torso device. This provides a backlog of packets which the torso device can consume in the event that further transmissions of packets from the peripheral device to the torso device temporarily fail and must be retried, due to ambient interference and noise. After sending a burst of the predetermined number of packets to fill the “receive” buffer of the torso device, the peripheral device thereafter sends packets as they become available, and its circular buffer of packets generally remains near-empty in the absence of radio transmission failures.
[0054] As mentioned, each packet sent from the peripheral device to the torso device must be acknowledged as received by the torso device to the peripheral device, typically by means of a brief acknowledgement reply which can preferably also include a packet identifier. If the acknowledgement is not received within a specified time window, the peripheral device assumes the transmission failed, and it resends the packet. Given the slower sampling rate of the biosignal data as compared to the rapid speed of data transmission, this resend can occur a number of times before acquisition of enough samples to form the next new packet, providing some latency for catching up with transmission without true data loss. Moreover, the peripheral device circular buffer provides a FIFO temporary store for acquired biosignal data in the event that radio communications to the torso device fail for longer due to transient noise and ambient interference; data can be inventoried without loss, up to the maximum size of the circular buffer. If radio transmissions continue to fail as the circular buffer is refilled to capacity, additional packets are eliminated on a first-in, first-out (FIFO) basis, and only then is biosignal data truly lost. When radio communication is next reestablished with the torso device, the backlog of packets inventoried in the circular buffer is transmitted in a burst to refill the “receive” buffer of the torso device, much like at power-up.
[0055] The sampling rates of the biosignals acquired by the peripheral device stand in some known ratio to the sampling rates of biosignals acquired by the torso device; in the preferred embodiment at least one biosignal from the peripheral device is sampled at the same rate as a biosignal from the torso device, so that sample counts can be directly compared as a means of synchronizing those signals and all other signals in relation to their respective sampling rates. By way of example, the PPG signals can be acquired at 250 Hz by the peripheral device, and the BIOZ or ECG biosignal can be acquired at 250 Hz by the torso device, so that sample tallies of each provide a baseline time synchronization of the biosignals for calculation of time differential features and other timestamps of the data. Generally, if the sampling rates are different, the ratio of rates can be used to determine how many samples of one biosignal correspond to samples of another biosignal to preserve synchronization information.
[0056] However, loss of data in radio transmission can cause a failure of this count-based synchronization. Therefore, a packet count of received packets is maintained on the torso device. It is known what the predetermined number of packets is that triggers the initial filling of the “receive” buffer, and accounting of packets is made from this baseline. Biosignal data acquired by the torso device is also tallied in parallel in “packets” of the same number of samples (or a known ratio of samples if the sampling rates are set to different frequencies); if the “receive” buffer of the torso device is depleted, and the number of samples obtained from a reference biosignal acquired by the torso device reaches a quantity equating to a “packet” of data from the peripheral device, it is assumed the peripheral device packet is permanently lost, and the data time series corresponding to peripheral device-acquired biosignals that the torso device is combining with its own biosignals for transmission to the mobile phone is filled with a “packet” of null, zero or other value designated as an indicator of lost data. In this way, the synchronization of the biosignals is preserved in relation to their respective sampling rates (typically the same sampling rate), since there is no timestamp associated with the data packets sent by the peripheral device. Filling in with replacement samples maintains the sequential alignment.
[0057] Generally, therefore, the circular buffer of the peripheral device is kept near zero packets, after the initial burst of packets on power-up fills the torso device “receive” buffer. As each batch of samples comprising a packet is formed on the peripheral device, several attempts are made to transmit this packet to the torso device. In the event that sustained radio interference prevents successful sending of the packet before a second packet of samples accumulates on the peripheral device, the circular buffer will begin to backlog the packets, and the torso device “receive” buffer will similarly begin to consume its backlog of packets filled with the initial burst. At any time prior to the filling to capacity of the circular buffer on the peripheral device, if radio transmissions are successfully reestablished, all pending packets are sent to the torso device, effectively refilling the “receive” buffer and emptying the circular buffer. Only when radio transmissions fail for an extended period, and the circular buffer reaches capacity at the same time as the torso device depletes all packets in its “receive” buffer, are packets of data lost. This will occur on the peripheral device by simple elimination of the packets on a FIFO basis. A commensurate data gap will be filled in the data stream being assembled by the torso device for transmission to the mobile phone by insertion of a full packet of nulls or zeros. The sample counts at both sides of the wireless communication are thus kept in synch.
[0058] Another problem with synchronizing sample counts however arises as mentioned above due to subtle differences in crystal frequency in each device. Though nominally set to the same frequency to drive biosignal sampling, differences in clock speeds due to manufacturing tolerances as well as differences that arise randomly in oscillator performance due to temperature differentials, can give rise to effectively different samples counts in the same true window of time. In one approach to this issue, a count of samples is maintained by the torso device of both the biosignals received from the peripheral device and from biosignals acquired by the torso device, and at specified intervals, if there is a discrepancy in the count in relation to expected sample numbers based on sampling rates, then excess samples are eliminated from one or the other sample stream. However, a much simpler better and more tractable approach is to actually set the clock speed of one of the devices to be slightly higher than the other. In this way, the device with the lower clock speed provides the “true” clock tick and the higher clock speed device data samples are forced to fall on the “true” ticks by intermittently removing the most recent sample when the total number of samples acquired is at least one sample greater than the lower clock speed device's total number of acquired samples. Doing this keeps the sampling consistent with a single clock and sample adjustments only need to be made on the samples from the higher clock speed device.
[0059] The mobile phone of the present invention preferably has a high resolution display and sufficient onboard processing power to render real-time biosignal data for review by the patient or a clinician on-screen. Mobile phones based on the Android operating system, Windows Phone operating system and Apple iOS operating system are quite adequate to be used in the present invention.
[0060] Turning now to the process for multivariate analysis of data collected by the inventive device, a number of different kernel-based multivariate estimator methods may be used for analysis on the remote computer platform of the uploaded data. According to this approach, a set of vital sign features are observed at a given moment in time to form a multidimensional “observation” (vector). Successive observations of the vital sign features form a multivariate time series of these vectors. An empirical model is generated as described below from exemplary observations of vital sign features collected in baseline or normal health (and indeed can be learned from the instant patient to form a personalized model). The model, once trained, can be used to generate multivariate estimates of the expected values of the vital sign features, when presented with an input of a new observation of the features. Differences between the estimates and the monitored observations form the basis for a determination of health status. Advantageously, the collective use of multiple vital signs together effectively informs the model's estimate of each feature—in essence, the model learns the way that the vital signs interrelate.
[0061] What is generally intended by the term “kernel-based” is a multivariate estimator that operates with a library of exemplary observations (the learned data) on an input observation using a kernel function for comparisons. A kernel function suitable for this multivariate analysis according to the invention generally yields a scalar value (a “similarity”) on a comparison of the input observation to an exemplary observation from the library. The scalar similarity can then be used in generating an estimate as a weighted sum of at least some of the exemplars. For example, using Nadaraya-Watson kernel regression, the kernel function is used to generate estimates according to:
Inferential form:
Autoassociative form:
where X.sub.new is the input multivariate observation of physiological features, X.sub.i are the exemplary multivariate observations of physiological features, X.sub.est are the estimated multivariate observations, and K is the kernel function. In the inferential case, exemplars comprise a portion X.sub.i comprising some of the physiological features, and a portion Y.sub.i comprising the remaining features, X.sub.new has just the features in X.sub.i, and Y.sub.est is the inferential estimate of those Y.sub.i features. In the autoassociative case, all features are included in X.sub.new, X.sub.i and in the X.sub.est together—all estimates are also in the input.
[0062] The kernel function, by one approach, provides a similarity scalar result for the comparison of two identically-dimensioned observations, which:
1. Lies in a scalar range, the range being bounded at each end;
2. Has a value of one of the bounded ends, if the two vectors are identical;
3. Changes monotonically over the scalar range; and
4. Has an absolute value that increases as the two vectors approach being identical.
[0063] In one example, kernel functions may be selected from the following forms:
where X.sub.a and X.sub.b are input observations (vectors). The vector difference, or “norm”, of the two vectors is used; generally this is the 2-norm, but could also be the 1-norm or p-norm. The parameter h is generally a constant that is often called the “bandwidth” of the kernel, and affects the size of the “field” over which each exemplar returns a significant result. The power λ may also be used, but can be set equal to one. It is possible to employ a different h and λ for each exemplar X.sub.i. Preferably, when using kernels employing the vector difference or norm, the measured data should first be normalized to a range of 0 to 1 (or other selected range), e.g., by adding to or subtracting from all sensor values the value of the minimum reading of that sensor data set, and then dividing all results by the range for that sensor; or normalized by converting the data to zero-centered mean data with a standard deviation set to one (or some other constant). Furthermore, a kernel function according to the invention can also be defined in terms of the elements of the observations, that is, a similarity is determined in each dimension of the vectors, and those individual elemental similarities are combined in some fashion to provide an overall vector similarity. Typically, this may be as simple as averaging the elemental similarities for the kernel comparison of any two vectors x and y:
[0064] Then, elemental kernel functions that may be used according to the invention include, without limitation:
[0065] The bandwidth h may be selected in the case of elemental kernels such as those shown above, to be some kind of measure of the expected range of the m.sup.th parameter of the observation vectors. This could be determined, for example, by finding the difference between the maximum value and minimum value of a parameter across all exemplars. Alternatively, it can be set using domain knowledge irrespective of the data present in the exemplars or reference vectors, e.g., by setting the expected range of a heart rate parameter to be 40 to 180 beats per second on the basis of reasonable physiological expectation, and thus h equals “140” for the m.sup.th parameter in the model which is the heart rate.
[0066] Similarity-Based Modeling may be used as the kernel-based multivariate estimator. Three types of SBM models can be used for human data analysis tasks: 1) a fixed SBM model, 2) a localized SBM model that localizes using a bounding constraint, and 3) a localized SBM model that localizes using a nearest neighbor approach. The fixed SBM modeling approach generates estimates using the equation below.
[0067] Here, D is a static m-by-n matrix of data consisting of n training data vectors with in physiological features, pre-selected from normal data during a training phase. The kernel function K is present as a kernel operator {circle around (x)} whereby each column vector from the first operand (which can be a matrix, such as D is) is compared using one of the kernel functions described above, to each row vector of the second operand (which can also be a matrix). The monitored input observation is here shown as x.sub.in (t), and the autoassociative estimate is shown as {circumflex over (x)}.sub.in (t). In contrast, localized SBM (LSBM) is given by the following equation:
[0068] Although similar in form to the fixed SBM model, here the D matrix is redefined at each step in time using a localizing function F(•) based on the current input vector x.sub.in (t) and a normal data reference matrix H. Accordingly, matrix H contains a large set of exemplars of normal data observations, and function F selects a smaller set D using each input observation. By way of example, F can utilize a “nearest neighbor” approach to identify a set of exemplars to constitute D for the current observation as those exemplars that fall within a neighborhood of the input observation in m-dimensional space, where m is the number of features. As another example, function F can compare the input observation to the exemplars for similarity using a kernel-based comparison, and select a preselected fraction of the most similar exemplars to constitute D. Other methods of localization are contemplated by the invention, including selection on the basis of fewer than all of the physiological features, and also selection on the basis of a distinct parameter not among the features, but associated with each exemplar, such as an ambient condition measure.
[0069] One method of residual testing that may be employed in the analytical aspect of the monitoring platform disclosed herein is a multivariate density estimation approach can be applied to the residual data. This has the effect of fusing the residuals from multiple vital sign features for which estimates are made with the model, into a single actionable index of physiological change that can be used to evaluate overall priority for medical care. The approximated densities in the normal behavior of the data are used to determine the likelihood (in the form of a multivariate health index (MHI)) that a new data point is part of the normal behavior distribution. The density estimates are calculated using a non-parametric kernel estimator with a Gaussian kernel. The estimator is shown in the equation below. The resulting density function is essentially a mixture of N individual multivariate Gaussian functions each centered at x.sub.i:
where N is the number of training vectors, h is a bandwidth parameter, d is the dimensionality of the vectors, and {circumflex over (f)}(x) is a scalar likelihood. Importantly, the X and X.sub.i here are not multivariate observations of physiological features, but are instead multivariate residual observations derived from the original observations by differencing with the estimates. Importantly also, the density “estimation” here is not the same as the estimation process described above for estimating physiological feature values based on measured values; the “estimate” here is empirically mapping out a probability distribution for residuals using the normal multivariate residual exemplars, as a Gaussian mixture model. This estimated distribution is then used to compute a likelihood that a new multivariate residual from an input observation of physiological features is a member of that distribution or not. The exemplars X.sub.i can be selected from regions of normal data residuals generated by SBM using test data that is deemed “normal” or representative of desired or stable physiological behavior. Before the density estimates are made, all residuals are scaled to have unit variance and zero mean, or at least are scaled to have unit variance. The means and standard deviations used for the scaling procedure are calculated from known normal data residuals.
[0070] Analytical results are presented to a medical clinician preferably by means of a secure web page in which time series of MHI can be evaluated to ascertain stability of health in an at-home patient. By means of the invention described hereinabove, high fidelity continuous multivariate physiological data is automatically collected, uploaded, analyzed and processed to inform medical practitioners of subtle early warning signs of incipient health degradation, so that early, easy, low-cost steps can be taken to mitigate the patient's health issue and keep the patient from being eventually hospitalized.