ADVANCED MECHANO-ACOUSTIC SENSING AND APPLICATIONS OF SAME
20240000322 ยท 2024-01-04
Inventors
- Shuai Xu (Bala Cynwyd, PA, US)
- Hyoyoung Jeong (Evanston, IL, US)
- Jong Yoon Lee (Evanston, IL, US)
- Kun Hyuck LEE (Evanston, IL, US)
- John A. Rogers (Wilmette, IL)
Cpc classification
A61B5/02055
HUMAN NECESSITIES
A61B5/7214
HUMAN NECESSITIES
A61B5/4803
HUMAN NECESSITIES
International classification
A61B5/0205
HUMAN NECESSITIES
Abstract
This invention discloses an electronic device for measuring physiological parameters of a living subject including at least a first inertial measurement unit (IMU) and a second IMU, the first IMU and the second IMU are time-synchronized to and spatially and mechanically separated from each other; and a microcontroller unit (MCU) electronically coupled to the first IMU and the second IMU for processing of data streams from the first IMU and the second IMU.
Claims
1. An electronic device for measuring physiological parameters of a living subject, comprising: at least a first inertial measurement unit (IMU) and a second IMU, the first IMU and the second IMU are time-synchronized to and spatially and mechanically separated from each other; and a microcontroller unit (MCU) electronically coupled to the first IMU and the second IMU for processing of data streams from the first IMU and the second IMU.
2. The electronic device of claim 1, wherein the first IMU is configured to measure data including a first signal related to a physiological signal of the living subject and a second signal, and the second IMU is configured to measure data including at least the second signal, wherein the first signal measured by the first IMU has a signal strength greater than that the second signal measured by the first IMU.
3. The electronic device of claim 2, wherein the data measured by the first IMU and the second IMU are processed such that subtraction of the second signal measured by the second sensor from the second signal measured by the first sensor results in a stronger first signal that is a signal of interest.
4. The electronic device of claim 2, wherein the second signal is related to at least one of ambient, motion and vibration.
5. The electronic device of claim 2, wherein the data measured by the second IMU includes the first signal and the second signal.
6. The electronic device of claim 2, wherein a signal-to-noise ratio (SNR) of a signal measured by the first IMU and the second IMU together is lower than a first SNR of a signal measured by the first IMU individually, or a second SNR of a signal measured by the second IMU individually.
7. The electronic device of claim 2, wherein both of the first IMU and the second IMU are operably in mechanical communication with the skin of the living subject.
8. The electronic device of claim 7, wherein one of the first IMU and the second IMU is operably in directly mechanical communication with the skin of the living subject, while the other of the first IMU and the second IMU is operably in indirectly mechanical communication with the skin of the living subject.
9. The electronic device of claim 8, wherein the first IMU and the second IMU are operably in directly mechanical communication with the skin of the living subject.
10. The electronic device of claim 2, wherein one of the first IMU and the second IMU is separated from the rest of rigid components of the electronic device.
11. The electronic device of claim 1, further comprising at least a first thermal sensing unit and a second thermal sensing unit, wherein one of the first and second thermal sensing units is thermally isolated from an ambient environment and configured to measure a body temperature of the living subject, and the other of the first and second thermal sensing units is configured to measure the ambient temperature.
12. The electronic device of claim 11, wherein each of the first and second thermal sensing units is embedded in a respective one of the first and second IMUs.
13. The electronic device of claim 1, being configured to measure a range of physiological information from activity of a cardiopulmonary system and movements of a core body to a diverse collection of processes across thoracic cavity, esophagus, pharynx, and oral cavity related to respiration, speech, swallowing, wheezing, coughing, and sneezing.
14. The electronic device of claim 13, being configured to separate signals associated with the cardiopulmonary system and related processes from those due to body movements.
15. The electronic device of claim 13, being configured to spatiotemporally map movements of the skin at this region of the anatomy onto which the electronic device is attached during cardiac and respiratory activities.
16. The electronic device of claim 13, being configured to continuously measure temperature, heart rate (HR), respiratory rate (RR), activity level, and body orientation, across a range of vigorous activities and conditions.
17. The electronic device of claim 13, being configured to monitor key symptoms of a patient with COVID-19 infection to track progress of recovery and response to therapies in hospital and/or home.
18. The electronic device of claim 13, being configured to measure any of respiratory or motion related digital biomarkers associated with coughing, swallowing, and/or specific motion related activities.
19. The electronic device of claim 18, being configured to assess coughing when the living subject is moving or immobile, and/or to measure muscle motion, when the living subject is moving.
20. The electronic device of claim 1, further comprising a bidirectional wireless communication system electronically coupled to the electronic device and configured to send an output signal from the electronic device to an external device.
21. The electronic device of claim 20, wherein the bidirectional wireless communication system is further configured to deliver commands from the external device to the electronic device.
22. The electronic device of claim 20, wherein the bidirectional wireless communication system comprises a controller that utilizes at least one of near field communication (NFC), Wi-Fi/Internet, Bluetooth, Bluetooth low energy (BLE), and cellular communication protocols for wireless communication.
23. The electronic device of claim 20, further comprising a customized app with a user interface deployed in the external device to allow a user to configure and operate the electronic device for data collection, data transfer, data storage and analysis, wireless charging, and monitoring of user's conditions.
24. The electronic device of claim 23, wherein the customized app is configured to allow time-synchronized operation of a plurality of the electronic devices simultaneously.
25. The electronic device of claim 20, wherein the external device is a mobile device, a computer, or a cloud service.
26. The electronic device of claim 1, further comprising a power module coupled to the first IMU, the second IMU and the MCU for providing power thereto.
27. The electronic device of claim 26, wherein the power module further comprises a failure prevention element including a short-circuit protection component or a circuit to avoid battery malfunction.
28. The electronic device of claim 26, wherein the power module comprises at least one battery for providing the power.
29. The electronic device of claim 28, wherein the battery is a rechargeable battery.
30. The electronic device of claim 29, wherein the power module further comprises a wireless charging module for wirelessly charging the rechargeable battery.
31. The electronic device of claim 28, wherein the second IMU is placed in a manner that it bends and folds over the battery.
32. The electronic device of claim 26, further comprising a flexible printed circuit board (fPCB) having flexible and stretchable interconnects electrically connecting to electronic components including the first IMU, the second IMU and the MCU and the power module.
33. The electronic device of claim 32, further comprising an elastomeric encapsulation layer at least partially surrounding the electronic components and the flexible and stretchable interconnects to form a tissue-facing surface operably attached to the living subject and an environment-facing surface, wherein the tissue-facing surface is configured to conform to a skin surface of the living subject.
34. The electronic device of claim 33, wherein the encapsulation layer is formed of a flame retardant material.
35. The electronic device of claim 34, wherein the elastomeric encapsulation layer is a waterproof and biocompatible silicone enclosure.
36. The electronic device of claim 1, further comprising a biocompatible hydrogel adhesive for attaching the electronic device on the respective region of the living subject, wherein the biocompatible hydrogel adhesive is adapted such that signals from the living subject are operably conductible to the first IMU and the second IMU.
37. The electronic device of claim 1, being flexible and conformable to the skin with a specific geometrical polarity for mounting in an anatomical location of interest of the living subject.
38. The electronic device of claim 1, being a wearable, twistable stretchable, and/or bendable.
39. An electronic device for measuring physiological parameters of a living subject, comprising: a sensor network comprising a plurality of sensor units operably deployed on a skin of the living subject, the plurality of sensor units being time-synchronized to and spatially and mechanically separated from each other; and a microcontroller unit (MCU) electronically coupled to the plurality of sensor units for processing of data streams from the plurality of sensor units.
40. The electronic device of claim 39, wherein the plurality of sensor units are configured to measure a same physiological parameter, or different physiological parameters.
41. The electronic device of claim 39, wherein each of the plurality of sensor units comprises at least a first sensor and a second sensor time-synchronized to and spatially and mechanically separated from each other.
42. The electronic device of claim 41, wherein for each sensor unit, the first sensor is configured to measure data including a first signal related to a physiological signal of the living subject and a second signal, and the second sensor is configured to measure data including at least the second signal, wherein the first signal measured by the first sensor has a signal strength greater than that the second signal measured by the first sensor.
43. The electronic device of claim 42, wherein the data measured by the first sensor and the second sensor of said sensor unit are processed such that subtraction of the second signal measured by the second sensor from the second signal measured by the first sensor results in a stronger first signal that is a signal of interest.
44. The electronic device of claim 42, wherein the second signal is related to at least one of ambient, motion and vibration.
45. The electronic device of claim 41, wherein each of the first sensor and the second sensor comprises an inertial measurement unit (IMU), a thermal sensor, a pressure sensor, and/or optical sensor.
46. The electronic device of claim 45, wherein each of the first sensor and the second sensor comprises the IMU.
47. The electronic device of claim 46, wherein further comprising a plurality of thermal sensing units.
48. The electronic device of claim 47, wherein each thermal sensing units is embedded in a respective IMU.
49. The electronic device of claim 47, wherein the MCU operably receives synchronized outputs of the plurality of thermal sensor units with at least one thermal sensing unit for an ambient environment and at least one thermal sensing unit in direct thermal communication from the body isolated thermally from the ambient environment with in-sensor thermally isolating materials.
50. The electronic device of claim 39, being configured to automatically switch operation modes, wherein the operation modes include at least a first mode when the living subject is at rest, and a second modes when the living subject is in a high motion.
51. The electronic device of claim 39, being configured to measure a range of physiological information from activity of a cardiopulmonary system and movements of a core body to a diverse collection of processes across thoracic cavity, esophagus, pharynx, and oral cavity related to respiration, speech, swallowing, wheezing, coughing, and sneezing.
52. The electronic device of claim 51, being configured to separate signals associated with the cardiopulmonary system and related processes from those due to body movements.
53. The electronic device of claim 51, being configured to spatiotemporally map movements of the skin at this region of the anatomy onto which the electronic device is attached during cardiac and respiratory activities.
54. The electronic device of claim 51, being configured to continuously measure temperature, heart rate (HR), respiratory rate (RR), activity level, and body orientation, across a range of vigorous activities and conditions.
55. The electronic device of claim 51, being configured to monitor key symptoms of a patient with COVID-19 infection to track progress of recovery and response to therapies in hospital and/or home.
56. The electronic device of claim 51, being configured to measure any of respiratory or motion related digital biomarkers associated with coughing, swallowing, and/or specific motion related activities.
57. The electronic device of claim 56, being configured to assess coughing when the living subject is moving or immobile, and/or to measure muscle motion, when the living subject is moving.
58. The electronic device of claim 39, further comprising a bidirectional wireless communication system electronically coupled to the electronic device and configured to send an output signal from the electronic device to an external device.
59. The electronic device of claim 58, wherein the bidirectional wireless communication system is further configured to deliver commands from the external device to the electronic device.
60. The electronic device of claim 58, wherein the bidirectional wireless communication system comprises a controller that utilizes at least one of near field communication (NFC), Wi-Fi/Internet, Bluetooth, Bluetooth low energy (BLE), and cellular communication protocols for wireless communication.
61. The electronic device of claim 58, further comprising a customized app with a user interface deployed in the external device to allow a user to configure and operate the electronic device for data collection, data transfer, data storage and analysis, wireless charging, and monitoring of user's conditions.
62. The electronic device of claim 61, wherein the customized app is configured to allow time-synchronized operation of the sensor network simultaneously.
63. The electronic device of claim 58, wherein the external device is a mobile device, a computer, or a cloud service.
64. The electronic device of claim 39, further comprising a power module coupled to the sensor network for providing power thereto.
65. The electronic device of claim 64, wherein the power module further comprises a failure prevention element including a short-circuit protection component or a circuit to avoid battery malfunction.
66. The electronic device of claim 64, wherein the power module comprises at least one battery for providing the power.
67. The electronic device of claim 66, wherein the at least one battery is a rechargeable battery.
68. The electronic device of claim 67, wherein the power module further comprises a wireless charging module for wirelessly charging the rechargeable battery.
69. An electronic device for measuring physiological parameters of a living subject, comprising: a first sensor adapted for detecting a first group of data related to the living subject and a second group of data that is different from the first group of data; and a second sensor for detecting a third group of data that is substantially similar to the second group of data, wherein in operation, the first sensor and the second sensor are time-synchronized to allow the third group of data from the second sensor to be used to substantially cancel out the second group of data from the first sensor.
70. The electronic device of claim 69, wherein the first sensor and the second sensor are spatially and mechanically separated from each other.
71. The electronic device of claim 71, wherein the separation of the first sensor and the second sensor is greater than zero and less than a predetermined distance.
72. The electronic device of claim 69, wherein each of the first sensor and the second sensor comprises an inertial measurement unit (IMU), a thermal sensor, a pressure sensor, or optical sensor.
73. The electronic device of claim 69, wherein the first group of data is physiological signals of the living subject, and the second group of data is signals related to ambient, motion and/or vibration at the first sensor.
74. The electronic device of claim 73, wherein the third group of data is signals related to ambient, motion and/or vibration at the second sensor.
75. The electronic device of claim 69, wherein both of the first sensor and second sensor are operably in mechanical communication with the skin of the living subject.
76. The electronic device of claim 75, wherein the first sensor is operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body, and the second sensor is operably in indirectly mechanical communication with the skin of the living subject.
77. The electronic device of claim 76, wherein the first sensor and the second sensor are operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body to assess pulse transit time.
78. The electronic device of claim 69, being flexible and conformable to the skin with a specific geometrical polarity for mounting in an anatomical location of interest of the living subject.
79. An electronic device for measuring physiological parameters of a living subject, comprising: a first sensor adapted for detecting a first group of data related to the living subject and a second group of data that is different from the first group of data; and a second sensor for detecting a third group of data that is substantially similar to the second group of data, wherein in operation, the first sensor is positioned such that there is a first distance d1 between a center of the first sensor and an area of the living subject where physiological signals of the living subject are measurable; the second sensor is positioned such that there is a second distance d2 between a center of the second sensor and the center of the first sensor, wherein the second distance d2 is greater than zero and less than a predetermined distance.
80. The electronic device of claim 79, wherein the second sensor is positioned over the first sensor.
81. The electronic device of claim 79, wherein the second sensor is positioned away from the first sensor.
82. The electronic device of claim 79, wherein each of the first sensor and the second sensor comprises an inertial measurement unit (IMU), a thermal sensor, a pressure sensor, or optical sensor.
83. The electronic device of claim 79, wherein the first group of data is physiological signals of the living subject, and the second group of data is signals related to ambient, motion and/or vibration at the first sensor.
84. The electronic device of claim 83, wherein the third group of data is signals related to ambient, motion and/or vibration at the second sensor.
85. The electronic device of claim 79, wherein both of the first sensor and second sensor are operably in mechanical communication with the skin of the living subject.
86. The electronic device of claim 85, wherein the first sensor is operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body, and the second sensor is operably in indirectly mechanical communication with the skin of the living subject.
87. The electronic device of claim 85, wherein the first sensor and the second sensor are operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body to assess pulse transit time.
88. The electronic device of claim 79, being flexible and conformable to the skin with a specific geometrical polarity for mounting in an anatomical location of interest of the living subject.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0098] The accompanying drawings illustrate one or more embodiments of the invention and together with the written description, serve to explain the principles of the invention. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or like elements of an embodiment.
[0099]
[0100]
[0101]
[0102]
[0103]
[0104]
[0105]
[0106]
[0107]
[0108]
[0109]
[0110]
[0111]
[0112]
[0113]
[0114]
[0115]
[0116]
[0117]
[0118]
[0119]
[0120]
[0121]
[0122]
[0123]
[0124]
[0125]
[0126]
[0127]
[0128]
[0129]
[0130]
[0131]
[0132]
DETAILED DESCRIPTION OF THE INVENTION
[0133] The invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this invention will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like reference numerals refer to like elements throughout.
[0134] The terms used in this specification generally have their ordinary meanings in the art, within the context of the invention, and in the specific context where each term is used. Certain terms that are used to describe the invention are discussed below, or elsewhere in the specification, to provide additional guidance to the practitioner regarding the description of the invention. For convenience, certain terms may be highlighted, for example using italics and/or quotation marks. The use of highlighting has no influence on the scope and meaning of a term; the scope and meaning of a term is the same, in the same context, whether or not it is highlighted. It will be appreciated that same thing can be said in more than one way. Consequently, alternative language and synonyms may be used for any one or more of the terms discussed herein, nor is any special significance to be placed upon whether or not a term is elaborated or discussed herein. Synonyms for certain terms are provided. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification including examples of any terms discussed herein is illustrative only, and in no way limits the scope and meaning of the invention or of any exemplified term. Likewise, the invention is not limited to various embodiments given in this specification.
[0135] One of ordinary skill in the art will appreciate that starting materials, biological materials, reagents, synthetic methods, purification methods, analytical methods, assay methods, and biological methods other than those specifically exemplified can be employed in the practice of the invention without resort to undue experimentation. All art-known functional equivalents, of any such materials and methods are intended to be included in this invention. The terms and expressions which have been employed are used as terms of description and not of limitation, and there is no intention that in the use of such terms and expressions of excluding any equivalents of the features shown and described or portions thereof, but it is recognized that various modifications are possible within the scope of the invention claimed. Thus, it should be understood that although the invention has been specifically disclosed by preferred embodiments and optional features, modification and variation of the concepts herein disclosed may be resorted to by those skilled in the art, and that such modifications and variations are considered to be within the scope of this invention as defined by the appended claims.
[0136] Whenever a range is given in the specification, for example, a temperature range, a time range, or a composition or concentration range, all intermediate ranges and subranges, as well as all individual values included in the ranges given are intended to be included in the invention. It will be understood that any subranges or individual values in a range or subrange that are included in the description herein can be excluded from the claims herein.
[0137] It will be understood that, as used in the description herein and throughout the claims that follow, the meaning of a, an, and the includes plural reference unless the context clearly dictates otherwise. Thus, for example, reference to a cell includes a plurality of such cells and equivalents thereof known to those skilled in the art. As well, the terms a (or an), one or more and at least one can be used interchangeably herein. It is also to be noted that the terms comprising, including, and having can be used interchangeably.
[0138] It will be understood that when an element is referred to as being on, attached to, connected to, coupled with, contacting, etc., another element, it can be directly on, attached to, connected to, coupled with or contacting the other element or intervening elements may also be present. In contrast, when an element is referred to as being, for example, directly on, directly attached to, directly connected to, directly coupled with or directly contacting another element, there are no intervening elements present. It will also be appreciated by those of skill in the art that references to a structure or feature that is disposed adjacent another feature may have portions that overlap or underlie the adjacent feature.
[0139] It will be understood that, although the terms first, second, third etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or section from another element, component, region, layer or section. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings of the invention.
[0140] Furthermore, relative terms, such as lower or bottom and upper or top, may be used herein to describe one element's relationship to another element as illustrated in the figures. It will be understood that relative terms are intended to encompass different orientations of the device in addition to the orientation depicted in the figures. For example, if the device in one of the figures is turned over, elements described as being on the lower side of other elements would then be oriented on upper sides of the other elements. The exemplary term lower, can therefore, encompasses both an orientation of lower and upper, depending of the particular orientation of the figure. Similarly, if the device in one of the figures is turned over, elements described as below or beneath other elements would then be oriented above the other elements. The exemplary terms below or beneath can, therefore, encompass both an orientation of above and below.
[0141] It will be further understood that the terms comprises and/or comprising, or includes and/or including, or has and/or having, or carry and/or carrying, or contain and/or containing, or involve and/or involving, characterized by, and the like are to be open-ended, i.e., to mean including but not limited to. When used in this disclosure, they specify the presence of stated features, regions, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, regions, integers, steps, operations, elements, components, and/or groups thereof.
[0142] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the invention, and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
[0143] As used in the disclosure, around, about, approximately or substantially shall generally mean within 20 percent, preferably within 10 percent, and more preferably within 5 percent of a given value or range. Numerical quantities given herein are approximate, meaning that the term around, about, approximately or substantially can be inferred if not expressly stated.
[0144] As used in the disclosure, the phrase at least one of A, B, and C should be construed to mean a logical (A or B or C), using a non-exclusive logical OR. As used herein, the term and/or includes any and all combinations of one or more of the associated listed items.
[0145] The term mechano-acoustic, as used in the disclosure, refers to any sound, vibration or movement by a user that is detectable by an accelerometer or a gyroscope. Accordingly, accelerometers are preferably high frequency, three-axis accelerometers, capable of detecting a wide range of mechano-acoustic signals. Examples include respiration, swallowing, organ (lung, heart) movement, motion (scratching, exercise, and/or movement), talking, bowel activity, coughing, sneezing, and the like.
[0146] As used in the disclosure, the term bidirectional wireless communication system refers to onboard components of sensors, wireless controller and other electronic components that provides capability of receiving and sending signals using at least one communication protocol of near field communication (NFC), Wi-Fi/Internet, Bluetooth, Bluetooth low energy (BLE), and Cellular communication protocols for wireless communication. In this manner, an output may be provided to an external device, including a cloud-based device, personal portable device, or a caregiver's computer system. Similarly, a command may be sent to the sensor, such as by an external controller, which may or may not correspond to the external device. Machine learning algorithms may be employed to improve signal analysis and, in turn, command signals sent to the medical sensor, including a stimulator of the medical sensor for providing haptic signal to a user of the medical device useful in a therapy. More generally, these systems may be incorporated into a processor, such as a microprocessor located on-board or physically remote from the electronic device of the medical sensor. An example of the wireless controller is a near field communication (NFC) chip, including NFC chips. NFC is a radio technology enabling bi-directional short range wireless communication between devices. Another example of a wireless controller is a Bluetooth chip, or a BLE system-on-chip (SoC), which enables devices to communicate via a standard radio frequency instead of through cables, wires or direct user action.
[0147] The term flexibility or bendability, as used in the disclosure, refers to the ability of a material, structure, device or device component to be deformed into a curved or bent shape without undergoing a transformation that introduces significant strain, such as strain characterizing the failure point of a material, structure, device or device component. In an exemplary embodiment, a flexible material, structure, device or device component may be deformed into a curved shape without introducing strain larger than or equal to 5%, for some applications larger than or equal to 1%, and for yet other applications larger than or equal to in strain-sensitive regions. A used herein, some, but not necessarily all, flexible structures are also stretchable. A variety of properties provide flexible structures (e.g., device components) of the invention, including materials properties such as a low modulus, bending stiffness and flexural rigidity; physical dimensions such as small average thickness (e.g., less than 100 microns, optionally less than 10 microns and optionally less than 1 micron) and device geometries such as thin film and open or mesh geometries.
[0148] The term stretchable, as used in the disclosure, refers to the ability of a material, structure, device or device component to be strained without undergoing fracture. In an exemplary embodiment, a stretchable material, structure, device or device component may undergo strain larger than 0.5% without fracturing, for some applications strain larger than 1% without fracturing and for yet other applications strain larger than 3% without fracturing. As used herein, many stretchable structures are also flexible. Some stretchable structures (e.g., device components) are engineered to be able to undergo compression, elongation and/or twisting so as to be able to deform without fracturing. Stretchable structures include thin film structures comprising stretchable materials, such as elastomers; bent structures capable of elongation, compression and/or twisting motion; and structures having an island-bridge geometry. Stretchable device components include structures having stretchable interconnects, such as stretchable electrical interconnects. As used herein, for embodiments where the devices are mounted directly to the skin, the devices may be characterized as stretchable, including stretchable and flexible so as to achieve good conformal contact with underlying skin, if desired. Conformable refers to a device, material or substrate which has a bending stiffness sufficiently low and elasticity sufficiently high to allow the device, material or substrate to adopt a desired contour profile, including a contour profile that may change over time, for example a contour profile allowing for conformal contact with a surface having a pattern of relief or recessed features, or. In certain embodiments, a desired contour profile is that of a tissue in a biological environment, for example skin or the epidermal layer.
[0149] The term elastomer, as used in the disclosure, refers to a polymeric material which can be stretched or deformed and return to its original shape without substantial permanent deformation. Elastomers commonly undergo substantially elastic deformations. Useful elastomers include those comprising polymers, copolymers, composite materials or mixtures of polymers and copolymers. Elastomeric layer refers to a layer comprising at least one elastomer.
[0150] Elastomeric layers may also include dopants and other non-elastomeric materials. Useful elastomers useful include, but are not limited to, thermoplastic elastomers, styrenic materials, olefenic materials, polyolefin, polyurethane thermoplastic elastomers, polyamides, synthetic rubbers, PDMS, polybutadiene, polyisobutylene, poly(styrene-butadiene-styrene), polyurethanes, polychloroprene and silicones. In some embodiments, an elastomeric stamp comprises an elastomer. Exemplary elastomers include, but are not limited to silicon containing polymers such as polysiloxanes including poly(dimethyl siloxane) (i.e. PDMS and h-PDMS), poly(methyl siloxane), partially alkylated poly(methyl siloxane), poly(alkyl methyl siloxane) and poly(phenyl methyl siloxane), silicon modified elastomers, thermoplastic elastomers, styrenic materials, olefenic materials, polyolefin, polyurethane thermoplastic elastomers, polyamides, synthetic rubbers, polyisobutylene, poly(styrene-butadiene-styrene), polyurethanes, polychloroprene and silicones. In an embodiment, a flexible polymer is a flexible elastomer.
[0151] The term encapsulate or encapsulation, as used in the disclosure, refers to the orientation of one structure such that it is at least partially, and in some cases completely, surrounded by one or more other structures. Partially encapsulated refers to the orientation of one structure such that it is partially surrounded by one or more other structures. Completely encapsulated refers to the orientation of one structure such that it is completely surrounded by one or more other structures. The invention includes devices having partially or completely encapsulated electronic devices, device components and/or inorganic semiconductor components.
[0152] Embodiments of the invention are illustrated in detail hereinafter with reference to accompanying drawings. The description below is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. The broad teachings of the invention can be implemented in a variety of forms. Therefore, while this invention includes particular examples, the true scope of the invention should not be so limited since other modifications will become apparent upon a study of the drawings, the specification, and the following claims. For purposes of clarity, the same reference numbers will be used in the drawings to identify similar elements. It should be understood that one or more steps within a method may be executed in different order (or concurrently) without altering the principles of the invention.
[0153] Soft, flexible, and wearable sensors offer the ability to continuously collect physiological parameters of relevance to human health. These systems offer the future ability to provide continuous biofeedback and even therapeutic benefit via on-board analytics and edge computing as we have previously disclosed. A key limitation of nearly all existing wearable sensors is motion artifact related deterioration of signal quality. This includes a lack of accurate sensing for heart rate, respiratory rate, body position, swallowing, talking, crying, or other respiratory signals in scenarios where the living subject is moving. Furthermore, core body temperature sensing remains a challenge for non-invasive skin mounted sensors. Thus, the ability to offer skin mounted continuous measurements of core body temperature would provide significant clinical utility.
[0154] One of the objectives of this invention is to provide a new class of wearable sensors that offers dramatically improved motion-resistant and ambient temperature resistant sensing enabled by novel device mechanics and design, and algorithms to subtract noises. This new class of wearable leverages differential measurement of outputs from sensors where one sensor is measuring physiological signals from the body and related ambient and gross body motion signals, and another sensor is measuring at least the related ambient and gross body motion signals allow for effective elimination of noise, e.g., related ambient and gross body motion signals, during rest and motion.
[0155] In certain aspects, the invention relates to an electronic device for measuring physiological parameters of a living subject. As shown in
[0156] In certain embodiments, the data measured by the first IMU and the second IMU are processed such that subtraction of the second signal measured by the second sensor from the second signal measured by the first sensor results in a stronger first signal that is a signal of interest.
[0157] In certain embodiments, the second signal is related to at least one of ambient, motion and vibration.
[0158] In certain embodiments, the data measured by the second IMU includes the first signal and the second signal.
[0159] In certain embodiments, a signal-to-noise ratio (SNR) of a signal measured by the first IMU and the second IMU together is lower than a first SNR of a signal measured by the first IMU individually, or a second SNR of a signal measured by the second IMU individually.
[0160] In certain embodiments, both of the first IMU and the second IMU are operably in mechanical communication with the skin of the living subject.
[0161] In certain embodiments, one of the first IMU and the second IMU is operably in directly mechanical communication with the skin of the living subject for sensing physiological signals of the body, while the other of the first IMU and the second IMU is operably in indirectly mechanical communication with the skin of the living subject.
[0162] In certain embodiments, the first IMU and the second IMU are operably in directly mechanical communication with the skin of the living subject.
[0163] In certain embodiments, one of the first IMU and the second IMU is separated from the rest of rigid components of the electronic device.
[0164] In certain embodiments, the electronic device also comprises at least first and second thermal sensing units, wherein one of the first and second thermal sensing units is thermally isolated from an ambient environment and configured to measure a body temperature of the living subject, and the other of the first and second thermal sensing units is configured to measure the ambient temperature.
[0165] In certain embodiments, each of the first and second thermal sensing units is embedded in a respective one of the first and second IMUs.
[0166] In certain embodiments, the electronic device is configured to measure a range of physiological information from activity of a cardiopulmonary system and movements of a core body to a diverse collection of processes across thoracic cavity, esophagus, pharynx, and oral cavity related to respiration, speech, swallowing, wheezing, coughing, and sneezing.
[0167] In certain embodiments, the electronic device is configured to separate signals associated with the cardiopulmonary system and related processes from those due to body movements.
[0168] In certain embodiments, the electronic device is configured to spatiotemporally map movements of the skin at this region of the anatomy onto which the electronic device is attached during cardiac and respiratory activities.
[0169] In certain embodiments, the electronic device is configured to continuously measure temperature, heart rate (HR), respiratory rate (RR), activity level, and body orientation, across a range of vigorous activities and conditions.
[0170] In certain embodiments, the electronic device is configured to monitor key symptoms of a patient with COVID-19 infection to track progress of recovery and response to therapies in hospital and/or home.
[0171] In certain embodiments, the electronic device is configured to measure any of respiratory or motion related digital biomarkers associated with coughing, swallowing, and/or specific motion related activities.
[0172] In certain embodiments, the electronic device is configured to assess coughing when the living subject is moving or immobile, and/or to measure muscle motion, when the living subject is moving.
[0173] In certain embodiments, the electronic device further comprises a bidirectional wireless communication system electronically coupled to the electronic device and configured to send an output signal from the electronic device to an external device.
[0174] In certain embodiments, the external device is a mobile device, a computer, or a cloud service.
[0175] In certain embodiments, the bidirectional wireless communication system is further configured to deliver commands from the external device to the electronic device.
[0176] In certain embodiments, the bidirectional wireless communication system comprises a controller that utilizes at least one of near field communication (NFC), Wi-Fi/Internet, Bluetooth, Bluetooth low energy (BLE), and cellular communication protocols for wireless communication.
[0177] In certain embodiments, the electronic device further comprises a customized app with a user interface deployed in the external device to allow a user to configure and operate the electronic device for data collection, data transfer, data storage and analysis, wireless charging, and monitoring of user's conditions.
[0178] In certain embodiments, the customized app is configured to allow time-synchronized operation of a plurality of the electronic devices simultaneously.
[0179] In certain embodiments, the electronic device further comprises a power module coupled to the first IMU, the second IMU and the MCU for providing power thereto.
[0180] In certain embodiments, the power module comprises at least one battery for providing the power. In certain embodiments, the battery is a rechargeable battery.
[0181] In certain embodiments, the power module further comprises a wireless charging module for wirelessly charging the rechargeable battery.
[0182] In certain embodiments, the power module further comprises a failure prevention element including a short-circuit protection component or a circuit to avoid battery malfunction.
[0183] In certain embodiments, the second IMU is placed in a manner that it bends and folds over the battery.
[0184] In certain embodiments, the electronic device further comprises a flexible printed circuit board (fPCB) having flexible and stretchable interconnects electrically connecting to electronic components including the first IMU, the second IMU and the MCU and the power module.
[0185] In certain embodiments, the electronic device further comprises an elastomeric encapsulation layer at least partially surrounding the electronic components and the flexible and stretchable interconnects to form a tissue-facing surface attached to the living subject and an environment-facing surface, wherein the tissue-facing surface is configured to conform to a skin surface of the living subject.
[0186] In certain embodiments, the encapsulation layer is formed of a flame retardant material.
[0187] In certain embodiments, the elastomeric encapsulation layer is a waterproof and biocompatible silicone enclosure.
[0188] In certain embodiments, the electronic device further comprises a biocompatible hydrogel adhesive for attaching the electronic device on the respective region of the living subject, wherein the biocompatible hydrogel adhesive is adapted such that signals from the living subject are operably conductible to the first IMU and the second IMU.
[0189] In certain embodiments, the electronic device is flexible and conformable to the skin with a specific geometrical polarity for mounting in an anatomical location of interest of the living subject.
[0190] In certain embodiments, the electronic device is wearable, tissue mountable or in mechanical communication or direct mechanical communication with the skin of the living subject. As used herein mechanical communication refers to the ability for the sensors to interface directly or indirectly with the skin or other tissue in a conformable, flexible, and direct manner (e.g., there is no air gap) which in some embodiments allows for deeper insights and better sensing with less motion artifact compared to accelerometers strapped to the body (wrists or chest).
[0191] In certain embodiments, the electronic device is twistable stretchable, and/or bendable.
[0192] Various embodiments of the present technology include a soft, conformal, stretchable class of device configured specifically for mechano-acoustic recording from the skin, capable of being used on nearly any part of the body, in forms that maximize detectable signals and allow for multimodal operation, such as electrophysiological recording, and neurocognitive interaction.
[0193] Another aspect of the invention provides an electronic device comprising a sensor network comprising a plurality of sensor units operably deployed on a skin of the living subject, the plurality of sensor units being time-synchronized to and spatially and mechanically separated from each other; and an MCU electronically coupled to the plurality of sensor units for processing of data streams from the plurality of sensor units.
[0194] In certain embodiments, the plurality of sensor units are configured to measure a same physiological parameter, or different physiological parameters.
[0195] In certain embodiments, each of the plurality of sensor units comprises at least a first sensor and the second sensor time-synchronized to and spatially and mechanically separated from each other.
[0196] In certain embodiments, for each sensor unit, the first sensor is configured to measure data including a first signal related to a physiological signal of the living subject and a second signal, and the second sensor is configured to measure data including at least the second signal. The first signal measured by the first sensor has a signal strength greater than that the second signal measured by the first sensor.
[0197] In certain embodiments, the data measured by the first sensor and the second sensor of said sensor unit are processed such that subtraction of the second signal measured by the second sensor from the second signal measured by the first sensor results in a stronger first signal that is a signal of interest
[0198] In certain embodiments, the second signal is related to at least one of ambient, motion and vibration.
[0199] In certain embodiments, each of the first sensor and the second sensor comprises the IMU.
[0200] In certain embodiments, the electronic device further comprises a plurality of thermal sensing units.
[0201] In certain embodiments, the MCU operably receives inputs from synchronized outputs of a plurality of thermal sensor units with at least one thermal sensing unit for the ambient environment and at least one thermal sensing unit in direct thermal communication from the body isolated thermally from the ambient environment with in-sensor thermally isolating materials.
[0202] In certain embodiments, the electronic device is configured to automatically switch operation modes, the operation modes include at least a first mode when the living subject is at rest, and a second modes when the living subject is in a high motion.
[0203] Yet another aspect of the invention provides an electronic device 1001 for measuring physiological parameters of a living subject 1000, as shown in
[0204] In certain embodiments, the first sensor and the second sensor are spatially and mechanically separated from each other.
[0205] In certain embodiments, the separation of the first sensor and the second sensor is greater than zero and less than a predetermined distance.
[0206] In certain embodiments, each of the first sensor and the second sensor comprises an IMU, a thermal sensor, and/or a pressure sensor.
[0207] In certain embodiments, the first group of data is physiological signals of the living subject, and the second group of data is signals related to ambient, motion and/or vibration at the first sensor.
[0208] In certain embodiments, the third group of data is signals related to ambient, motion and/or vibration at the second sensor.
[0209] In certain embodiments, both of the first sensor and second sensor are operably in mechanical communication with the skin of the living subject.
[0210] In certain embodiments, the first sensor is operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body, and the second sensor is operably in indirectly mechanical communication with the skin of the living subject.
[0211] In certain embodiments, the first sensor and the second sensor are operably in directly mechanical communication with the skin of the living subject for sensing physiological signals from the body to assess pulse transit time.
[0212] In certain embodiments, the electronic device is flexible and conformable to the skin with a specific geometrical polarity for mounting in an anatomical location of interest of the living subject.
[0213] A further aspect of the invention provides an electronic device 1001 for measuring physiological parameters of a living subject 1000, as shown in
[0214] In one embodiment, the second sensor 1004 is positioned over the first sensor 1002, as shown in
[0215] In one embodiment, the second sensor 1004 is positioned away from the first sensor 1002, as shown in
[0216] In certain embodiments, measurements of physiological parameters can be derived from mechano-acoustic signals from the human body of heart rate, respiratory rate, body position, swallow count, cry time, talk time, singing, coughing, and differential motion of specific body parts when the sensor is mounted across an anatomical boundary (e.g., trunk motion in relation to the head, hand motion in relation to the wrist, lower leg motion in relation to the knee), and other respiratory signals at rest and during motion.
[0217] In certain embodiments, the derivation of these physiological resistant to motion allows for applicability across a wide range of medical specialties and acuity ranging from critical care, general medicine care, ambulatory medicine, rehabilitation, and consumer health particularly in high motion scenarios.
[0218] In certain embodiments, the core body sensing is resistant to ambient temperature fluctuations and clothing.
[0219] In certain embodiments, the single MCU receives inputs from synchronized outputs of a plurality of IMU sensors where an individual IMU sensor is in differential mechanical communication with the body.
[0220] In certain embodiments, the single MCU receives inputs from synchronized outputs of a plurality of thermal sensors with at least one thermal sensor for the ambient environment and at least one thermal sensor in direct thermal communication from the body isolated thermally from the ambient with in-sensor thermally isolating materials.
[0221] In certain embodiments, the novel mechanics of the sensor/device allows for twisting, stretching, bending to enable a low profile design and thermal/mechanical isolation of various sensing elements in the device.
[0222] In certain embodiments, the novel mechanics of the sensor/device enables a physical separation of rigid components of the device and the sensing element enabling mounting in unique anatomical locations for high data fidelity. Further advantages include the ability to obscure the sensor from sight to reduce patient stigma. This represents an umbilical functionality to allow for discrete sensing in sensitive locations with the body of the sensor is mounted in a location easier to obscure with clothing.
[0223] In certain embodiments, thermal isolating materials and layers that allow for improved thermal sensing of core body temperature that is resistant to ambient temperature fluctuations. In certain embodiments, the sensor/device is configured such that the modes of operation in situations of high motion allows for automated switching to motion resistant outputs. For example, the preferred measurement of heart rate may be ECG at resthowever, a patient maybe in a situation where they are actively moving. In this instance, the sensor can start actively interrogating the dual IMUS for heart rate derivation where ECG based heart rate is not dependable.
[0224] In certain embodiments, the sensor/device has ability to toggle or activate dual sensing functionality in situations of high motion to improve accuracy but conserve power in settings of rest.
[0225] The techniques introduced here can be embodied as special purpose hardware (e.g. circuitry) as programmable circuitry appropriately programmed with software and/or firmware, or as a combination of special-purpose and programmable circuitry. Hence, embodiment may include a machine-readable medium having stored thereon instructions which may be used to program a computer (or other electronic devices) to perform a process. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, compact disc read-only memories (CD-ROMs), magneto-optical disks, ROMs, random access memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or other type of media/machine-readable medium suitable for storing electronic instructions.
[0226] These and other aspects of the present invention are further described below. Without intent to limit the scope of the invention, exemplary instruments, apparatus, methods and their related results according to the embodiments of the present invention are given below. Note that titles or subtitles may be used in the examples for convenience of a reader, which in no way should limit the scope of the invention. Moreover, certain theories are proposed and disclosed herein; however, in no way they, whether they are right or wrong, should limit the scope of the invention so long as the invention is practiced according to the invention without regard for any particular theory or scheme of action.
Example
Differential Cardiopulmonary Monitoring System for Artifact-Canceled Physiological Tracking of Athletes, Workers, and COVID-19 Patients
[0227] Soft, skin-integrated electronic sensors can provide continuous measurements of diverse physiological parameters, with broad relevance to the future of human health care. Motion artifacts can, however, corrupt the recorded signals, particularly those associated with mechanical signatures of cardiopulmonary processes. Design strategies introduced herein address this limitation through differential operation of a matched, time-synchronized pair of high-bandwidth accelerometers located on parts of the anatomy that exhibit strong spatial gradients in motion characteristics. When mounted at a location that spans the suprasternal notch and the sternal manubrium, these dual-sensing devices allow measurements of heart rate and sounds, respiratory activities, body temperature, body orientation, and activity level, along with swallowing, coughing, talking, and related processes, without sensitivity to ambient conditions during routine daily activities, vigorous exercises, intense manual labor, and even swimming. Deployments on patients with COVID-19 allow clinical-grade ambulatory monitoring of the key symptoms of the disease even during rehabilitation protocols.
[0228] Specifically, the exemplary work exploits a pair of time-synchronized, high-bandwidth accelerometers (inertial measurement units (IMUs)) at opposite ends of a skin-interfaced device that locates one of the IMUs at the suprasternal notch (SN) and the other at the sternal manubrium (SM). Differences in movements of the skin associated with cardiac and respiratory activity between these regions lead to differences in signals captured by these IMUs. By contrast, overall movements of the neck and the core of the body produce nearly identical responses. As a consequence, simple differential measurements cleanly eliminate common mode features, thereby separating signals associated with cardiopulmonary and related processes from those due to body movements. An additional benefit of this architecture is that temperature sensors integrated in these IMUs can be used in a similar differential manner to yield estimates of core body temperature, largely independent of the ambient. Here, careful choices in thermal aspects of the device layout, rather than intrinsic anatomical gradients, produce the necessary differential responses.
[0229] The following sections present (i) designs of automated devices that incorporate matched pairs of high-bandwidth IMUs with optimized soft mechanics for high measurement sensitivity and accurate time synchronization across the SN and SM; (ii) results of spatiotemporal mapping of movements of the skin at this region of the anatomy during cardiac and respiratory activity; (iii) examples of modeling and design approaches for exploiting these IMUs in dual temperature sensing of core body temperature, with minimal influence of the thermal ambient; (iv) demonstrations of continuous, differential measurements of temperature, HR, and respiratory rate (RR) across a range of vigorous activities and conditions, with benchmarking against the most accurate commercial sensors; and (v) illustrations of the use on patients recovering from COVID-19 infections to track key symptoms of the disease even during intense physical rehabilitation protocols.
Results
Design and Characterization
[0230] The platform exploits a thin, flexible printed circuit board (fPCB) in an open architecture, with an elastomeric encapsulation structure that completely seals the system to physically isolate the electronics from the environment and to facilitate sterilization for reuse. The layouts yield soft mechanical characteristics for comfortable mounting on the skin, even at sensitive regions of the body. A touch-free docking interrogator supports wireless charging and initiates data downloads in an automated fashion to eliminate user burden.
[0231]
[0232]
[0233] Experimental studies, as shown in
[0234] The block diagram in
[0235] Full automation of the key operational steps minimizes user burden, of particular importance for use with patients with COVID-19, as described subsequently. The user simply mounts the device during use and places it on the wireless charging platform when removed. The sensor continuously stores data from both accelerometers onto the internal memory module when not on the charging platform; when on this platform, the device charges and simultaneously streams data to a user interface device via Bluetooth protocols. The user interface then passes data to a cloud hub for signal processing to extract various physiological information, including cough count, RR, HR, activity level, body orientation, and calibrated body temperature. The cloud hub is HIPAA (Health Insurance Portability and Accountability Act) compliant, and the interface application uses HTTPS transport layer security (TLS 1.2) with an algorithm for encryption/decryption for the application programming interface and a standard for in-storage encryption (AES-256).
Core Body Temperature Estimation with Dual Temperature Sensing
[0236] The simplest consequence of the dual-sensing architecture is in temperature measurements that approximate the temperature of the skin (T.sub.skin), largely unperturbed by the ambient (T.sub.amb), following schemes described previously in other contexts. Here, sensors embedded in IMU1 and IMU2, in a configuration illustrated in
[0237] Transient heat transfer analysis associated with three-dimensional (3D) thermal conduction and natural convection quantifies these effects. The boundary conditions include a constant temperature at the bottom surface of the tissue layer (T.sub.core) and convective coupling to the ambient air at the free surfaces (T.sub.amb). The parameters include the room temperature, T.sub.amb=18 to 24 C., and the convection coefficient, h=5 to 30 W m.sup.2 K.sup.1.
[0238] A simple demonstration involves a subject wearing a device in an environment with an ambient temperature of 18.2 C., then moving between areas with temperatures of 21.3 and 19.5 C. every 3 to 8 min, and lastly remaining in place as the ambient temperature rises from 19.5 to 24.2 C. for 7 min. The results for temperatures recorded from IMU1 and IMU2 appear in the top graph in
Dual Sensing from the SN and the SM
[0239] Dual temperature sensing relies critically on design choices that yield different levels of sensitivity to temperatures of the body and the ambient for IMU1 and IMU2. For dual MA sensing, differential responses arise mainly from spatial gradients in motions across the mounting location, specifically those from the SN, the location of IMU1 and from the SM, the location of IMU2 (2.5 cm below the IMU1). Spatiotemporal maps of motions of this region of the anatomy determined by 3D particle tracking velocimetry (3D-PTV) provide quantitative insights into differential motions associated with respiratory and cardiac activities at these two locations and adjacent regions. 3D-PTV relies on optical techniques to track the Lagrangian paths of fiducial marks on the skin, in 3D using stereoscopic imaging, in a way that recapitulates the point-measurement modality of the IMUs. Here, 3D-PTV can capture the essence of dual sensing from the SN and SM by recording from four time-synchronized, high-speed cameras, each at a frame rate of 200 frames per second (fps) (
[0240]
[0241] Similar considerations apply to differential dynamics associated with respiration.
Differential MA Sensing Minimizes Motion Artifacts in Respiratory and Cardiac Monitoring
[0242] As verified by 3D-PTV, cardiac and respiratory activities create motions that have different amplitudes at the SN and the SM. Similar amplitudes result from movements of the core body. By consequence, simple subtraction of MA signals measured at these two locations greatly improves the accuracy and reliability of measurements of respiratory and cardiac activity by eliminating large, common-mode features that result from body motions.
[0243] The flow chart in
[0244] The flow chart in
[0245]
[0246]
Examples During Vigorous Activities in Sports
[0247] Athletic competition, fitness training, manual labor, and related activities create daunting challenges for accurate measurements of RR and HR because of fast, dynamic, and highly variable large-amplitude accelerations of the body. The dual-sensor platform offers powerful capabilities in these and other contexts.
Examples during Vigorous Activities in Manual Labor
[0248] Worker health represents another area of opportunity given the need to continuously monitor key cardiopulmonary parameters in hostile environments. Demanding occupations that involve work in construction, mining, firefighting, and related areas could benefit from noninvasive, high-fidelity monitoring systems to detect fatigue, heat exhaustion, and performance in ways that are seamless and compatible with high motion artifacts and extreme ambient conditions in temperature, sounds, and other.
Clinical Deployment for Monitoring COVID-19 Patients Recover
[0249] An area of urgent interest is in digital monitoring of the key symptoms of patients with COVID-19 to track the progress of recovery and the response to therapies in the hospital and the home. In addition to RR, HR, body movements, and body temperature, measurements also capture the intensity and frequency of coughing, talking, and laughing events. Collectively, these factors are important for symptomatic evaluation of the disease and for indirect assessments of aerosol production. Studies reported here involve a COVID-19-positive patient (49 years old; female; height, 170 cm; weight, 107 kg; type 2 diabetes mellitus, obesity, hypertension, and cerebrovascular accident in 2018) provided with the dual-sensing platform and instructions for use in recording over the course of 8 days, as shown in
Materials and Methods
Encapsulating the Electronics in a Soft Enclosure
[0250] Top and bottom molded layers of a low-modulus elastomer (Silbione 4420; each 300 m thick) form a soft encapsulating structure for the electronics. The fabrication process involved placing the electronics onto the bottom layer and then casting a uniform overcoat of a liquid prepolymer to a silicone elastomer (Ecoflex 0030). Mounting the top molded layer with a spacer on each of the short sides of the mold and clamping the assembly together enclosed the system for thermal curing at 70 C. in an oven for 20 min. Cooling to room temperature, removing the device, and eliminating excess elastomer from the perimeter using a die cutter completed the process.
Forming the Thermal Insulating Foam
[0251] A three-axis milling machine (Roland MDX 540) created an aluminum mold with a concave shape. Casting a liquid precursor to a polyurethane foam material (mixing ratio of A to B is 2:3; FlexFoam-iT! III, Smooth-On, USA) on the mold after coating its surface with a releasing agent (Ease Release 200, Smooth-On, USA) and then pressing a flat aluminum plate on top side produced insulation foams upon curing on a hot plate at 100 C. for 30 min. A reflective film (thermal blanket; Swiss Safe Products) attached to the flat bottom surface of the foam layer using a 5-m-thick double-sided tape (No. 5600, Nitto Denko Co., Japan) further improved the insulating properties. The final step of the process involved a CO2 laser (Universal Laser System Inc.) to cut the perimeter of the material into the final geometry.
Modeling the Mechanical Characteristics
[0252] The commercial software ABAQUS (ABAQUS Analysis User's Manual 2010, version 6.10) defined the strain c in the metal layers of the system. The simulations allowed selection of design parameters to ensure that the strain in the copper (Cu) remains below the fracture limit (6=1%), to avoid mechanical failure during assembly of the device and during different types of deformations (stretching, bending, and twisting). The thin Cu and PI films were modeled by composite shell elements (S4R). The number of elements in the model was 210.sup.5, and the minimal element size was of the width of the narrowest interconnects (100 m). The mesh convergence of the simulation was guaranteed for all cases. The elastic modulus (E) and Poisson's ratio (v) of are E.sub.Cu=119 GPa and v.sub.Cu=0.34 for copper and E.sub.PI=2.5 GPa and V.sub.PI=0.34 for PI.
3D FEA Modeling for the Thermal Characteristics
[0253] Transient heat transfer analysis determined the effects of thermal conduction and natural convection on the responses of the temperature sensors. The tissue and internal sensor components were modeled by hexahedron elements (DC3D8). The encapsulation layer was modeled using tetrahedron elements (DC3D4). The number of elements in the model was 610.sup.5, and mesh convergence of the simulation was ensured for all cases. The boundary conditions included a constant temperature (T.sub.core) at the bottom surface of the tissue layer and convection conditions with the ambient air (T.sub.amb) at the free surfaces. The following parameters were used in the computations: room temperature T.sub.amb=18 to 24 C.; convection coefficient h=(5 to 30) W m.sup.2 K.sup.1; thermal conductivity, heat capacity, and mass density of 0.3 W m.sup.1 K.sup.1, 1460 J kg.sup.1 K.sup.1, and 960 kg m.sup.3 for the tissue; 0.21 W m.sup.1 K.sup.1, 1090 J kg K.sup.1, and 1420 kg m.sup.3 for the thermoplastic chips; 0.343 W m.sup.1 K.sup.1, 1150 J kg.sup.1 K.sup.1, and 1850 kg m.sup.3 for FR4; 0.03 W m.sup.1 K.sup.1, 1200 J kg K.sup.1, and 85 kg m.sup.3 for the urethane foam; 0.21 W m.sup.1 K.sup.1, 2100 J kg K.sup.1, and 909 kg m.sup.3 for PI; 0.2 W m.sup.1 K.sup.1, 1460 J kg K.sup.1, and 1070 kg m.sup.3 for Ecoflex 00-30; and 0.15 W m.sup.1 K.sup.1, 1460 J kg K.sup.1, and 970 kg m for Silbione 4420.
Measuring the Displacement Distributions by 3D-PTV
[0254] The experiments involved recordings from four synchronized high-speed area scan cameras (20481088 resolution; HT-2000M, Emergent) with 35-mm imaging lenses (F1.4 manual focus; Kowa) at the frame rate of 200 fps. The process focused on tracking of 300 fiducial points marked in a grid pattern across the neck covering the SN, the SM, and adjacent areas. The investigation volume was 10 cm by 8 cm by 10 cm illuminated by six arrays for 600 lumen light-emitting diode light bars. Preprocessing, calibration, 3D reconstruction, tracking, and postprocessing used customized 3D-PTV code. Image sequences were preprocessed by subtracting the background noise and enhancing the contrast. 3D calibration exploited the structure-from-motion technique from multiple views. After removing effects of lens distortion, intrinsic parameters of a single camera were estimated using the checkboard calibration method. Extrinsic parameters of all four cameras, including 3D translation and rotation matrices, were obtained by using a sparse set of points matched across the views. Once all camera parameters were estimated, a dense set of fiducial points across multiviews were detected in a subpixel level and reconstructed in 3D coordinate. 3D reconstructed fiducial points were tracked using the Hungarian algorithm and linked by performing a five-frame gap closing to produce long trajectories. Displacement, velocity, and Lagrangian acceleration were filtered and computed using fourth-order B splines. 3D displacement and vector contour fields were obtained by interpolating scattered fiducial points at each frame based on the Delaunay triangulation. Image sequences during cardiac activities were magnified using the Eulerian video magnification method.
Procedures for Dual-Sensing Temperature and Motion Measurements
[0255] A double-sided medical silicone adhesive (3M, 2477P) secured the sensors to the neck area (aligned IMU1 on the SN and IMU2 on the SM). The authors affirm that all subjects in the study provided written informed consent for study images to be published with faces blurred. All data in this study were captured using IMUS with sensitivity of 0.061 mg (gravitational acceleration), 1666-Hz sampling rates (adjustable up to 6664 Hz), and 2 g acceleration measurement range (adjustable up to 16 g).
Protocols for Human Subject Studies
[0256] The studies were approved by the Northwestern University Institutional Review Board, Chicago, IL, USA (STU00202449 and STU00212522) and were registered on ClinicalTrials.gov (NCT02865070 and NCT04393558). All study-related procedures were carried in accordance with the standards listed in the Declaration of Helsinki, 1964. For COVID-19-positive patients, double-sided medical silicone adhesive (3M, 2477P) secured the sensor to the neck area (aligned IMU1 on the SN and IMU2 on the SM) for more than 12 hours. For multiple days of use, medical-grade transparent film (Tegaderm, 3M) was applied between the skin and the double-sided adhesive to eliminate irritation from the adhesive. Clinical staff assisted the patient in placing the sensor. After each data measurement session, the device was sterilized with 70% isopropyl alcohol and left to dry at room temperature, and the sterilization process was repeated twice.
Classifying Signal Features by Machine Learning to Extract Coughing Events
[0257]
1-D Analytical Model for the Thermal Characteristics
[0258] It is assumed that the skin/tissue thickness and thermal properties are approximately the same for both sensors since the horizontal distance between them is relatively small. In this way, the core body temperature is determined from temperature variations through the thickness direction of the device. A 1-D heat transfer model based on the device material layers (thickness t.sub.i and thermal conductivity k.sub.i, listed in
where z denotes the coordinate along the thickness direction in
[0259] The boundary conditions based on heat conduction through the device layers for the IMU1 sensor can be expressed as
Based on these boundary conditions the temperature of the IMU1 sensor can be expressed as
Similarly, the boundary conditions based on the conduction through the device layers IMU2 sensor can be expressed as
Where, the ratios (B/A) and (D/C) are given below and depend h.
If the device is attached to a different body location with different thermal properties (e.g., neck, head, arm, etc.) then the skin/tissue thermal properties (i.e., thickness and thermal conductivity) would have to be adjusted accordingly (depending on the anatomy of the skin/tissue layers) for each location. Experiments show that the temperature of the battery changes by a negligible amount (<0.06 C.) during device operation (
Analytical Modeling of Differential Accelerometry
[0260] Although most of the capabilities in differential accelerometry arise from intrinsic differences in motions at the SN and SM, additional contributions can arise from details associated with the device layout. A schematic illustration of an analytical model that captures these structural differences is in
u=A.sub.0 sin(w.sub.0t)(20)
to cause both sensors to accelerate along the z-axis. IMU1, located at the SN, is tied to the rigid platform (i.e. same displacement as equation (20)), considered as the chest wall. IMU2, at the SM, connects to this rigid platform by a spring of stiffness k with magnitude k=.sub.iE.sub.iS.sub.i/L.sub.i, where E.sub.i, S.sub.i, and L.sub.i are the Young modulus, effective area, and height, respectively, of different material/electronic layers between the platform and IMU2 (e.g. battery, device and silicone gel) and a damper with damping ratio . Both IMU1 and IMU2 have a mass m. The damper in IMU2 provides a damping force proportional to the relative velocity F=cv, where the damping ratio
depends on the damping factor c and the critical damping factor c.sub.c. In the dual sensor, silicone gel acts as a damper with a damping ratio =1%12%. Since IMU1 is tied to the rigid platform, its acceleration is also the same as
a.sub.IMU1=
The acceleration of IMU1 is described by the ordinary differential equation (ODE) kinematic equation
m
Equation (22) has a solution of the form
[0261] The first term in equation (23) is the general solution and the second term is the solution. Using the initial conditions x(t=0)=0, {dot over (x)}(t=0)=0, the constants A and can be determined. For body motions, w.sub.0=13(2) s.sup.1=620 s.sup.1. For the spring materials (battery, gel, device) in the sensor, the total height is 8 mm and the mass of accelerator is 0.07 g, sow should be larger than 1000 s.sup.1. The solution of A and is not relevant in this case since the first term will decay very fast in a few seconds, thereby simplifying equation (23) to
x=bA.sub.0 sin(w.sub.0t)(24)
Therefore, the acceleration of IMU.sub.2 can be determined as
a.sub.IMU2=
The differential (IMU.sub.1-IMU.sub.2) is then
Because
[0262]
so .fwdarw.0 and there is no phase difference between IMU1 and IMU2. Meanwhile, b.fwdarw.1, so b.sub.0.fwdarw.0 and the amplitude difference between IMU1 and IMU2 is very small.
Discussion
[0263] This exemplary example presents, among other things, a low-profile, lightweight, flexible, and wireless sensor that intimately couples to the skin as a dual measurement interface to the SN and SM with modalities for differential sensing of temperature and MA signatures of body processes. The results allow for measurements of a broad range of physiological parameters and activity behaviors that overcome a fundamental challenge in nearly every existing monitoring system: motion artifacts. Comparisons with previous studies on the mechano-acoustic sensing method are presented in Table 1. Specific examples reported here include tracking of cardiac activity, respiratory activity, respiratory sounds, body temperature, and overall activity across a range of controlled settings and natural activities in sports, manual labor, and clinical medicine. These technologies and underlying ideas have many other implications. Examples include rehabilitation for patients with aphasia and/or dysphagia, where measurements of vocal activity and swallowing are possible during daily life, outside hospitals or rehabilitation clinics, of particular relevance to stroke survivors and patients with chronic obstructive pulmonary disease. Capabilities in tracking these processes without privacy concerns associated with microphone recordings and in a manner that is independent of ambient sounds represent key features of the approach. The availability of multiaxial information, including three-axis acceleration measurements, three-axis gyroscope data, and three-axis magnetometer information, suggests additional opportunities for these same platforms. Examples include quantitative measurements of neck movements (
TABLE-US-00001 TABLE 1 Comparisons with previous studies on the mechano-acoustic sensing method. Studies Liu et al. Lee et al. This invention Mechanics Soft, Soft, flexible Soft, flexible flexible/Thin Connectivity/ Wired/ Wireless BLE, Wireless Data Local PC Memory/ BLE, Memory/ management Local PC Processing on Cloud platform for vital signals with machine learning Sensors Single IMU Single IMU Dual IMUs + Temp Amplifier Features Conformability Placement Motion noise on skin (Suprasternal canceling notch) Core body temp. estimation Placement (Suprasternal notch + sternal manubrium ) Applications Seismo- Stagnant subject Ambulatory cardiography RR/HR subject RR/HR Electro- Swallow count Time-sync with cardiography Talking time multiple devices Speech Sleep study Spatio-temporal recognition mapping (3D-PTV) Monitoring of vital signs during daily activities, vigorous exercises, intense manual labor COVID-19 patient recovery monitoring Quantitative Only cycling Walking + running + comparison stationary jumping (36 min) bike (5 min) HR: mean difference HR: mean of 0.01 BPM difference Standard deviation of 3.1 BPM of 2.71 BPM Standard deviation RR: mean difference of 5.4 BPM of 0.27 RPM RR: mean difference Standard deviation of 0.3 RPM of 1.93 RPM Standard deviation of 2.5 RPM Ref. [35] [36] This device
[0264] The foregoing description of the exemplary embodiments of the invention has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teaching.
[0265] The embodiments were chosen and described in order to explain the principles of the invention and their practical application so as to enable others skilled in the art to utilize the invention and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its spirit and scope. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description and the exemplary embodiments described therein.
[0266] Some references, which may include patents, patent applications and various publications, are cited and discussed in the description of this invention. The citation and/or discussion of such references is provided merely to clarify the description of the present invention and is not an admission that any such reference is prior art to the invention described herein. All references cited and discussed in this specification are incorporated herein by reference in their entireties and to the same extent as if each reference was individually incorporated by reference.
REFERENCES
[0267] [1]. D.-H. Kim et al., Epidermal electronics. Science 333, 838-843 (2011). [0268] [2]. S. Kabiri Ameri et al., Graphene electronic tattoo sensors. ACS Nano 11, 7634-7641 (2017). [0269] [3]. A. Miyamoto, et al., Inflammation-free, gas-permeable, lightweight, stretchable on-skin electronics with nanomeshes. Nat. Nanotechnol. 12, 907-913 (2017). [0270] [4]. J. Byun et al., Electronic skins for soft, compact, reversible assembly of wirelessly activated fully soft robots. Sci. Robot. 3, eaas9020 (2018). [0271] [5]. S. Lee et al., Nanomesh pressure sensor for monitoring finger manipulation without sensory interference. Science 370, 966-970 (2020). [0272] [6]. W.-H. Yeo et al., Multifunctional epidermal electronics printed directly onto the skin. Adv. Mater. 25, 2773-2778 (2013). [0273] [7]. S. Xu et al., Soft microfluidic assemblies of sensors, circuits, and radios for the skin. Science 344, 70-74 (2014). [0274] [8]. S. Choi et al., Highly conductive, stretchable and biocompatible AgAu core-sheath nanowire composite for wearable and implantable bioelectronics. Nat. Nanotechnol. 13, 1048-1056 (2018). [0275] [9]. J. W. Ahn et al., A novel wearable EEG and ECG recording system for stress assessment. Sensors 19, 1991 (2019). [0276] [10]. H. Jeong et al., Modular and reconfigurable wireless E-tattoos for personalized sensing. Adv. Mater. Technol. 4, 1900117 (2019). [0277] [11]. H. U. Chung et al., Skin-interfaced biosensors for advanced wireless physiological monitoring in neonatal and pediatric intensive-care units. Nat. Med. 26, 418-429 (2020). [0278] [12]. T. Yokota et al., Ultraflexible organic photonic skin. Sci. Adv. 2, e1501856 (2016). [0279] [13]. T.-H. Kim et al., Fully stretchable optoelectronic sensors based on colloidal quantum dots for sensing photoplethysmographic signals. ACS Nano 11, 5992-6003 (2017). [0280] [14]. H. Jeong et al., in 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (IEEE, 2017), pp. 4094-4097. [0281] [15]. H. U. Chung et al., Binodal, wireless epidermal electronic systems with in-sensor analytics for neonatal intensive care. Science 363, eaau0780 (2019). [0282] [16]. L. Y. Chen et al., Continuous wireless pressure monitoring and mapping with ultra-small passive sensors for health monitoring and critical care. Nat. Commun. 5, 5028 (2014). [0283] [17]. N. Luo et al. et al., Flexible piezoresistive sensor patch enabling ultralow power cuffless blood pressure measurement. Adv. Funct. Mater. 26, 1178-1187 (2016). [0284] [18]. J. Kim et al., Soft wearable pressure sensors for beat-to-beat blood pressure monitoring. Adv. Healthc. Mater. 8, 1900109 (2019). [0285] [19]. M. Kaisti et al., Clinical assessment of a non-invasive wearable MEMS pressure sensor array for monitoring of arterial pulse waveform, heart rate and detection of atrial fibrillation. NPJ Digit. Med. 2, 39 (2019). [0286] [20]. H. Yao et al., Environment-resilient graphene vibrotactile sensitive sensors for machine intelligence. ACS Mater. Lett. 2, 986-992 (2020). [0287] [21]. D. J. Lipomi et al., Skin-like pressure and strain sensors based on transparent elastic films of carbon nanotubes. Nat. Nanotechnol. 6, 788-792 (2011). [0288] [22]. C.-S. Kim et al., Ballistocardiogram as proximal timing reference for pulse transit time measurement: Potential for cuffless blood pressure monitoring. IEEE Trans. Biomed. Eng. 62, 2657-2664 (2015). [0289] [23]. W. Gao et al., Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 529, 509-514 (2016). [0290] [24]. H. Lee et al., A graphene-based electrochemical device with thermoresponsive microneedles for diabetes monitoring and therapy. Nat. Nanotechnol. 11, 566-572 (2016). [0291] [25]. Y. Yamamoto et al., Printed multifunctional flexible device with an integrated motion sensor for health care monitoring. Sci. Adv. 2, e1601473 (2016). [0292] [26]. M. Bariya et al., Wearable sweat sensors. Nat. Electronics 1, 160-171 (2018). [0293] [27]. M. Elsherif et al., Wearable contact lens biosensors for continuous glucose monitoring using smartphones. ACS Nano 12, 5452-5462 (2018). [0294] [28]. J. Kim et al., Simultaneous monitoring of sweat and interstitial fluid using a single wearable biosensor platform. Adv. Sci. 5, 1800880 (2018). [0295] [29]. S. K. Ameri et al., Imperceptible electrooculography graphene sensor system for human-robot interface. NPJ 2D Mater. Appl. 2, 19 (2018). [0296] [30]. L. Dejace et al., Gallium-based thin films for wearable human motion sensors. Adv. Intell. Syst. 1, 1900079 (2019). [0297] [31]. L. Tian et al., Large-area MRI-compatible epidermal electronic interfaces for prosthetic control and cognitive monitoring. Nat. Biomed. Eng. 3, 194-205 (2019). [0298] [32]. M. Chu et al., Respiration rate and volume measurements using wearable strain sensors. NPJ Digit. Med. 2, 8 (2019). [0299] [33]. X.-R. Ding et al., Wearable sensing and telehealth technology with potential applications in the coronavirus pandemic. IEEE Rev. Biomed. Eng. 14, 48-70 (2020). [0300] [34]. S. Kim et al., Soft, skin-interfaced microfluidic systems with integrated immunoassays, fluorometric sensors, and impedance measurement capabilities. Proc. Natl. Acad. Sci. U.S.A. 117, 27906-27915 (2020). [0301] [35]. Y. Liu, et al., Epidermal mechano-acoustic sensing electronics for cardiovascular diagnostics and human-machine interfaces. Sci. Adv. 2, e1601185 (2016). [0302] [36]. K. Lee et al., Mechano-acoustic sensing of physiological processes and body motions via a soft wireless device placed at the suprasternal notch. Nat. Biomed. Eng. 4, 148-158 (2020). [0303] [37]. H. Jeong et al., Continuous on-body sensing for the COVID-19 pandemic: Gaps and opportunities. Sci. Adv. 6, eabd4794 (2020). [0304] [38]. M. J. Mathie et al., Accelerometry: Providing an integrated, practical method for long-term, ambulatory monitoring of human movement. Physiol. Meas. 25, R1-R20 (2004). [0305] [39]. F. Leito et al., High-resolution seismocardiogram acquisition and analysis system. Sensors 18, 3441 (2018). [0306] [40]. T. Ha et al., A chest-laminated ultrathin and stretchable e-tattoo for the measurement of electrocardiogram, seismocardiogram, and cardiac time intervals. Adv. Sci. 6, 1900290 (2019). [0307] [41]. A. Dragomir et al., Acoustic detection of coronary occlusions before and after stent placement using an electronic stethoscope. Entropy 18, 281 (2016). [0308] [42]. Y. Huang et al., Real-time intended knee joint motion prediction by deep-recurrent neural networks. IEEE Sensors J. 19, 11503-11509 (2019). [0309] [43]. C. Adans-Dester et al., Enabling precision rehabilitation interventions using wearable sensors and machine learning to track motor recovery. NPJ Digit. Med. 3, 121 (2020). [0310] [44]. CDC, Communities, Schools, Workplaces, & Events. Centers for Disease Control and Prevention (2020); www.cdc.gov/coronavirus/2019-ncov/community/clean-disinfect/index.html. [0311] [45]. O. Kimberger et al., Accuracy and precision of a novel non-invasive core thermometer. Br. J. Anaesth. 103, 226-231 (2009). [0312] [46]. O. Kimberger et al., The accuracy of a disposable noninvasive core thermometer. Can. J. Anesth. 60, 1190-1196 (2013). [0313] [47]. Y. Zhang et al., Theoretical and experimental studies of epidermal heat flux sensors for measurements of core body temperature. Adv. Healthc. Mater. 5, 119-127 (2016). [0314] [48]. J.-T. Kim, L. P. Chamorro, Lagrangian description of the unsteady flow induced by a single pulse of a jellyfish. Phys. Rev. Fluids 4, 064605 (2019). [0315] [49]. J.-T. Kim et al., On the dynamics of air bubbles in Rayleigh-Benard convection. J. Fluid Mech. 891, A7 (2020). [0316] [50]. I. Awolusi et al., Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices. Autom. Constr. 85, 96-106 (2018). [0317] [51]. E. J. Chow et al., Symptom screening at illness onset of health care personnel with SARS-CoV-2 infection in King County, Washington. JAMA 323, 2087-2089 (2020). [0318] [52]. K. Y. Chen, D. R. Bassett, The technology of accelerometry-based activity monitors: Current and future. Med. Sci. Sports Exerc. 37, S490-S500 (2005). [0319] [53]. S. Brage et al. et al., Estimation of free-living energy expenditure by heart rate and movement sensing: A doubly-labelled water study. PLOS ONE 10, e0137206 (2015). [0320] [54]. H.-Y. Wu et al., Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31, 1-8 (2012). [0321] [55]. P. S. L. Anderson et al., Taking a stab at quantifying the energetics of biological puncture. Integr. Comp. Biol. 59, 1586-1596 (2019). [0322] [56]. J.-T. Kim et al., Free fall of homogeneous and heterogeneous cones. Phys. Rev. Fluids 093801 (2020).