Sensing System and Method for Smart Rings Employing Sensor Spatial Diversity

Abstract

A ring for photoplethysmographic sensing performs transmissive PPG and/or reflective PPG. It can enable lower power consumption, higher fidelity, and/or greater versatility to different use cases and users' specificities. The PPG system takes advantage of sensor spatial diversity to enhance the quality and the reliability of the PPG measurements in smart rings, for example. It can also perform user identification.

Claims

1. A ring system, comprising sensors each performing photoplethysmographic sensing of a user's finger on which the ring system is worn.

2. A ring system, comprising sensors each performing reflective photoplethysmographic sensing of a user's finger on which the ring system is worn.

3. A ring system, comprising sensors for performing both transmissive and reflective photoplethysmographic sensing of a user's finger on which the ring system is worn; wherein the sensors each perform reflective photoplethysmographic sensing and transmissive photoplethysmographic sensing in conjunction with another one of the sensors.

4. The ring system according to claim 3, wherein the ring system performs user identification based on information from the photoplethysmographic sensing.

5. The ring system according to claim 3, comprising at least 4 of the sensors.

6. The ring system according to claim 3, comprising 8 or more of the sensors.

7. The ring system according to claim 3, wherein each of the sensors comprise photodiodes and light emitters.

8. The ring system according to claim 3, wherein each of the sensors comprises a two dimensional array of photodiodes and light emitters.

9. The ring system according to claim 3, wherein the sensors comprise an annular photodiode array and an annular light emitter array.

10. The ring system according to claim 9, wherein the light emitters are organic light emitting diodes and the photo diode array are organic photodiodes.

11. The ring system according to claim 3, further comprising a control unit for triggering the different sensors to perform reflective photoplethysmographic sensing and transmissive photoplethysmographic sensing.

12. The ring system according to claim 11, wherein the control unit uses results from the transmissive photoplethysmographic to validate the reflective photoplethysmographic sensing.

13. The ring system according to claim 11, wherein the control unit uses results from the transmissive photoplethysmographic to determine which of the sensors to use for ongoing reflective photoplethysmographic sensing.

14. The ring system according to claim 3, wherein the control unit uses the sensors around the ring to track arterial and/or venous patterns.

15. The ring system according to claim 3, further comprising a sensor block having inertial sensors.

16. The ring system according to claim 3, further comprising a sensor block with a user temperature sensor and an ambient temperature sensor.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In the accompanying drawings, reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale; emphasis has instead been placed upon illustrating the principles of the invention. Of the drawings:

[0028] FIG. 1 is a side cross-sectional view perpendicular to the axis of a sensor ring system, according to the invention;

[0029] FIG. 2 is a side cross-sectional view perpendicular to the axis of a sensor ring system, according to a second embodiment of the invention;

[0030] FIG. 3 is a schematic plan view of a PPG sensor 200;

[0031] FIG. 4 is a side cross-sectional view perpendicular to the axis of a sensor ring system, according to a third embodiment of the invention;

[0032] FIG. 5 is partial view looking outward along a radius of the sensor ring of the third embodiment showing the PPG sensor subsystem PPGR on the ring's PCB;

[0033] FIG. 6 is a flow diagram showing the operation of the control unit;

[0034] FIGS. 7A, 7B, and 7C are schematic views showing the transmissive PPG readings between the different sensor units;

[0035] FIG. 8 is a schematic view showing a comprehensive set of transmissive PPG readings between sensor units in both directions;

[0036] FIG. 9 is a schematic view of user identification; and

[0037] FIG. 10 shows signal analysis employed for user identification by the control unit.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] The invention now will be described more fully hereinafter with reference to the accompanying drawings, in which illustrative embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

[0039] As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Also, all conjunctions used are to be understood in the most inclusive sense possible. Thus, the word “or” should be understood as having the definition of a logical “or” rather than that of a logical “exclusive or” unless the context clearly necessitates otherwise. Further, the singular forms and the articles “a”, “an” and “the” are intended to include the plural forms as well, unless expressly stated otherwise. It will be further understood that the terms: includes, comprises, including and/or comprising, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Further, it will be understood that when an element, including component or subsystem, is referred to and/or shown as being connected or coupled to another element, it can be directly connected or coupled to the other element or intervening elements may be present.

[0040] It will be understood that although terms such as “first” and “second” are used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. Thus, an element discussed below could be termed a second element, and similarly, a second element may be termed a first element without departing from the teachings of the present invention.

[0041] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0042] FIG. 1 shows a first embodiment of the sensor ring system 100.

[0043] In general, the sensor ring includes a ring or annual-shaped ring body 110 having an inner bore 110I sized to receive a human digit such as a finger, and specifically an index finger, middle finger, ring finger, or little finger or pinkie. The ring body 110 is typically a molded plastic or ceramic material, but could also be metal.

[0044] An array of PPG sensor units 200-1 to 200-8 are distributed around the inner bore and directed inwardly in order to perform PPG sensing of the digit inserted into the inner bore 110I. In the illustrated example, the sensor units 200-1 to 200-8 are evenly arrayed in a concentric ring.

[0045] A control unit CU is installed on a ring-shaped, concentric printed circuit board PCB. The control unit CU controls the triggering of and readout from the PPG sensors 200. In one mode of operation, the control unit CU alternates between a transmissive PPG mode and reflective PPG mode. The control unit CU preferably includes a Bluetooth-low-energy communications block BLE and a power management block PM, for communicating data with the external world and regulating system power, respectively.

[0046] The control unit CU stores sensor readings to a memory unit M, which also contains the operating instructions for the system set-up and other firmware components required for operation.

[0047] A battery B provides power to the system via the PCB, and is generally controlled by the power management unit PM in order to provide for extended operation.

[0048] A sensor block S has inertial sensors, including a three axis accelerometer and a three axis gyroscope. In some cases, the accelerometer and the gyroscope each have more than three axes, possibly six axes. In addition, the sensor block S also preferably has a user temperature sensor and an ambient temperature sensor, for separate body and environmental temperature detection.

[0049] A smart user interface block SUI provides active feedback from the device to the user and also receives user control input. In some examples, the SUI block includes a visible LED array and a touch sensor system, such as a capacitive touch sensor array.

[0050] FIG. 2 shows a second embodiment of the sensor ring system 100. This uses a series of small independent PCBs PCB1-PCB10 for each of the sensor units 200, the battery B, the memory and smart user interface block SUI, the control unit CU, and sensor block S. Each of these PCBs are interconnected with wiring harnesses WH in a daisy-chained fashion.

[0051] In still other examples, the independent PCBs are replaced with one or more flexible PCBs. In both cases, flexible PCBs can be used to allow a better integration into the system.

[0052] FIG. 3 shows an exemplary configuration for the PPG sensors 200.

[0053] In a typical implementation, each PPG sensor 200 includes at least one and preferably multiple photodiodes. In one example, an array of at least 8 by 8 photodiodes PDA is provided on a submount SM.

[0054] Each sensor 200 also preferably includes one or more light emitters such as LEDs or vertical cavity surface emitting lasers (VCSELs) installed on the submount SM, next to the photodiode array PDA. Moreover, the light emitters can operate at different wavelengths. In the illustrated example, two LEDs LED1 and LED2 are provided on the submount SM that emit at different wavelength in the visible and/or infrared.

[0055] In a current example, to reduce the PPG sensor size, the PPG readout electronics is embedded into the array of photo diodes PDA.

[0056] FIG. 4 shows a third embodiment of the sensor ring system 100.

[0057] This example includes a flexible and/or circular PCB, supporting an annular PPG sensor subsystem PPGR that follows the curvature of the ring's inner bore 110I.

[0058] As shown in FIG. 5, the PPG sensor subsystem PPGR includes a circular and curved, annular, photodiode array PDA and a circular and curved, annular, LED array LDA on the inner bore 110I of the ring system. The photodiode array PDA and the LED array LDA are directed inward toward the axis of the ring and arranged next to each other along the axial direction of the ring system 100.

[0059] To achieve a truly curved optoelectronic design, some embodiments use flexible organic photodiodes in the photodiode array PDA and organic LEDs (OLEDs) in the laser diode array LDA. Indeed, today's organic optoelectronics elements provide performance closer and closer to silicon ones, with the advantage of more versality, reduced power consumption and lower costs.

[0060] FIG. 6 is a flow diagram showing one method of operation of the ring system 100. This enables the control unit CU to optimize the PPG signal quality and light source power consumption.

[0061] In more detail, in step 210, once the ring system 100 is correctly worn as determined by the control unit CU, it triggers all the PPG sensors 210 consecutively in reflective mode. That is, each sensor's light emitters are activated while performing PPG sensing with the sensor's photodiodes.

[0062] Then, in step 212, the control unit calculates the perfusion index (PI) and the signal-to-noise ratio (SNR) of the PPG signals for each PPG sensor 200 and the best channel or PPG sensor 200 with the best PI and SNR is stored kept in the memory M. The control unit CU also stores in memory the set-up, per each reflective PPG channel, allowing the best signal quality, namely, but not limited to, the LED driving current, sampling frequency, PPG sensor integration time, gain and resolution.

[0063] If more than one PPG sensor 200 provides good PI and SNR, then more than one PPG reflective channel is stored with the corresponding set-up. The response of these multiple good PPG sensors can then be voted or fused to enhance the quality of the readings.

[0064] From the chosen channel or combination of channels, the signal vitals, including—but not limited to—the heart rate HR and the blood oxygen saturation SpO2 based on the reflective mode SPO2_r, are computed by the control unit CU in step 214 as part of the PPG sensing. In the case of a combination of channels, the vitals can be fused or voted from each independent channel.

[0065] Then, for the transmissive mode SpO2, the control unit CU triggers, with a given repetition frequency, three transmissive PPG recordings in step 216. In other examples, more than three transmissive PPG recordings is performed such as six or 16 or more with the eight sensor unit arrangement shown.

[0066] FIGS. 7A, 7B, 7C are schematic illustrations showing several transmissive PPG sensing operations, namely south-north (SN), south-east (SE) and south-west (SW).

[0067] In some examples, transmissive PPG sampling operations are performed between every pair of sensors 200 in both directions for each pair.

[0068] Returning to FIG. 6, the SpO2 is computed out of each of the transmissive PPG channels in step 218. The three channels are fused or voted, and the final value is kept in memory, as a calibration value, namely SpO2_t.

[0069] If the three transmissive PPG channels fail to provide a reference value, for instance in the case the fusion or the voting is impossible because of too much discrepancy between them, then step 216 is repeated in the opposite lighting direction, namely north-south (NS), north-east (NE) and north-west (NW), in one example.

[0070] In step 220, the SpO2 value computed from the reflective channel as in step 214, namely SpO2_r, is compared with the calibration value, i.e. SpO2_t, out of the transmissive channel. It is then determined if the two SpO2 values, i.e. SpO2_t and SpO2_r, are within a given range difference.

[0071] If SpO2_t and SpO2_r are within the range difference, then the reflective channel (or combination of channels) is kept in step 222.

[0072] On the other hand, motion artefacts are detected, by the means of the sensor S, the control unit CU reacts by increasing the repetition frequency, resulting into more frequent checks versus the calibration value.

[0073] The smart ring can also be operated in transmissive mode only. In this case the control unit CU operates the ring and the PPG sensors in the following way.

[0074] At a given repetition frequency, three transmissive PPG recordings are triggered, namely south-north (SN), south-east (SE) and south-west (SW).

[0075] Then, the SpO2 is computed out of each of the transmissive PPG channels. The three channels are fused or voted, and the final value is kept in memory, as the reference value, namely SpO2.

[0076] If the three transmissive PPG channels fail to provide a reference value, for instance in the case the fusion or the voting is impossible because of too much discrepancy between them, then the step is repeated in the opposite lighting direction, namely north-south (NS), north-east (NE) and north-west (NW), as in FIG. 8.

[0077] The user interface SUI block allows the exchange of information between the user and the device. On one hand, the SUI, by the means of the integrated LED, provides optical feedback to the user, for instance, if the device is used for fitness purposes. The LED can shine in green, orange, and red depending on the cardiac zones of the user. At the same time, the user can, by the means of the integrated touch sensor, trigger a particular training function or a meditative phase.

[0078] FIG. 9 shows how the spatial distribution of the PPG sensors around the ring allows tracking of the user's venous pattern, very similar to what conceptually can be done by an iris scanner. Indeed, the control unit CU analyzes for each n reflective path the type of corresponding PPG signal. In addition, each transmissive path is also assessed in some examples. By fusing these signals and the corresponding information, the arterial and/or venous pattern is deduced by the control unit CU, indirectly, without the need of further hardware.

[0079] Unlike a standard venous recognition system which utilizes IR-based cameras, the present embodiment utilizes the generated PPG signals out of the reflective based PPG sensors. All the n PPG signals are detected out of the n PPG sensors. The n PPG signals are fed to the control unit CU which has stored in memory the expected user's venous pattern under the form of PPG temporal and spatial features.

[0080] FIG. 10 shows the spatial features.

[0081] In addition to the above-mentioned figure, the PPG PI and SNR are also used, since a larger SNR or a larger PI result from a richer venous/arterial distribution. The spherical distribution of the PPG sensors allows the PPG signals to integrate the maximum possible signal features a, b, c, d, e leading to more robust identification. If an identification by means of this manner is not possible, then the user interface SUI, which is equipped with a touch sensor, is used in this regard, by analyzing the fingerprint of another finger.

[0082] The sensor block S integrates a temperature sensor which analyzes the ambient and the finger temperature. This is used for two main reasons: accounting for the vasodilation and vasoconstriction in the identification process. Indeed, both can temporarily bias the venous pattern, so the temperature information helps the control unit CU calibrating the identification in the best way.

[0083] Providing continuous temperature readings of the user and its environment helps scout diseases like covid-19, on one hand, and on the other hand, enhances quality of life and sleep.

[0084] Integrating a plurality of PPG sensors onto a ring system comes with the advantage of creating a sensing platform tailored to the user's biomedical specificities. In essence, each user has his/her own arterial pattern, and this must be considered to reduce the system power consumption and enhance signal quality. Very often wearable devices, including smart rings, lack this functionality and this results in using more power to chase good biometric signals, eventually limiting their use cases and the user's experience. In addition, the spatial distribution of the PPG sensors allows one device to be used in both reflective and transmissive modes, expanding the possible use cases beyond wellness/lifestyle.

[0085] Moreover, the present embodiments do not need user intervention to find a good sensing spot in the ring. Indeed, spatial diversity guarantees a scanning of the finger itself resulting in a user specific configuration. This is particularly important at night, since smart rings tend to move around the finger without any action from the user, which can lead to losing a good sensing spot.

[0086] The plurality of PPG sensors can also be used for identification purposes, since, by means of some features analysis, the PPG signals can be used for deducing the user's arterial/venous pattern.

[0087] The obvious industrial applications relate to the growing business of smart rings. This is an emerging market which is just showing a small fraction of its future potential. This is particularly true in regard to the growing use of devices for monitoring sleep and covid-19 outbreaks. The proposed embodiment and method are particularly interesting in this regard, due to the challenges resulting from effectively measuring a PPG signal in the finger for very different use cases. In addition, using the device for identification purposes can expand the market share of a device like this in contrast to more mature wearables, like smartwatches, which benefit from huge market penetration.

[0088] While this invention has been particularly shown and described with references to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.