Health monitoring device including pinned photodiode
11612330 · 2023-03-28
Assignee
Inventors
- Assim Boukhayma (Neuchâtel, CH)
- Antonino Caizzone (Milvignes, CH)
- Christian Enz (Saint-Aubin-Sauges, CH)
Cpc classification
A61B2562/12
HUMAN NECESSITIES
H04N25/00
ELECTRICITY
A61B5/0295
HUMAN NECESSITIES
A61B5/7246
HUMAN NECESSITIES
A61B2560/0247
HUMAN NECESSITIES
A61B2562/0233
HUMAN NECESSITIES
A61B5/7225
HUMAN NECESSITIES
H04N25/77
ELECTRICITY
H01L27/14
ELECTRICITY
International classification
Abstract
The invention relates to a photoplethysmography (PPG) sensing device comprising —a pulsed light source, —at least one pixel to create photo-generated electrons, synchronized with said pulsed light source. It is mainly characterized in that each pixel comprises: —a pinned photodiode (PPD) having two electronic connection nodes, —a sense node (SN), to convert the photo-generated electrons into a voltage, and —a Transfer Gate (TGtransfer) transistor, having its source electronically connected to one electronic connection node of said pinned photodiode (PPD), and being configured to act as a transfer gate (TG) between said pinned photodiode (PPD) and said sense node (SN), allowing the photo-generated electrons to sink when the light is pulsed-off, the photo-generated electrons integration when the light is pulsed-on and the transfer of at least part of the integrated photo-generated electrons to said sense node for a read-out.
Claims
1. A photoplethysmography (PPG) sensing device, configured to output a signal comprising a DC component and an AC component, said device comprising: a pulsed light source, adapted to be pulsed-on or pulsed-off, at least one pixel for light-to-charge conversion to create photo-generated electrons, each pixel being synchronized with said pulsed light source, characterized in that each pixel comprises: a pinned photodiode comprising a well and having two electronic connection nodes, a sense node, said sense node being a junction capacitance whose role is to convert the photo-generated electrons in the pinned photodiode well into a voltage, by the means of the conversion gain of said capacitance, and a Transfer Gate (TGtransfer) transistor, having its source electronically connected to one electronic connection node of said pinned photodiode, and being configured to act as a transfer gate between said pinned photodiode and said sense node, allowing the photo-generated electrons to sink when the light is pulsed-off, the photo-generated electrons integration when the light is pulsed-on and the transfer of at least part of the integrated photo-generated electrons to said sense node for a read-out.
2. The photoplethysmography (PPG) sensing device according to claim 1, wherein each pixel further comprises: a Sink (TGsink) transistor, having its source electronically connected to said pinned photodiode, and being configured to act as a transfer gate between said pinned photodiode and either a constant DC power source or a capacitance, allowing the photo-generated electrons to sink towards said constant DC power source or said capacitance when the light is pulsed-off and the photo-generated electrons integration when the light is pulsed-on.
3. The photoplethysmography (PPG) sensing device according to claim 2, wherein each of said pixels comprises at least one further pinned photodiode, arranged in parallel with said pinned photodiode and connected to said sense node by means of a respective Transfer Gate (TGtransfer) transistor, each of said Transfer Gate (TGtransfer) transistors being configured to be operated synchronously.
4. The photoplethysmography (PPG) sensing device according to claim 3, wherein each of said further pinned photodiodes is connected to said constant DC power source or said capacitance, as appropriate, by means of a respective Sink (TGsink) transistor, the gate of each of said Sink (TGsink) transistors being configured to be operated synchronously.
5. The photoplethysmography (PPG) sensing device according to claim 1, comprising a plurality of said pixels, wherein said pixels are disposed as an array.
6. The photoplethysmography (PPG) sensing device according to claim 5, further comprising a processor configured to average spatially outputs of the pixels.
7. The photoplethysmography (PPG) sensing device according to claim 1, further comprising: A first block (CDS1) comprising: a capacitance to store a value of the output signal of the photoplethysmography sensing device, when the pulsed light source is off and the sense node (SN) well is empty, and a capacitance to store a value of the output signal of the photoplethysmography (PPG) sensing device, when the pulsed light source is off, and the photoplethysmography (PPG) sensing device is just subject to ambient light, and to store a value of the output signal of the photoplethysmography (PPG) sensing device when the pulsed light source is on.
8. The photoplethysmography (PPG) sensing device according to claim 1, comprising a block comprising: a capacitance to store a first value of the output signal of the photoplethysmography (PPG) sensing device, when the pulsed light source is on during a first pulse and the sense node well has been allowed to integrate for a predetermined time period, and a capacitance to store a second value of the output signal of the photoplethysmography (PPG) sensing device when the pulsed light source is on during a second pulse, and the sense node well has been allowed to integrate for a predetermined time period.
9. The photoplethysmography (PPG) sensing device according to claim 1, comprising a block (CDS) comprising: a capacitance to store a value of the output signal of the photoplethysmography (PPG) sensing device, when the pulsed light source is off and the sense node well has been allowed to integrate for a predetermined time period, and a capacitance to store a value of the output signal of the photoplethysmography (PPG) sensing device when the pulsed light source is on, and the sense node well has been allowed to integrate for a predetermined time period.
10. The photoplethysmography (PPG) sensing device according to claim 1, wherein said sensing device is built in CMOS technology, and wherein each pixel is embedded in a system on chip.
11. The method of operating a photoplethysmography (PPG) sensing device, comprising: pulsing a light source, adapted to be pulsed-on or pulsed-off; detecting light from the light source with a pinned photodiode for light-to-charge conversion to create photo-generated electrons; in a transfer phase, setting a Transfer Gate voltage of a transfer gate transistor to a value between a well potential of the pinned photodiode and a voltage applied to a Sink transistor to allow only photo-generated electrons exceeding an offset to be transferred to a sense node for read-out.
12. A method according to claim 11 wherein the Transfer Gate voltage is dynamically adapted.
13. A method according to claim 11 comprising a calibration step comprising: A. setting the value of a DC power source to a predetermined value, B. checking if a pixel response exceeds a predetermined threshold value, and C. if the pixel response exceeds the said threshold value, repeating steps A and B until the corresponding pixel response is no longer exceeding the threshold.
14. The method according to claim 11, comprising the steps of: pulsing-off the light source, and integrating charge in said pinned photodiode during a predetermined period of time; transferring said charge to said sense node by means of said transfer gate and storing said charge in a first capacitor so as to generate a voltage corresponding to ambient light; then pulsing-on the light source for at least said predetermined period of time, integrating charge in said pinned photodiode during said predetermined period of time; transferring said charge to said sense node by means of said transfer gate and storing said charge in a second capacitor so as to generate a voltage corresponding to ambient light mixed with the pulsed light source; then subtracting the voltage corresponding to the ambient light from the voltage corresponding to the pulsing-on of the pulsed light source mixed with the ambient light to result in a voltage corresponding to a function of the detected light originating from the pulsed light source exclusively.
15. The method according to claim 11, comprising: pulsing-on a pulsed light source, integrating charge in said pinned photodiode during a predetermined period of time; transferring said charge to said sense node by means of said transfer gate transistor and storing said charge in a first capacitor so as to generate a voltage corresponding to the ambient light mixed with the light source; then pulsing-off the light source, and integrating charge in said pinned photodiode during said predetermined period of time; transferring said charge to said sense node by means of said transfer gate transistor and storing said charge in a second capacitor so as to generate a voltage corresponding to ambient light; then subtracting the voltage corresponding to the ambient light from the voltage corresponding to the pulsing-on of the light source mixed with the ambient light to result in a voltage corresponding to a function of the detected light originating from the pulsed light source exclusively.
16. The method according to claim 11, comprising: pulsing-on the light source, integrating charge in said pinned photodiode during a predetermined period of time; transferring said charge to said sense node by means of said transfer gate and storing said charge in a first capacitor so as to generate a voltage corresponding to the ambient light mixed with the light source; then pulsing-on again the light source, and integrating charge in said pinned photodiode during said predetermined period of time; transferring said charge to said sense node by means of said transfer gate and storing said charge in a second capacitor so as to generate a voltage corresponding to ambient light mixed with the second sample of pulsed light source.
17. The method according to claim 11, comprising: pulsing-off a pulsed light source, integrating charge in said pinned photodiode during a predetermined period of time; transferring said charge to said sense node by means of said transfer gate transistor and storing said charge in a first capacitor so as to generate a voltage corresponding to the ambient light mixed with the reset voltage; then pulsing-on the pulsed light source, and integrating charge in said pinned photodiode during said predetermined period of time.
18. The method according to claim 11, wherein said photoplethysmography (PPG) sensing device comprises a plurality of pixels, said method further comprising a step of averaging spatially the outputs of each pixel.
19. The method according to claim 18 where the averaging of the pixels is performed in a passive switched-capacitor fashion through the connection of a plurality of capacitors leading to an electronic buffer.
Description
DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
DETAILED DESCRIPTION
(21) In the foregoing description and in the figures, whenever a switch is mentioned or illustrated, it typically is implemented as a transistor such as a FET, MOSFET or similar.
(22) PPD Photo-Generated Current
(23)
(24) This photo-generated current comprises mostly a large direct current (DC) component, due to the combined action of the tissue (DC tissue), the venous blood layer (DC ven.) and the non-pulsatile arterial blood layer absorption (DC art.). Just a small amount of this photo-generated current (
(25) Typically, depending on the LED wavelength, the total DC component (DC tissue+DC ven.+DC art. with reference to
(26) Such a discrepancy in values gives rise to: either tough design and filtering stratagems with the aim of amplifying the tiny AC component and reducing in parallel the DC component; or processing in the digital domain, at the price of Analog-to-Digital Converters (ADCs), needing large bit resolution, large power consumption and more silicon area, or weak signal-to-noise (SNR) and bad performances.
(27) Indeed for PPG applications, the AC is the component of the photo-generated current which is needed to enable health monitoring. For instance, the AC component comes out of the pulsation of the blood in the arteries and is used to determine the heart rate by measuring the distance between two consecutive AC peaks. It is also used to determine the oxygen saturation level, said level being proportional to the logarithmic ratio between the absolute maximum and the absolute minimum value of the full photo-generated signal.
(28) One of the challenges of a PPG signal relates to its dynamic range (DR), which is the ratio between the largest and the smallest values that said signal can assume.
(29) Different solutions, each with a corresponding electronic circuit, exist but none of them is satisfactory enough.
(30) For instance: a first solution, based on a logarithmic transimpedance photoreceptor, has bandwidth that changes linearly with the light intensity, which is an undesirable property. For instance, a same image sensor would give different results depending on the skin pigmentation of the user; an improved solution of the first solution leads to interesting results but at a price of an overall power consumption which is quite high (about 4.5 mW) and an analog circuit which is quite complex; another solution, based on a forward-path and a feedback-path reached a sub-mW power consumption, where instead of measuring the DC component and the AC component of the photocurrent, the feedback-path sets the DC photocurrent to a desired value, called reference current, which is the same for both the visible and IR channels. Such a solution allows for the removal of the DC in a quite easy way but at a price of a complex electronic circuit and a control loop where any layout mismatch or simply charge injection errors may result into a large offset errors; another solution demonstrates that converting to digital the DC component of the PPG signal can resolve into the saturation of the ADC resolution. This suggests, in order to exploit the ADC full dynamic range, eliminating the DC before the ADC conversion and adding it back to the AC component afterwards, in the digital domain. But such a solution may lead to weak SNR and bad performances; another solution based on an Error Amplifier also uses a feedback loop which controls the photoreceptor, but the efficiency of such technique gets weaker as the DC current gets smaller; another solution is based on a Dynamic-Range Enhancer technique but also faces issues such as more complexity (additional blocks), lower speed and larger power.
(31) To address this, the present invention proposes a new photonic sensing technology to read-out a PPG signal, especially by means of a system-on-chip (SOC) which can be fabricated in a standard CMOS technology, and having low-noise and low-power signal processing chain, a higher sensitivity and a reliable measurement at lower light levels from the LEDs.
(32) The proposed solution, based on a PPG sensor comprising at least a pinned photodiode (PPD) instead of conventional single PD, enables to remove most of the DC component of a PPG signal as explained here after. The use of a PPD rather than a convention PN or PIN photodiode enables elimination of the DC component of the signal without complex and power-hungry circuitry, signal processing or similar, by exploiting the unique properties of PPD's which are not exhibited by PN or PIN photodiodes.
(33) PPD Based Image Sensor
(34) A first embodiment relates to a single transfer gate pixel arrangement.
(35) A PPD comprises a p+-n-p junction (n-p junction buried under a shallow highly doped p+), as shown in
(36) According to this first embodiment, a PPD is electronically connected to the source of a transistor, called Transfer Gate transistor, or TGtransfer transistor, which acts as a transfer gate (TG) between said PPD and a Sense Node, described later. As can be seen from
(37) The grid of the TGtransfer transistor is electronically connected to a DC power source called V_TGtransfer, of which the value can be dynamically adapted.
(38) The TGtransfer transistor is used to control the potential barrier at one edge of the PPD, the other edge being electronically connected to the ground (
(39) Adjusting the TG potential thanks to the TGtransfer transistor enables adjusting a DC Offset (
(40) With reference to
(41) When this potential barrier surrounding the PPD, is lower than the well potential V.sub.well of the PPD, the photogenerated electrons are kept within that well. Typically, the potential barrier surrounding the PPD is kept at a slightly negative value by means of the TGtransfer transistor, at least in the integration phase described here under.
(42) The other side of the TGtransfer transistor, in this case the drain, is electronically connected to a Sense Node (SN), see
(43) As illustrated in
(44) Switch S1 on
(45) Operating the pixel of
(46) In an integration phase: the PPD is illuminated with ambient light (if present) and LEDs light, V_TGtransfer is set to low voltage to close the TGtransfer transistor and to create a barrier of potential, S1 is open.
(47) The potential barrier surrounding the PPD is kept lower than the well potential V.sub.well of the PPD. Accordingly the PPD generates photo-generated electrons, which are kept and accumulated within the PPD well.
(48) Preferably the LEDs emit synchronously (in phase). This way, the LEDs consume power only when really needed. The integration phase typically lasts a hundreds of ns to several microseconds, i.e. from about 200 ns to 3 μs, preferably from 300 ns to 2 μs. Such a low integration time is possible thanks to the complete decoupling between the electronic readout chain and the PPD. In a standard PPG sensor based on a conventional PN or PIN photodiode, such a small integration time would require a much faster readout circuitry and hence much more power consumption. Note that a typical pulse time in state of the art commercially available products is 400 μs.
(49) Successively to the integration phase, in a reset phase: Preferably LEDS are off, which saves power, but is not essential V_TGtransfer is kept to a low voltage, S1 switch is closed.
(50) This way, the voltage of the sense node SN is increased and set to V_reset value, draining all electrons (if any) within the SN well to the V_reset DC power source, but photo-generated electrons are still kept within the PPD well during the reset phase. Then the reset switch S1 is opened for a predetermined period of time, determined in an ad-hoc manner.
(51) This enables the SN node to act as a capacitance as mentioned above, thus capable of storing photo-generated electrons that will be transferred in the transfer phase.
(52) Successively to the reset phase, in a transfer phase, Preferably LEDS are off, but this is not essential, V_TGtransfer is increased, S1 switch is kept open.
(53) In the transfer phase, the TG potential is increased to a value comprised between the well potential V_well of the PPD and V_reset.
(54) This way, the photo-generated electrons (e−) filling the PPD well diffuse to the SN through the transfer gate TG.
(55) This charge diffusion causes the potential of the SN to drop from the reset level V_reset to a V_transfer value, said V_transfer value being proportional to the number of transferred charges, that is to the number of photons which reached the PPD.
(56) Preferably, the transfer phase does not last more than a 1 μs.
(57) Successively to the transfer phase, in a readout phase: V_TGtransfer is set to its low voltage of the integration phase, S1 switch is kept open.
(58) The value of the voltage at the sense node is proportional to the number of electrons sunk from the PPD, that is to say the number of photon which reached the PPD.
(59) A second embodiment relates to a dual transfer gates pixel arrangement.
(60) Further to the first embodiment, it is proposed here a pixel arrangement where, instead of having the PPD electronically connected to the TGtransfer transistor and the ground like in the previous embodiment, at each pixel level, the PPD is electronically connected between the TGtransfer transistor and another transistor, called TGsink transistor, that is to say two transfer gates TGt and TGs corresponding to TGtransfer transistor and TGsink transistor respectively. This is illustrated in
(61) To this effect, the TGsink transistor works the same way as the TGtransfer transistor works: depending on the value of the voltage V_TGsink applied to the grid of the TGsink transistor, with regard to the value of the voltage V_TGtransfer applied to the grid of the TGtransfer transistor, it is possible to modify the potential barrier surrounding the PPD, meaning transferring electrons from the PPD well through the TGtransfer transistor for sensing or through the TGsink transistor for sinking to V.sub.DD. Both transistors TGtransfer and TGsink are independent, although both are arranged to be able to sink charge from the PPD.
(62)
(63) In this embodiment, the PPD electrons can be transferred either to one side of the PPD to the Sink Node through the TGsink transistor in a sink phase, or to the Sense Node SN on the other side of the PPD through the TGtransfer transistor in a transfer phase.
(64)
(65) In the sink phase: The LEDs are preferably off, V_TGsink is set to a high voltage applied to the grid of TGsink transistor, The drain of TGsink transistor is connected to a constant DC power source, e.g. V_reset (illustrated on
(66) V_TG transfer is lower than V_well which is lower than V_TGsink. Accordingly, photo-generated electrons that were within the PPD well cannot go through the TGtransfer transistor and can only go through the TGsink transistor.
(67) Electrons of the PPD well go through the TGsink transistor, e.g. to a constant voltage DC power source. In such a case, because the drain of the TGsink transistor is connected to a constant voltage and not to a capacitor, when proper voltage V_TGsink is applied to the gate of the TGsink transistor, all the electrons of the PPD well are lost.
(68) Accordingly, none of these electrons reaches the acquisition chain (which is located downstream of the Sense Node through the TGtransfer transistor). Accordingly, ambient light does not alter the sensing, the PPD well is emptied.
(69) In the integration phase, similar to the integration phase of the first embodiment: The LEDs are on, V_TGsink is set to low voltage to close the TGsink transistor and to create a barrier of potential. Preferably V_TGsink is lower than or equal to V_TGtransfer such that no photo-generated electrons can overflow through TGsink transistor, V_TGtransfer is kept at a low voltage.
(70) The potential barrier surrounding the PPD is kept lower than the well potential V.sub.well of the PPD. Accordingly the PPD generates photo-generated electrons, which are kept within the PPD well.
(71) However, most of the integrated signal contains a DC component. Transferring a small fraction of the signal exceeding a predetermined threshold (offset) enables the readout performed after the sense node to subtract said offset from said DC component.
(72) In the reset phase: Preferably LEDS are off, V_SN is set to V_reset.
(73) This way, the voltage of the sense node SN is increased and set to V_reset value, draining all electrons (if any) within the SN well to the V_reset DC power source, but photo-generated electrons are still kept within the PPD well during the reset phase. Then the reset switch S1 is opened for a predetermined period of time, as required.
(74) This enables the SN node to act as a capacitance, thus capable of storing photo-generated electrons that will be transferred in the transfer phase.
(75) In the transfer phase, The LEDs are preferably off to save power, TGsink potential (TGs) is maintained, TGtransfer (TGt) potential is increased to a value comprised between the well potential V_well of the PPD and V_TGsink.
(76) This way, the photo-generated electrons (e−) filling the PPD well diffuse to the SN through the transfer gate TGt of the TGtransfer transistor, setting the sense node SN to a V_transfer voltage value.
(77) The difference between V_well and V_TGtransfer is the offset (or V_offset) which corresponds to the DC component which is removed from the signal at the pixel level. It should be noted that the minimum value of V_offset can be zero, although it is typically a larger value.
(78) In the readout phase, The LEDs are preferably off, again to save power.
(79) Photo-generated electrons (e−) on the sense node SN side are read; and photo-generated electrons within the PPD are kept within its potential well.
(80) After the readout of the sense node voltage, the latter can be reset again and a new loop starting from the sink phase can be implemented.
(81) The n layer of a PPD device is a kind of well: once the well is fully filled, because of the barrier of potential on the TGsink transistor side, the additional photo-generated electrons overflow to the SN depletion through the TGtransfer transistor.
(82) Thanks to the V_TGtransfer dynamic value, only the photo-generated electrons overflowing the offset to the SN depletion will be read, and if the V_TGtransfer is set appropriately, this results in only the AC component of the signal (see
(83) The barrier of potential level chosen depends on the ambient light and the AC/DC ratio of the PPG signal in a calibration phase, as will be made clear below.
(84) Typically, this calibration phase comprises setting the V_TGtransfer to a predetermined value then checking if the corresponding pixel is saturated. If the pixel response is saturated, then a loop comprising increasing said predetermined value of V_TGtransfer by a predetermined pitch (i.e. amount) is performed until the pixel response is no longer saturated.
(85) For instance, the calibration phase enables a same device to be used on different users having different skin pigmentations.
(86) After a calibration phase, it is possible to set a predetermined offset level, corresponding to a predetermined amount of the DC which does not overflow through the TGtransfer transistor, by setting a corresponding predetermined value to V_TGtransfer.
(87) For instance, in the calibration phase it is possible to measure the grand total comprising the DC component+the AC component of the signal. It is known that the AC component represents a few percent of such signal. Accordingly, it is possible to set V_TGtransfer such that the predetermined offset level equals 90% of the signal. Reducing the offset by 90% DC enhances the AC/DC ratio by one order of magnitude, leading to less strict dynamic range constraints at the input. In fact, it should be noted that in PPG measurement, PPG signal typically has a very high DC/AC ratio of 20 to e.g. 500, which is not addressable with classical image sensing solutions.
(88) This embodiment further reduces the DC component of the PPD signal; it thus behaves as a DC remover or as a DR enhancer. This comes without extra cost on power and circuit complexity. Such system does this at the earliest stage of the read-out chain without any additional circuitry.
(89) Advantageously, V_TGtransfer is part of an analog device. Accordingly, it is possible to adjust precisely the level of the potential barrier, i.e. the level of the electrons remaining in the PPD vs. the number of the exceeding electrons being transferred to the sense node (overflow). Such adaptation of the potential barrier level can be done in real time.
(90) Adjusting the value of V_TGtransfer enables adjusting the value of a predetermined part of the DC which is not sensed, which in turn, enables avoiding saturation of the sensor, leading to a better signal to noise ratio.
(91) When the value of V_TGsink equals the value of V_TGtransfer, electrons can be integrated within the PPD well; or electrons can be read from the SN.
(92) When the value of V_TGsink is greater than the value of V_TGtransfer, electrons do sink from the PPD through the TGsink transistor when the PPD is not being read.
(93) When the value of V_TGsink is smaller than the value of V_TGtransfer, electrons cannot sink from the PPD through the TGsink transistor while being read through the TGtransfer transistor.
(94) V_TGsink is a constant value which is selectively applied or not to the grid of the TGsink transistor, thanks e.g. to a switch or to a DSP.
(95) Accordingly, the value of V_TGtransfer and of V_TGtransfer only, can be used to control the value of the potential barrier at the edge of the PPD. Such value of V_TGtransfer is set, and can be continuously adapted thanks to a calibration phase, so that the majority of the photo-generated electrons representing the constant component of the PPG signal (offset electrons) are not transferred to the sense node and, instead, remain within the PPD well. Eventually, these electrons can be sunk out in a next phase.
(96) It should be underlined at this stage that, although PPD's are known in image sensors (charge coupled device, CCD's), they are not exploited in the same way as in the present invention. In an image sensor, the aim is to capture and exploit the entirety of the impinging light, since the entire amount of this light contains critical information regarding light intensity. The intensity recorded by each PPD of an image sensor is then used to create the image. As a result, in an image sensor, the entire charge stored in the PPD's charge well is transferred to the remainder of the circuit for signal processing. In the specific case of a PPG sensor, the majority of the light received is simply DC noise, hiding the signal. As described above, some of this comes from ambient light, and some from non-varying reflection from tissue, arteries and veins, the desired signal being simply the varying AC component on top of this noise. When using a conventional PN or PIN photodiode, there is no way to remove this at the level of the photodiode itself, and the entire current generated in the conventional diode must be processed. By exploiting the properties of PPD diodes as described above, it is possible to reject most, if not all, of this DC noise at the level of the PPD, only transferring the small portion of the received light that corresponds to the desired AC component.
(97) A number of the PPD arrangements of
(98) Although two PPD's are arranged in parallel in
(99) The macropixel structure is optimized for the specific properties of a PPG signal which is completely different from the properties of the signal sensed in a classical image sensing. Fundamentally, a PPG output is a one-dimensional signal, and does not require any information regarding the spatial relationship between the individual PPD's, which is mandatory in conventional imaging. Furthermore, use of such macropixels would reduce the image resolution significatively in conventional imaging since they cover a larger area, whereas here, since there is no concept of “resolution”, multiple PPD's can be used in parallel to increase the amount of charge available for sampling at extremely short illumination and sampling times.
(100) The reset voltage, the V_well of the PPD device and the transfer gate voltage used during the transfer are all chosen specifically in order to:
(101) allow the PPDs of the same macropixel to inject the charge in the common sense node SN of the macropixel without cross talk (the PPDs remain independent from each other during the transfer) Prevent a predetermined amount of signal from being transferred to the sense node thanks to VTG_transfer level as explained above. The said signal depends on the perfusion index (AC/DC ratio)
(102) The choice of the number of PPDs per macropixel is defined to optimize the signal to noise ratio specifically for the PPG signal characteristics which is a function involving the electronic read noise, photon shot noise, PPDs dark current noise, quantization noise, saturation level, AC/DC ratio or perfusion index, the number of pixels macropixel, the number of macro pixels per array. Such a function is specific to the PPG signal processing and is not a consideration in image sensor design, as discussed above.
(103) Array of Pixels
(104) Regardless of whether the first or the second embodiment of pixels, or the macropixel structure described above is used, it is advantageous to use a photo detector comprising a plurality of pixels, especially an array of pixels, each pixel comprising one PPD one macropixel.
(105) This leads to significant improvements. Indeed, it has been shown that PPD based imagers achieve outstanding sensitivity and noise performance.
(106) The PPG device proposed in this embodiment bases its functionalities on the distribution of the input light on an array of PPD based pixels and averaging their outputs, this reducing significantly the read-out noise, photonic shot noise and spurious signals.
(107) As mentioned earlier, most of the power consumption of a PPG device is spent in the LEDs emission. The better sensitivity allowed by the proposed device enables to significantly reduce the duty cycle and the illumination of the LEDs, significantly reducing the average bias current and the power consumption.
(108) In addition to this, this new PPG device can also be fully integrated into a single chip, a SOC, which represents a breakthrough with respect to the state-of-the-art-solutions, mostly showing SOBs (discrete electronics).
(109) Replacing a single PD or PIN diode by an array of pixels results at least in the distribution of the input light on the pixels which reduces the dynamic range constraint on the read-out chain. In addition, the averaging of the array pixels output allows a reduction of the read noise variance, which is proportional to the number of averaged outputs.
(110) The fact that there is a reader circuitry at each pixel generates electronic read noise. Averaging the value of all pixels reduces the read noise by a number which is a factor of the total number of pixels of the array. This enables to eradicate the read noise.
(111) The averaging of the outputs of the array pixels is performed in the charge domain.
(112) The timing diagram related to this schematic (
(113) In the array structure presented in different variants in
(114) The array structure allows pulse capturing, ambient light cancellation, noise reduction, DC cancellation with respect to a given perfusion index in less than 10 us for a full array of more than 100,000 PPDs and allows a power consumption at least two orders of magnitude below that achieved by a conventional array. This demonstrates the substantial difference between a pixel array and a conventional image sensor.
(115) Multiple Sampling
(116) The purpose here is to further improve the signal-to-noise ratio SNR.
(117) In a first step, the LEDs are off. Ambient light is sampled for a predetermined length of time thanks to a first capacitor. The signal which is read and recorded only corresponds to ambient light.
(118) In a second step, the LEDs are on for a predetermined length of time, ideally the same as the predetermined length of time for which ambient light is sampled. The light from the ambient light and from the LED is sampled thanks to a second capacitor. The signal which is read and recorded corresponds to LEDs light and ambient light.
(119) This operation is an intrinsic subtraction which eliminates both the constant reset level and also reduces the flicker noise, which is called “Correlated-Double-Sampling” (CDS), using corresponding CDS block or stage.
(120) It is then possible to subtract the signal of the first step from the signal of the second step to get a signal which only corresponds to LEDs light by subtracting the value from the first capacitor from the value of the second capacitor.
(121) The two CDS can be operated within 20 μs (pulse of LED light of 10 μs), it is assumed that ambient light does not change in a significant way within that period of time. This removes any artefacts that don't change within that period of time, e.g. motion artefacts.
(122) It has been previously discussed that the reading-out action is performed in several steps, starting from the reset level sensing and finishing with the CDS.
(123) This mechanism can be enhanced for PPG applications to perform ambient light subtraction and output averaging, i.e. filtering, in an almost fully passive manner, which means inherently zero power.
(124)
(125) With reference to
(126) In the first phase (“Ambient Light” with reference to
(127) Subsequently, switches SH1 and SH2 are opened, and switches SH3 are closed, resulting in both capacitors CHS1 and CSH2 being connected in parallel, with the polarity inverted. In other words, the pole of the capacitor CSH2 into which the charge from the PPD flowed is connected to ground, its other pole, which had previously been grounded by the lower of the two SH2 switches, being connected to the input pole of capacitor CSH 1. Thanks to the inversion potential principle, at the end of the first CDS1 stage, the corresponding voltage level results to be 0.5(V_C.sub.SH1−V_C.sub.SH2), which equals to 0.5(V_amb+V_reset−V_reset)=0.5V_amb. This removes any artefact from a preceding reset. Such result is stored in a CSH4 capacitance (block CDS2 on
(128) In a second phase (“LED Light” with reference to
(129) In this case, at the end of the first CDS1 stage, similarly to the first phase, the corresponding voltage level results to be approximately equal to: 0.5(V_LED+V_amb+V_reset−V_reset)=0.5(V_LED+V_amb).
(130) As for the first phase, V_LED+V_amb is stored in a capacitance C.sub.SH3 (block CDS2 on
(131) Since the PPG information of interest is contained in V.sub.LED only, the signal can be “cleaned” of ambient light to improve the signal-to-noise ratio.
(132) By construction of block CDS2, it is possible to differentiate C.sub.SH4 with C.sub.SH3, then to subtract the voltage 0.5(V_amb) related to the ambient light from the voltage 0.5(V_amb+V_LED) related to the ambient light+the signal resulting from LED illumination, thus to obtain the voltage 0.25(V_LED) related to the LEDs only, by operating the various switches of the block CDS2 as described above in the context of CDS1, mutatis mutandis. This final signal is then passed to the ADC and converted to a digital signal.
(133) As a result, the signal to noise ratio can be massively improved by subtracting the DC voltage component from the PPD output which corresponds to the received ambient light measured with the LED off can easily be subtracted from the total signal measured with the LED on.
(134) One other embodiment and operation of the presented photoplethysmography (PPG) sensing device allowing ambient light cancellation with one single CDS is described using
(135) This ambient light cancellation with one CDS is described as follows based on
(136) One other embodiment and method operation of the presented photoplethysmography (PPG) sensing device allowing sensing the derivative of the PPG signal instead of the PPG signal itself is described using
(137) The PPG derivative sensing is described as follows based on
(138) This technique has also the advantage of computing the PPG signal derivative with one single readout scheme and one analog to digital conversion.
(139) Multiple Sampling+Array of Pixels
(140) The multiple sampling described here above can be performed simultaneously for all the pixels in a same column, as shown on
(141) In a same column, pixels share the same sense node SN connected to one voltage buffer, as shown in
(142) The inversion polarity principle of
(143) The averaging all the column reduces the read noise variance by a factor equal to the number of columns, this leading to low-noise, low-power performances.
(144) In a first embodiment,
(145) The averaging involves a fully passive circuit made of switches and sampling capacitances, as shown on
(146) As shown in
(147) After this reset operation, the TGtransfer transistor is turned off and the LED is pulsed on for a predetermined period of time to let the integrated charge cumulate in the PPD and overflow to the sense node. The overflowing charge changes linearly the value of the sense node SN voltage.
(148) The outputs of each voltage follower, SFx with respect to
(149) In a further embodiment,
(150) The two CDS stages perform independently, per each column, the ambient and reset voltage compensation and only in the end the LED signal voltages are averaged among the m-columns.
(151) In a further embodiment illustrated in
(152) The process of averaging and a system level representation is depicted in
(153) As far as the input noise (in e.sup.−.sub.rms) is concerned, the shot noise is a limiting factor. Indeed, for a 28.5 dB SNR, accounting for the shot noise only, the shot noise accounts for more than 10 ke.sup.−.sub.rms in terms of input referred noise. This means that the solutions of
(154) This operation is an intrinsic subtraction which eliminates both the constant reset level and also reduces the flicker noise and spurious signals.
(155) Thanks to the present invention, it is possible to remove the DC component of a signal at the pixel level.
(156) The PPD acts as a capacitor whose capacitance value is known. The amount of charges in the PPD can then be calculated by multiplying said capacitance value by V_TGtransfer.
(157) The PPD based image sensor according to the present invention can be a CMOS imager, which is advantageously used in a PPG application. As explained later, a CMOS image sensor can be driven to solve the issues of LED power consumption, dynamic range limitations of a PPG signal which make the signal processing and filtering difficult otherwise.
(158) The device according to the present invention is advantageously built as a system-on-chip (SOC), integrating a different photonic sensing technology with low-noise and low-power signal processing chain, this allowing higher sensitivity, reliable vital parameters measurement at lower active light (LEDs) levels and at the same time fabricated in a standard CMOS process.
(159) As can be seen from the foregoing, with respect to conventional PPG sensing devices, the PPG sensor of the invention has the advantage of complete decoupling between the photoelectrons light integration in the pixel array and the next stages of the readout chain e.g. amplification and analog to digital conversion. This special feature is enabled thanks to the fact that the capacitors can hold an analog value without any external driving trigger. This allows switching-on the power supply to the array only during the light integration time which is typically less than 10 us and switching-off that supply during the rest of readout operation. In this way the overall power consumption of the PPG sensor is even more reduced.