METHOD AND SYSTEM FOR UNATTENDED CHILD DETECTION
20180170213 ยท 2018-06-21
Inventors
- Mathieu Lu-Dac (Luxembourg, LU)
- Patrick Di Mario-Cola (Serrouville, FR)
- Dimitri TATARINOV (Trier, DE)
- Andreas DIEWALD (Kell am See, DE)
- Claude Watgen (Sandweiler, LU)
- Sam Calmes (Luxembourg, LU)
- Peter Larsen (Bereldange, LU)
Cpc classification
B60N2/266
PERFORMING OPERATIONS; TRANSPORTING
A61B2503/06
HUMAN NECESSITIES
A61B5/4809
HUMAN NECESSITIES
B60N2/0035
PERFORMING OPERATIONS; TRANSPORTING
G01S7/412
PHYSICS
B60N2/0022
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60N2/00
PERFORMING OPERATIONS; TRANSPORTING
A61B5/00
HUMAN NECESSITIES
B60N2/28
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A radar sensor system and method for ascertaining whether an unattended child is present within an automotive vehicle. The radar sensor system carries out the method and includes a transmitter, at least one sensor, and processing circuitry. The method includes the steps of: illuminating at least one occupiable position within the vehicle with radiation of multiple frequencies; generating radar sensor signals from reflections of the transmitted radiation, a plurality of the radar sensor signals corresponding to different frequencies; and operating the processing circuitry for generating and determining if a first indicator value indicative of motion in the occupiable position satisfies a first predetermined criteria and, if so, generating and determining a second indicator value indicating a degree of repetitive pattern within the radar sensor signals, and determining presence of an unattended child in the vehicle if the second indicator value satisfies a second predetermined criteria.
Claims
1. A method for ascertaining whether an unattended child is present within an automotive vehicle using a radar sensor system, the radar sensor system comprising a transmitter, at least one sensor, and processing circuitry, the method comprising: illuminating, using the transmitter, at least one occupiable position within the vehicle with radiation, the radiation exhibiting at least one frequency; generating, using at least one sensor, radar sensor signals from radiation reflected as a result of the transmitted radiation; and carrying out, using the processing circuitry, the following steps: generating, based on the radar sensor signals, a first indicator value, the first indicator value indicating a degree of motion associated with the occupiable position; determining whether the first indicator value satisfies a first predetermined criteria; when the first indicator value satisfies the first predetermined criteria, generating, based on radar sensor signals, a second indicator value, the second indicator value indicating a degree of repetitive pattern within the radar sensor signals; and determining that an unattended child is present within the automotive vehicle if the second indicator value satisfies a second predetermined criteria.
2. The method of claim 1, wherein the first predetermined criteria is that the first indicator value lies between a first threshold value and a second threshold value.
3. The method of claim 1, wherein the first indicator value comprises an R-value, corresponding to an amplitude of variation of the radar sensor signals.
4. The method of claim 2, wherein the second predetermined criteria is that the second indicator value lies above a third threshold value.
5. The method of claim 1, wherein the second indicator value is dependent upon a breathing rate index, the breathing rate index being derived from motion determined based on the radar sensor signals.
6. The method of claim 1, wherein the second indicator value is dependent upon a breathing rate variation index, the breathing rate variation index being derived from motion determined based on the radar sensor signals and indicating a degree of variation in breathing rate.
7. The method of claim 1, wherein the second indicator value is or is derived from the product of multiple breathing indices, each breathing index being related to breathing rate.
8. The method of claim 1, wherein the second indicator value is a function combining both the breathing rate and breathing rate variation index.
9. The method of claim 1, wherein the second indicator value comprises a breathing signature.
10. The method of claim 1, wherein determining whether the first indicator value satisfies a first predetermined criteria is performed based on radar sensor signals occurring during a first predetermined period following initiation.
11. The method of claim 1, wherein determining that an unattended child is present within the automotive vehicle if the second indicator value satisfies a second predetermined criteria is based on radar sensor signals occurring during a second predetermined period following initiation.
12. The method of claim 11, wherein determining whether the first indicator value satisfies a first predetermined criteria is performed based on radar sensor signals occurring during a first predetermined period following initiation, and wherein the second predetermined period is longer than the first predetermined period.
13. The method of claim 11, wherein determining whether the first indicator value satisfies a first predetermined criteria is performed based on radar sensor signals occurring during a first predetermined period following initiation, and wherein the first predetermined period is has a duration lying in the range 1-5 seconds and the second predetermined period has a duration lying in the range 10-60 seconds.
14. The method of claim 1, wherein the radar sensor signals are derived from a combination of multiple received signals resulting from the radiation, the received signals being at different frequencies.
15. The method of claim 1, wherein the frequencies of the transmitted radiation are dynamically varied whereby (i) determining whether the first indicator value satisfies a first predetermined criteria is and/or (ii) determining that an unattended child is present within the automotive vehicle if the second indicator value satisfies a second predetermined criteria is time optimized.
16. The method of claim 1, wherein (i) the first threshold value is such that the first indicator value being below the first threshold value is indicative of an empty seat or environment; (ii) the second threshold value is such that the first indicator value being above the second threshold value is indicative of a moving person or child; and/or (iii) the first threshold value the second threshold value are such that the first indicator value being between the first threshold value the second threshold value is indicative of a sleeping child being present in the occupiable position or of strong influence from sources external to the vehicle.
17. (canceled)
18. A radar sensor system for ascertaining whether an unattended child is present within an automotive vehicle, the system comprising: a transmitter, for illuminating at least one occupiable position within the vehicle with radiation, the radiation exhibiting multiple frequencies; at least one sensor for generating radar sensor signals from radiation reflected as a result of the transmitted radiation, a plurality of the radar sensor signals corresponding to different frequencies; processing circuitry, coupled to the at least one sensor (10), the processing circuitry being configured to carry out the steps of: generating, based on the radar sensor signals, a first indicator value, the first indicator value indicating a degree of motion associated with the occupiable position; determining whether the first indicator value satisfies a first predetermined criteria; when the first indicator value satisfies the first predetermined criteria, generating, based on radar sensor signals, a second indicator value, the second indicator value indicating a degree of repetitive pattern within the radar sensor signals; and determining that an unattended child is present within the automotive vehicle if the second indicator value satisfies a second predetermined criteria.
19-20. (canceled)
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Preferred embodiments of the invention will now be described, by way of example, with reference to the accompanying drawings, in which:
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
DESCRIPTION OF PREFERRED EMBODIMENTS
[0046] In order to address the aforementioned problems, the present invention proposes to use a radar-based system able to detect children in a car. The action to be taken in response to such detection may be a (e.g. audible) reminder for the driver not to leave his child alone, the automatic regulation of the car temperature, or even an emergency call initiation.
[0047]
[0048]
[0049] As also well known, demodulators and filters together with a shift element 210 providing a 90? shift provides received signals in the form of real (I) and imaginary (Q) signals on separate channels 212 and 214, respectively. The transmitted radiation is preferably FMCW/FSK radar signals where the frequency can be tuned.
[0050] Embodiments are based on a Frequency Modulated Continuous Wave (FMCW) or Frequency Shift Keying (FSK) Radar module that emits in a particular bandwidth (24-24.25 GHz currently but other frequency ranges may be used).
[0051] A waveform for the transmitted frequencies, and corresponding samples, is illustrated in
where the encircled term is used to provide the Doppler information. The R-value is the translation in polar coordinates of the IQ cathesian modulation where the origin of the coordinates is set to the center of the circle (or where the offset due to hardware and scene is filtered out).
[0052] Thus, based on the radar signals, a first measure of motion is extracted: the R-Value. This value takes into account most kinds of motion but is centered on human motion, to limit the higher frequency noises as well as the much lower frequencies influences that might come from slower processes (e.g. drift inherent of the system or other slow external processes). The R-value is important as it can be used to determine whether a sleeping/unattended baby or child is present.
[0053]
[0054] An R-value below a first (lower) threshold R.sub.1 is indicative of an empty seat (also known as an empty environment) or weak external influence. A very weak R-Value (typically below the Empty Seat/Sleeping Child threshold) is characteristic of an environment devoid of any human presence: empty seat or weak outside influences (lowermost zone in
[0055] An R-value above an upper threshold R.sub.2 is indicative of a moving child being present. A very high R-value Value (typically above the Sleeping Child/Moving threshold) is characteristic of human motions like limb movement or larger child/adult breathing (uppermost zone in
[0056] Finally, an R-value lying between R.sub.1 and R.sub.2 is inconclusive: there is either a sleeping baby present or a strong influence from external sources; and a subsequent breathing pattern extraction algorithm must be executed in accordance with embodiments of the invention to determine which is the case.
[0057] Between the two thresholds, the R-values can be either caused by a sleeping child (typically a newborn) but could be as well be caused by outside influences (car passing by, rain, pedestrian close to the car, sunshield on the external part of the window moving with the wind etc.). In this (intermediate) region, a more sophisticated type of processing is needed, in order to distinguish the human signals from outside influencesSleeping Child Recognition (SCR).
[0058]
[0059] If, on the other hand, it is determined at s508 that the R-value is less than R.sub.2, processing proceeds with a sleeping child recognition (detection) step s512, discussed in further detail herein below. At s512, a determination that a sleeping child recognition value or index is equal to 1 max, a decision is taken that a still (unattended/sleeping) child is present within the vehicle (s514). If, at s512, the determined sleeping child recognition index is 0, a further determination is made at s516 such that, if t>max, a decision is made that the car is empty but noisy (s518). Where, however, t<max, processing returns to s502. This inconclusive loop is made to avoid babies to be hidden by external perturbations.
[0060] Referring to
[0061]
[0062]
[0063] Signal pattern unit 706 provides a command signal generally designated 708 that is fed via digital-to-analog unit (DAC) 710, which in turn provides a control signal to the VCO of analog transceiver block 702. Received radar sensor signals provided at outputs 712 and 714 of analog transceiver block 702 provide, via ADCs 716 and 718 I and Q signals, respectively, to inputs 720 and 722 of signal processing unit 704.
[0064] Within signal processing unit 704, buffer 724, DC-offset subtraction unit 726 and digital filter 728 (e.g. Butterworth with N approx. 1-5) provide preprocessing of the I and Q signals.
Principles of the SCR Algorithm:
[0065] To discriminate the sleeping child from outside influences, a new algorithm has been developed that takes into account the specificity of sleeping children, which requires processing the radar signal for a longer time.
[0066] At least in embodiments, the invention is based on the unexpected finding that the radar signature of a sleeping child incorporates a repetitive pattern due to the regularity of the breathing of the newborn. Indeed, despite the low R-value, the signal of the sleeping newborn child is recognizable by the regularity of its dominant frequencies, which are distinct from the system noise and outside influences.
[0067] Referring to
[0068] As seen in
[0069] Returning to
[0070] In the event that the R-value is intermediate those thresholds (R1, R2), further processing is carried out. More particularly, sleeping child recognition unit 740 receives the I, Q signals and then performs interpolation thereof using interpolation unit 742, if it is determined by comparison unit 744 that the R-value is intermediate. The output of interpolation unit 742 is a signature waveform (or signature), also referred to herein as VSM. Examples of signatures in the case of a sleeping child being present are shown in
[0071] At least in embodiments, the SCR-algorithm is capable of identifying the intensity and the frequency of repeating signal patterns. In case of a sleeping child, the output of this analysis will show the regularity of the breathing frequency in certain frequency range, as seen in
[0072]
[0073] In contrast to
[0074] Returning to
[0075]
[0076] As will be appreciated, frequency selection s1102, offset filter ring s1104 and drift filtering s1106 correspond to units 706, 726 and 728 in
[0077] For sleeping child recognition/detection, first VSM signal reconstruction is performed to generate the signature or VSM (s1124). In this embodiment, operations are carried out in parallel to perform, on the signatures, dominant frequency extraction (s1126), frequency regularity extraction (s1128) and amplitude regularity extraction (s1130). The output of operations s1126 to s1130 is a human signature index (HSI), as determined at s1132. Then, a decision is made (s1134), whereby if the HSI is greater than a threshold (H1), there is a finding (s1136) that the vehicle is unoccupied. On the other hand, if it is determined at s1134 that the HSI is less than H1 and that a period (e.g. 30 seconds; s1136) has elapsed, there is a finding that the vehicle is empty (s1138).
[0078] The Human Signature Index (HSI) determination is based on extraction of repeating patterns. This assists in determining whether a sleeping child is present, and in this respect reference is made to
[0079] Moreover, the dominant frequency extraction operation (s1126) enables the derivation of a breathing rate index from the received signature; this is illustrated in
[0080]
[0081] In relation to the SCR subprocess (s1122) of
[0082]
[0083] Figure shows signals produced using the algorithm of
Timings of the SCR Algorithm:
[0084] At least in embodiments, the in practice, the Sleeping Child Recognition algorithm triggers the decision Sleeping Child as soon as the signature is recognized. At best, a sleeping child can then be detected within c. 30 seconds.
[0085] Moreover, to cover all possible scenarios, the Empty/Sleeping Child Threshold (EER) and the Sleeping/Moving Child Threshold (SCR) are still tested in parallel to the Sleeping Child Recognition algorithm and can also lead to anticipated decision, at least in embodiments of the invention.
[0086] This optimization of the detection time may be done for the Moving Child, Empty Seat and Sleeping Child decisions, but in case of persistent Outside Influence, the decision may only be taken after a longer period (c. 1-5 minutes).
[0087] In some embodiments, the SCR algorithm is based on two important processes: (i) the optimization of radar signals to the primary target (e.g. a baby in an occupiable position) and (ii) the recognition of human breathing signatures.
[0088] At least in embodiments, the optimization of radar signals to the primary target is the process of combining the signals of different frequency steps of the FMCW or FSK in order to eliminate the destructing interferences and retain only the best signals corresponding to the motion of the primary target. This selection process of the frequency can lead to a modification of the emitted (transmitted) radar waves if necessary.
[0089] At least in embodiments, the recognition of human breathing signals is done by using signal processing methods able to identify repetitive patterns (typically autocorrelation) on a well chosen time window (typically 15 s). From this processed output (see
[0090] While embodiments have been described by reference to embodiments having various components in their respective implementations, it will be appreciated that other embodiments make use of other combinations and permutations of these and other components.
[0091] Furthermore, some of the embodiments are described herein as a method or combination of elements of a method that can be implemented by a processor of a computer system or by other means of carrying out the function. Thus, a processor with the necessary instructions for carrying out such a method or element of a method forms a means for carrying out the method or element of a method. Furthermore, an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
[0092] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
[0093] Thus, while there has been described what are believed to be the preferred embodiments of the invention, those skilled in the art will recognize that other and further modifications may be made thereto without departing from the spirit and scope of the invention, and it is intended to claim all such changes and modifications as fall within the scope of the invention. For example, any formulas given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present invention.