Method of operating a radar sensor system for vital sign detection with elimination of signals excited by interfering movements

Abstract

A method of operating a radar sensor system that is configured to determine range and velocity information from radar waves reflected by a scene in an interior of a vehicle for vital sign detection. The method includes steps to decompose reflected and received signals into range and velocity information, to measure the movement over time in specified range gates and to evaluate the similarities between them. Based on the characteristics of similar behaving range bins, it can be decided whether any detected movement is related to an internal or external disturbance or by vital signs.

Claims

1. Method of operating a radar sensor system that is configured to determine range and velocity information from radar waves reflected by a scene in an interior of a vehicle for vital sign detection, the method comprising at least the following steps, which are to be executed iteratively, while illuminating the interior of the vehicle with radar waves by the radar sensor system, receiving radar waves reflected from the scene, removing signals that are representative of a static portion of the scene from range signals obtained from the received radar waves for deriving dynamic range signals assigned to a plurality of range bins, selecting a plurality of predefined groups of range bins out of the plurality of range bins, wherein the groups are separated by at least one range bin, retrieving real values of range signals assigned to each of the range bins of the selected predefined groups of range bins, averaging the retrieved real values over a predefined period of time to form range signal buffers, determining a Doppler frequency for each range bin of the plurality of predefined groups of range bins, deriving a statistic quantity from the determined Doppler frequencies representing a dominant frequency, comparing the dominant frequency with at least one predetermined condition concerning a predefined characteristic vital sign frequency, if the dominant frequency fulfills all predetermined conditions, calculating a plurality of correlation coefficients, one correlation coefficient for each possible pair of range signal buffers, grouping the correlation coefficients into at least two groups depending on the range bins to which the range signals of each possible pair of range signal buffers have been assigned, comparing each correlation coefficient with a group-specific threshold value and assign predetermined numerical values to each correlation coefficient depending on the outcome of the comparison, for each group of correlation coefficients, calculating a numerical indicator value based on the predetermined numerical values that have been assigned to each correlation coefficient of the specific group, comparing each numerical indicator value to a predetermined group-specific indicator value threshold, and generating an output signal based on a result of the comparison for each group.

2. The method as claimed in claim 1, wherein the step of removing signals that are representative of a static portion of the scene comprises: converting the range signals obtained from the received radar waves from the time domain to the frequency domain, and subtracting frequency domain range signals obtained from radar waves received in one of previously executed iterations of the steps, or subtracting an average of a plurality of frequency domain range signals obtained from radar waves received in a plurality of previously executed iterations of the steps, or applying a high pass filter to the range signals obtained from the received radar waves.

3. The method as claimed in claim 1, wherein the step of determining a Doppler frequency for each range bin of the plurality of predefined groups of range bins comprises converting values from the formed range signal buffers from the time domain to the frequency domain.

4. The method as claimed in claim 1, wherein the step of deriving a statistic quantity from the determined Doppler frequencies includes determining a median Doppler frequency value.

5. The method as claimed in claim 1, wherein the step of calculating a plurality of correlation coefficients comprises to store the calculated correlation coefficients as matrix coefficients in a matrix.

6. The method as claimed in claim 1, wherein the step of assigning predetermined numerical values to each correlation coefficient depending on the outcome of the comparison includes assigning predetermined numerical values of either 0 or 1.

7. The method as claimed in claim 1, wherein the step of calculating a numerical indicator value based on the predetermined numerical values that have been assigned to each correlation coefficient of the specific group includes calculating a sum of the numerical values that have been assigned to each correlation coefficient.

8. A radar sensor system, comprising: a radar transmitter unit that is configured to transmit radar waves towards a scene, a radar receiving unit that is configured for receiving radar waves that have been transmitted by the radar transmitter unit and have been reflected from the scene, an evaluation and control unit that is configured for determining range and velocity information from the radar waves received by the radar receiving unit, wherein the evaluation and control unit is further configured for carrying out the method as claimed in in claim 1.

9. The radar sensor system as claimed in claim 8, wherein the radar transmitter unit is configured for transmitting frequency-modulated continuous radar waves or for transmitting radar waves that are modulated according to a frequency-shift keying scheme.

10. A non-transitory, computer-readable medium having stored thereon a software module for controlling automatic execution of the method as claimed in claim 1, wherein the software module comprises program code that is executable by a processor unit of a radar sensor system or by a separate control unit for the radar system to carry out the method, wherein the radar sensor system comprises: a radar transmitter unit that is configured to transmit radar waves towards a scene, a radar receiving unit that is configured for receiving radar waves that have been transmitted by the radar transmitter unit and have been reflected from the scene, and an evaluation and control unit that is configured for carrying out the method to determine range and velocity information from the radar waves received by the radar receiving unit.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) Further details and advantages of the present invention will be apparent from the following detailed description of not limiting embodiments with reference to the attached drawings, wherein:

(2) FIG. 1 schematically illustrates a radar sensor system in accordance with the invention for detecting passenger vital signs in an interior of a vehicle in a side view, installed in the vehicle,

(3) FIG. 2 is an overview block picture of an embodiment of the method in accordance with the invention of operating the radar sensor system pursuant to FIG. 1,

(4) FIG. 3 is a flowchart of a part of the embodiment of the method pursuant to FIG. 2,

(5) FIG. 4 schematically shows an intermediate result after executing the part of the method pursuant to FIG. 3,

(6) FIG. 5 is a flowchart of another part of the embodiment of the method pursuant to FIG. 2,

(7) FIG. 6 shows an exemplary region mask,

(8) FIG. 7 is a flowchart of another part of the embodiment of the method pursuant to FIG. 2, and

(9) FIG. 8 is a flow chart of another part of the embodiment of the method pursuant to FIG. 2.

DETAILED DESCRIPTION

(10) FIG. 1 schematically illustrates, in a side view, a possible embodiment of a radar sensor system 100 in accordance with an embodiment of the invention. The radar sensor system 100 is installed in an interior 116 of a vehicle 114, which is designed as a passenger car. The radar sensor system 100 is configured for operation in the interior 116 of the vehicle 114, and particularly for determining range and velocity information from radar waves reflected by a scene given by an interior 116 of the vehicle 114, for vital sign detection by an automotive vehicle interior sensing system.

(11) A person 124 located in the interior 116 of the vehicle 114 is the driver, who is occupying the driver's seat 118 of the vehicle 114. The vehicle 114 is driving on a roadway, whose roughness causes vertical motion 122 of vehicle wheels 120. The vertical motion 122 of the wheels 120 is transferred to a body of the vehicle 114 via a vehicle suspension system (not shown), generating forced vibrations of the driver's seat 118 (and other seats as well) and the person 124 occupying the driver's seat 118. Additional forced vibrations are induced by mechanical vibrations of a running engine of the vehicle 114.

(12) The radar sensor system 100 comprises a radar transmitter unit 102, a radar receiving unit 104 and an evaluation and control unit 108 that is connected by data links and signal lines to both the radar transmitter unit 102 and the radar receiving unit 104 and which may be positioned in the vehicle 114 remote from the radar transmitter unit 102 and the radar receiving unit 104. The radar transmitter unit 102 of the radar sensor system 100 includes a radar transmit antenna (not shown) that is directed towards a scene given by the interior 116 of the vehicle 114 and is configured for transmitting frequency-modulated continuous radar waves towards the scene. In other embodiments, the radar transmitter unit may be configured for transmitting radar waves that are modulated according to a frequency-shift keying scheme. In the embodiment shown in FIG. 1, the radar transmitter unit 102 and the radar receiving unit 104 are shown to be arranged in the front part of the vehicle in front of the driver/passenger (e.g. in the vicinity of the windshield). The skilled person will however understand that other mounting positions for the transmitter and receiver units are possible. The radar transmitter unit 102 and the radar receiving unit 104 may e.g. be positioned more centrally in the vehicle compartment, e.g. above the driver and/or passenger. This position is schematically represented in FIG. 1 in dashed line.

(13) The radar receiving unit 104 includes a radar receiving antenna (not shown) that is also directed towards the scene. The radar receiving unit 104 is configured for receiving radar waves, which have been transmitted by the radar transmitter unit 102 and have been reflected from the scene, in particular by the driver's chest.

(14) The radar transmit antenna and the radar receiving antenna are co-located in a monostatic, bistatic of multistatic arrangement. In this specific embodiment, the radar transmitter unit 102 and the radar receiving unit 104 form an integral part of a transceiver unit 106. In other embodiments, the radar transmitter unit 102 and the radar receiving unit 104 may be designed as separate units.

(15) The evaluation and control unit 108 is configured for determining range and velocity information from the radar waves received by the radar receiving unit 104. The evaluation and control unit 108 comprises a processor unit 110 and a digital data memory unit 116 to which the processor unit 110 has data access.

(16) The radar sensor system 100 is configured for vital sign detection that are given by a breathing motion of the driver or passenger, characterized by an amplitude and a breathing frequency. The radar sensor system 100 is sensitive to a relative motion between the radar transceiver unit 106 and the driver's chest. The radar sensor system 100 is also sensitive to a relative motion of the radar transceiver unit 106 to parts within the interior 116 of the vehicle 114.

(17) As a relative movement of the driver's chest with regard to the radar transceiver unit 106 is superimposed by the forced vibrations, so are the range and velocity information determined from radar waves reflected by the driver's chest and received by the radar receiving unit 104.

(18) In order to reliably and robustly distinguishing between radar signals related to an occupant positioned in a specific region of interest in the vehicle interior 116 and disturbing signals caused by vehicle interior events and/or events outside the vehicle 114, such as vehicle or sensor shaking induced by rough road, strong wind gusts or engine vibrations or intentional shaking, the evaluation and control unit 108 is configured for automatic execution of steps of an inventive method of operating the radar sensor system 100 in a controlled way.

(19) To this end, the evaluation and control unit 108 is equipped with a software module 126. The method steps to be conducted are converted into a program code of the software module 126. The program code is implemented in the digital data memory unit 112 of the evaluation and control unit 108 and is executable by the processor unit 110 of the evaluation and control unit 108.

(20) In the following, an embodiment of the method of operation the radar sensor system 100 in the interior 116 of the vehicle 114 will be described with reference to FIG. 1. In preparation of operating the radar sensor system 100, it shall be understood that all involved units and devices are in an operational state and configured as illustrated in FIG. 1.

(21) The steps of the method are to be executed iteratively, while illuminating the interior 116 of the vehicle 114 with radar waves by the radar sensor system 100 as a step 10 of the method.

(22) In a first block 20 of steps (FIG. 2), dynamic range signals assigned to a plurality of range bins are derived.

(23) In a first step 22 of the block 20, radar waves reflected from the scene are received (FIG. 3). In a next step, signals that are representative of a static portion of the scene are removed from range signals obtained from the received radar waves for deriving the dynamic range signals assigned to the plurality of range bins. To this end, the range signals obtained from the received radar waves are converted from the time domain to the frequency domain in a step 24, for instance by applying a Fast Fourier Transform (FFT), followed by a step 26 of subtracting an average of a plurality of frequency domain range signals obtained from radar waves received in a plurality of previously executed iterations of the steps. A result for the (dynamic) range FFT is exemplarily shown in FIG. 4.

(24) In a next block 30 of steps (FIG. 2), preprocessing of the range FFT signals is carried out.

(25) As a next step 32 of this block 30 of steps, a plurality of predefined groups of range bins 80 out of the plurality of range bins is selected (FIG. 5), wherein the groups are separated by two guard range bins 82, as is shown in FIG. 4. In another step 34, real values of range signals assigned to each of the range bins 80 of the selected predefined groups of range bins are retrieved, for instance from the digital data memory unit 112. Then, the retrieved real values are averaged over a predefined period of time in one step 36 and range signal buffers are formed in another step 38.

(26) In a further block 40 of steps (FIG. 2) a dominant frequency of the real values of the range signals is derived.

(27) In this block 40 of steps, a Doppler frequency for each range bin 80 of the plurality of predefined groups of range bins is determined. This is carried out by converting values from the formed range signal buffers from the time domain to the frequency domain, for instance by applying an FFT. From the determined Doppler frequencies, a statistic quantity is then derived by determining a median Doppler frequency value, which is taken as the dominant frequency.

(28) The determined dominant frequency is checked against a predetermined condition concerning a predefined characteristic vital sign frequency, which is given by the determined dominant frequency falling below an upper limit Th.sub.f for the breathing frequency, in a step 42 of comparison (FIG. 8). If the determined dominant frequency fails to fulfill this predetermined condition, the received radar waves are considered to originate from sources other than vital signs.

(29) If the determined dominant frequency fulfills these predetermined conditions, a plurality of correlation coefficients is calculated in another step 44, one correlation coefficient for each possible pair of range signal buffers (FIG. 2). Further, the calculated correlation coefficients are stored as matrix elements in a matrix 89 (FIG. 7). The matrix may reside in the digital data memory unit 112 of the evaluation and control unit 108.

(30) In a next step 46, the correlation coefficients are grouped, depending on the range bins to which the range signals of each possible pair of range signal buffers have been assigned. In this specific embodiment, the correlation coefficients are grouped into three groups, which may represent a range region 84 covering the vehicle interior 116, a region 86 of interior ranges whose distance is large, and an exterior region 88. In FIG. 6, the grouping of the correlation coefficients is illustrated in a two-dimensional array forming a region mask. In other embodiments, the correlation coefficients may be grouped into a different number of groups.

(31) In a further block 50 of steps (FIG. 2) predetermined numerical values are assigned to the grouped correlation coefficients.

(32) In a step 52 of this block 50 of steps (FIG. 7), each correlation coefficient is compared with a group-specific threshold value, and a predetermined numerical value is assigned to each correlation coefficient depending on the outcome of the comparison. In this specific embodiment, a predetermined numerical value of 0 is assigned if the correlation coefficient is smaller than the group-specific threshold value Th.sub.cc, and the predetermined numerical value of 1 is assigned if the correlation coefficient is equal to or larger than the group-specific threshold value. The result of the step 52 of assigning the predetermined numerical values to the correlation coefficients of the matrix 89 is a binary matrix 90 of same size.

(33) All predetermined/predefined values, threshold values and conditions mentioned herein may reside in the digital data memory unit 112 of the electronic control unit 108 and can readily be retrieved by the processor unit 110 of the electronic control unit 108.

(34) In a next step 60, for each group of correlation coefficients, a numerical indicator value 92 is calculated based on the predetermined numerical values that have been assigned to each correlation coefficient of the specific group. In this specific embodiment, this is carried out by calculating a sum of the numerical values that have been assigned to each correlation coefficient of a specific group; i.e. by summing up the “1”s for each group in the region mask.

(35) Then, a further block 70 of steps is executed for decision-making (FIG. 2).

(36) In steps 72, 74, 76 of this block 70 of steps (FIG. 8), each numerical indicator value 92 is compared to a predetermined group-specific indicator value threshold Th.sub.1, Th.sub.2, Th.sub.3. The indicator value thresholds Th.sub.1, Th.sub.2, Th.sub.3 are suitably defined in such a way that the method is sensitive to correlation in the interior 116 of the vehicle 114 as well as to distinguishing between movement of a person within the vehicle 114 and an interior or exterior interfering movement.

(37) In a final step 78, an output signal 128 is generated based on a result of the comparison for each group of correlation coefficients. Only if each numerical indicator value 92 falls below the predetermined group-specific indicator value threshold Th.sub.1, Th.sub.2, Th.sub.3 of its group of correlation coefficients, vital sign detection is confirmed and a corresponding output signal 128 is generated. If at least one of the numerical indicator values 92 is equal to or larger than the predetermined group-specific indicator value threshold Th.sub.1, Th.sub.2, Th.sub.3 of its group, vital sign detection is highly improbable, and a different corresponding output signal is generated.

(38) While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.

(39) Other variations to be disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality, which is meant to express a quantity of at least two. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting scope.