Safety electronic device for presence detection inside a vehicle
10814744 ยท 2020-10-27
Assignee
Inventors
Cpc classification
G01K1/14
PHYSICS
B60N2/002
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60N2/00
PERFORMING OPERATIONS; TRANSPORTING
B60Q5/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
An electronic device for detecting the presence of an occupant on board a vehicle includes an audio sensor to acquire sound-sensing signals on board the vehicle. A movement sensor acquires movement-sensing signals associated with movement of the vehicle and an environmental sensor acquires environmental-sensing signals on board the vehicle. A processing unit is coupled to the audio sensor, movement sensor, and environmental sensor processes the respective sound-sensing signals, movement-sensing signals, and environmental-sensing signals to monitor the presence on board the vehicle of the occupant and the absence of a responsible person to determine a situation of danger and to activate a corresponding alarm warning.
Claims
1. An electronic device, comprising: an audio sensor configured to acquire sound-sensing signals in a vehicle; a movement sensor configured to acquire movement-sensing signals indicating movement of the vehicle itself; an environmental sensor configured to acquire environmental-sensing signals in the vehicle; and a processing unit coupled to receive the sound-sensing signals, the movement-sensing signals, and the environmental-sensing signals from the audio sensor, the movement sensor, and the environmental sensor, respectively, and configured to determine presence of an occupant on board the vehicle based on the sound-sensing signals, movement-sensing signals, and environmental-sensing signals and to activate a corresponding alarm warning based on that the presence of the occupant being determined; wherein the processing unit is configured to evolve in a state of alert starting from a wait state in response to processing of at least the sound-sensing signals detecting the presence of the occupant on board the vehicle; and configured to evolve from the state of alert into a state of danger of a first level of danger in response to the processing detecting the presence of the occupant for a time interval longer than a time threshold, and wherein the corresponding alarm warning includes a first warning at the first level of danger and a second warning, the first warning including at least a remote communication directed to a responsible person, the second warning including in addition to the remote communication directed to the responsible person an activation of one or more of a sound or a light signals at the vehicle.
2. The electronic device according to claim 1, wherein the audio sensor comprises a MEMS microphone sensor; and wherein the processing unit is configured to process the sound-sensing signals in a time domain and/or in a frequency domain to identify in the sound-sensing signals patterns indicative of the presence of the occupant on board the vehicle.
3. The electronic device according to claim 2, wherein the movement sensor includes a MEMS accelerometer sensor and a MEMS gyroscope sensor and the movement-sensing signals include linear-acceleration signals and angular-acceleration signals; and wherein the processing unit is configured to process the movement-sensing signals to identify, in the signals, patterns indicative of a state of movement, or a state of stopping, of the vehicle.
4. The electronic device according to claim 1, wherein the environmental sensor includes a temperature sensor, and the environmental-sensing signals include a temperature signal indicative of a temperature on board the vehicle; and wherein the processing unit is configured to process the environmental-sensing signals to determine a situation of danger as a function of the temperature.
5. The electronic device according to claim 1, further comprising a communication unit configured to be controlled by the processing unit to transmit the alarm warning.
6. The electronic device according to claim 5, wherein the communication unit comprises a mobile data-communication module and an associated identification module configured to access to a cellular network.
7. The electronic device according to claim 1, wherein the processing unit is configured to evolve in the state of danger from the first level of danger to a second level of danger in response to processing of the environmental-sensing signals detecting the presence of an environmental condition that is at least potentially harmful for the occupant.
8. The electronic device according to claim 7, wherein the harmful environmental condition is associated with a temperature on board the vehicle higher than maximum first threshold or lower than a second threshold.
9. The electronic device according to claim 8, wherein the processing unit is further configured to evolve again into the wait state in response to the processing of at least the movement-sensing signals detecting a condition of movement of the vehicle.
10. The electronic device according to claim 9, wherein the second warning is issued in response to the second level of danger.
11. The electronic device according to claim 1, further comprising an electronic-circuit board to which a number of chips are coupled, each chip being provided with a corresponding package, and the number of chips integrating the audio sensor, the movement sensor, the environmental sensor and the processing unit on the electronic-circuit board.
12. The electronic device according to claim 11, wherein the electronic-circuit board is configured to be integrated in a safety and restraint device for the occupant on board the vehicle.
13. The electronic device according to claim 11, wherein the electronic-circuit board is configured to be integrated in an on-board electronic system of the vehicle.
14. The electronic device according to claim 1, wherein the occupant is a child.
15. A device, comprising: an electronic detection circuit including: an audio sensor that in operation senses sound signals in a passenger compartment of a vehicle; a movement sensor that in operation senses movement signals indicating movement of the vehicle itself; an environmental sensor that in operation senses environmental signal of an environmental condition of the passenger compartment; and a processing circuit coupled to the audio, movement and environmental sensors and that in operation processes the sound, the movement, and the environmental signals to determine a presence of an occupant in the passenger compartment, and that in operation activates an alarm warning the based on the detected presence of the occupant; wherein the processing circuit is configured to evolve in a state of alert starting from a wait state in response to processing of at least the sound signals detecting the presence of the occupant on board the vehicle; and configured to evolve from the state of alert into a state of danger of a first level of danger in response to the processing detecting the presence of the occupant for a time interval longer than a time threshold; and wherein the alarm warning includes a first warning at said first level of danger and a second warning, the first warning including at least a remote communication directed to a responsible person, the second warning including in addition to said remote communication directed to the responsible person an activation of one or more of a sound or a light signals at the vehicle.
16. The device of claim 15 wherein the electronic detection circuit is attached to a baby seat.
17. A method, comprising: acquiring sound-sensing signals on board a vehicle; acquiring movement-sensing signals indicating the movement of the vehicle itself; acquiring environmental-sensing signals on board the vehicle; processing the sound-sensing signals, the movement-sensing signals, and the environmental-sensing signals to detect a presence of an occupant on board the vehicle; determining a situation of danger responsive to the processing of the sound-sensing, the movement-sensing, and the environmental-sensing signals; activating an alarm warning in response to the determining indicating the situation of danger; starting from a wait state, transitioning into a state of alert based on the processing of at least the sound-sensing signals detecting the presence of the occupant on board the vehicle; and transitioning from the state of alert into a state of danger having a first level of danger based on the processing detecting the presence of the occupant on board the vehicle for a time interval that exceeds a time threshold, wherein the corresponding alarm warning includes a first warning corresponding to the first level of danger and a second warning, the first warning including at least a remote communication directed to a responsible person, the second warning including in addition to the remote communication directed to the responsible person an activation of one or more of a sound or a light signals at the vehicle.
18. The method according to claim 17, wherein the processing further comprises transitioning from the state of danger having the first level of danger to the state of danger having a second level of danger based on the processing of the environmental-sensing signals detecting presence of an environmental condition harmful to the occupant and the second warning corresponds to the second level of danger.
Description
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
(1) For a better understanding of the present disclosure preferred embodiments thereof are now described, purely by way of non-limiting example, with reference to the attached drawings, wherein:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9) As will be clarified in detail hereinafter, one aspect of the present solution envisages exploiting semiconductor technology, in particular MEMS technology, to provide an integrated electronic device capable of: detecting a number of quantities inside the passenger compartment of the vehicle, via appropriate sensors; and jointly processing the values detected for said quantities with a suitable processing algorithm in order to detect the presence of an occupant of the vehicle (for example, a baby or young child) left alone inside the same vehicle, assess the potential danger of the situation and, if need be, generate an appropriate alarm or warning to warn of the situation of danger.
(10)
(11) In the embodiment of
(12) The electronic detection device 1 may further comprise an interface unit 8 configured to enable interfacing with an ECU (Electronic Control Unit) of the vehicle, for example in order to activate a vehicle alarm in the case where a condition of danger is detected, or else to interface with a data-communication unit of the same vehicle.
(13) The electronic detection device 1 may further be provided with an autonomous supply source (here not illustrated), for example a battery source, designed to supply a voltage for operation of the electronic detection device 1; the autonomous supply source may be coupled to a supply source of the vehicle and provided with a recharging function using the same supply source of the vehicle, when the engine is running.
(14) The electronic detection device 1 may further be provided with its own alarm warning means (not illustrated), via emission of sounds or light warnings, controlled by the processing unit 5 and activated upon detection of a condition of alarm.
(15) As illustrated schematically in
(16) The electronic detection device 1 may be provided as an autonomous stand-alone device that is to be appropriately coupled to the vehicle to be monitored, including after-market installations.
(17) Moreover, as illustrated schematically in
(18) In a possible alternative solution, illustrated schematically in
(19) The features of the electronic detection device 1 are now described in greater detail.
(20) The audio sensor 2, in particular the MEMS microphone sensor, is designed to detect audio signals indicating the presence on board the vehicle 12 of the driver (i.e., of the adult, parent, or in any case person responsible for the occupant) and/or of the occupant, or occupants (for example, a child or an animal).
(21) The above audio signals may be suitably processed by the processing unit 5 of the electronic detection device 1, for example with techniques (in themselves known and not described in detail herein) of recognition of characteristic patterns for identification, for example, of sounds that characterize the speech of the adult or the crying of the child (or the characteristic sound of an animal, for example the barking of a dog).
(22) The audio sensor 2 may further enable detection and identification of sounds associated with movement of the vehicle 12, for example the sound of the engine running, or the noise of rolling of the wheels, in this way contributing to monitoring the state of movement of the same vehicle 12, as discussed hereinafter.
(23) Purely by way of example,
(24) The above plots, provided by way of example, illustrate the different characteristic patterns of the aforesaid signals and hence how it is effectively possible, via analysis of the audio signals in the time and frequency domains, to discriminate and recognize the different sources of sounds inside the vehicle 12.
(25) In particular, the processing unit 5 may be configured to acquire the audio signals detected by the audio sensor 2 and to implement appropriate decision tools, such as decision trees, neural networks, and appropriate tools of analysis in the time domain, such as analysis of the temporal repeatability of the signal, or in the frequency domain, such as analysis of the predominant frequency or analysis of the spectral components in various bands of interest (for example, via analysis of the so-called octave-relative power spectrum).
(26) In this regard,
(27) The audio sensor 2 may further comprise a microphone sensor dedicated to operations (of a per se known type, here not described) of noise cancelling. For example, the microphone sensor may be dedicated to the specific detection of the noise of the engine of the vehicle 12 in order to enable elimination thereof from the resulting audio signal and facilitate recognition of the components associated with the driver and the occupant of the vehicle 12, during processing of the respective signals.
(28) The movement sensor 3, in particular including the accelerometer sensor 3a and the gyroscope sensor 3b, is designed to enable detection of movement of the vehicle 12. Furthermore, in addition to this function, the movement sensor 3, appropriately located, may also detect the movement of the occupant of the vehicle 12, for example the movements of the child, and/or the movement of the driver, in order to contribute to presence detection on board the same vehicle 12.
(29) The environmental sensor 4 is designed to monitor the environmental conditions on board the vehicle 12 in order to identify a condition of danger for the occupant (or occupants). For instance, the environmental sensor 4, as mentioned previously, may include a temperature sensor, designed to detect the temperature in the vehicle 12, which, if higher than an upper threshold (designated in what follows by T.sub.LIM_H), or lower than a lower threshold (designated in what follows by T.sub.LIM_L), is indicative of a condition of environmental stress (e.g., too hot or too cold).
(30) In addition, or as an alternative, the environmental sensor 4 may include different and further sensors aimed at identification of the condition of danger inside the vehicle 12, such as a gas sensor (designed to identify harmful gaseous species in the air), a humidity sensor and/or a pressure sensor.
(31) The processing unit 5, as mentioned previously, is designed to acquire the various signals detected by the audio, movement, and environmental sensors 2, 3, and 4, and to implement an appropriate sensor-fusion algorithm for promptly detecting the situation of danger for the occupant of the vehicle 12, activating appropriate actions of alarm (for example, remote communication to the person responsible, or local activation of visual or sound alarms).
(32) With reference to
(33) In detail, in the first state 20, the processing unit 5 detects the state of movement of the vehicle 12, with the engine running; the processing unit 5 thus presumes the presence of a person responsible on board (the driver, an adult) and hence the absence of danger for the occupant (or occupants).
(34) Monitoring of the first state is implemented substantially using the movement sensor 3; the audio sensor 2 may be used, in addition to the movement sensor 3, for detecting the movement of the vehicle 12 and the condition of running of the engine of the same vehicle 12, or otherwise may be set in an inactive or low-consumption state; also the other unused components of the electronic detection device 1 (amongst which the environmental sensor 4, or the communication unit 6) may be set in the inactive state, so as to limit the overall power consumption.
(35) From the first state 20 the processing unit 5 transitions or evolves to the second state 22, when it determines that the vehicle 12 has stopped; likewise, from the second state 22, the processing unit 5 transitions or returns to the first state 20, when it determines that the vehicle 12 is again moving.
(36) In the second state 22, the processing unit 5 hence detects that the vehicle 12 is stationary (absence of movement and engine off), and hence enters a state of alert, in which it monitors the onset of conditions of alarm that may lead to the state of danger, i.e., the presence of the child (or animal or, in general, other occupant) left alone inside the vehicle 12, in the absence of the person responsible, namely, the driver.
(37) Monitoring of this second state 22 is basically carried out by continuous acquisition and processing of the signals coming from the audio sensor 2 in order to detect the presence of the driver and/or of the occupant in the vehicle 12; the movement sensor 3 may be used, in addition to the audio sensor 2, for presence detection, or otherwise may be set in an inactive or low-consumption state, as likewise the other unused components of the electronic detection device 1, so as to limit also in this case power consumption.
(38) From the second state 22 the processing unit 5 transitions or evolves to the third state 24, i.e., the state of alarm, when it determines the persistence of the condition of potential danger for the occupant, who is left alone inside the vehicle 12 in the absence of the responsible person, for a time interval the duration of which exceeds an alarm threshold of a pre-set value, for example of some minutes (e.g., five minutes); from the third state 24 the processing unit 5 returns to the second state 22, when the state of alarm is deactivated. In particular, it may be required that deactivation of the state of alarm should be carried out manually by the responsible person, for example by the driver of the vehicle 12, so as to increase safety and reliability of the electronic detection device 1.
(39) In detail, in the third state 24, the processing unit 5, upon activation of the state of alarm, determines the presence of a first level of alarm, corresponding to the permanence of the occupant (for example, the child) alone inside the vehicle 12 in the absence of the driver for a time interval longer than the pre-set alarm threshold (exceeding of the threshold indicates a possible situation of risk for the occupant). The first level of alarm entails activation of a first alarm warning by the detection unit 5, for example activation of a communication to the responsible person by the communication unit 6, including, for example, sending via the GSM module of an SMS (Short Message Service) message.
(40) The processing unit 5, which continues to monitor the situation of danger, in real time, then determines the presence of a second level of alarm in the case where the signals supplied by the environmental sensor 4 indicate a harmful environmental condition, for example in the case where the temperature detected has a given relation with an alarm threshold (for example, it is higher than the upper threshold, T>T.sub.LIM_H, indicating a condition of too hot, or lower than the lower threshold T<T.sub.LIM_H, indicating a condition of too cold).
(41) The second level of alarm entails activation of a second alarm warning by the detection unit 5, for example via activation of every available alarm, locally at the vehicle 12 (via activation of sound and visual alarms) and remotely via communication by the communication unit 6 to the responsible person and/or to further subjects authorized for emergency interventions.
(42) In greater detail, and as illustrated in
(43) The second state 22, as illustrated in
(44) In an evident way, from the first sub-state 22a the processing unit 5 transitions or evolves to the second sub-state 22b in the case of detection of the presence of the occupant, and from the second sub-state 22b it transitions or evolves to the first sub-state 22a if no occupant is detected inside the vehicle 12. Likewise, from the second sub-state 22b it transitions or evolves to the third sub-state 22c in the case of detection of the presence of the driver, and from the third sub-state 22c it transitions or evolves to the second sub-state 22b if the presence of the driver inside the vehicle 12 is not detected.
(45) If the second sub-state is maintained for a time interval longer than the alarm threshold (here designated by t.sub.LIM), the processing unit 5 transitions or evolves to the third state 24, whereas detection of movement of the vehicle 12 determines at any moment return to the first state 20, in so far as it is presumed that the driver, an adult, is present inside the vehicle 12.
(46) As previously mentioned, in this second state 22 there is a continuous monitoring of the signals supplied by the audio sensor 2 in order to implement recognition of the occupant and of the driver. The signals acquired by the movement sensor 3 may further be monitored, for example by pattern-recognition techniques, as previously discussed.
(47) The third state 24, as illustrated in
(48) The third state 24 further envisages a second sub-state 24b, in which the processing unit 5 determines the presence of the second level of alarm and activation of the second alarm warning, for example, via activation of sound and visual alarms or remote communication to the responsible person and/or to further subjects.
(49) As is evident from what has been discussed previously, from the first sub-state 24a the processing unit 5 transitions or evolves to the second sub-state 24b in the case of detection of critical environmental conditions, for example in the case where the temperature is higher than the upper threshold (T>T.sub.LIM_H); from the second sub-state 24b it transitions or evolves to the first sub-state 24a if the absence of critical environmental conditions is detected, for example in the case where the temperature is below the upper threshold (T<T.sub.LIM_H). It should be noted that a hysteresis may be applied in the threshold detection, considering for the first comparison a maximum upper value, higher than the upper threshold T.sub.LIM_H, and a minimum upper value, lower than the upper threshold T.sub.LIM_H, for the second comparison. Evidently, other conditions may further be applied for the detection of the critical environmental conditions, for example a value of temperature below the lower threshold T.sub.LIM_L, or else the presence of a particular gas in the passenger compartment 11, or again a value of pressure higher than a given threshold.
(50) As previously mentioned, it may be envisaged that only manual intervention will enable exit from the third state 24 (state of alarm) and return to the second state, the state of alert.
(51) The advantages of the present solution are clear from the foregoing description.
(52) In any case, it is again highlighted that the proposed solution is reliable and safe in the detection of presence of an occupant (for example, a child or an animal) left alone inside the vehicle in the absence of a person responsible, enabling prompt detection of a condition of danger and activation of an alarm warning. In particular, the combined use of several types of sensors (amongst which audio sensors, movement sensors, and environmental sensors) enables acquisition of a plurality of information, in particular sound information, movement information, and environmental information, joint processing of which affords the desired results of reliability and safety.
(53) Furthermore, the solution described is technically simple to implement and has a low cost, hence favoring integration both inside the vehicle and in restraint devices for vehicle occupants (for example, baby seats) and for installation as a stand-alone device (i.e., after-market installation).
(54) Finally, it is clear that modifications and variations may be made to what has been described and illustrated herein, without thereby departing from the scope of the present disclosure.
(55) In particular, as previously highlighted, it is emphasized that different types of sensors could be used in the detection device; for example, the audio sensor 2 could comprise an array of microphone sensors; the movement sensor 3 could include just one between the accelerometer sensor 3a and the gyroscope sensor 3b; or the environmental sensor 4 could include different sensors for monitoring environmental conditions (for example, a gas sensor).
(56) As previously highlighted, the sound-recognition algorithms may be applied also to animals or persons with disabilities, there possibly being envisaged specific sound patterns included in the different use scenarios.
(57) Furthermore, the electronic detection device 1 may include further analysis units, coupled to the processing unit 5, for execution of specific processing on the signals acquired by the sensors, in this way aiding the detection unit 5: for example, a unit for analyzing audio signals (audio analyzer) could be envisaged, in order to implement dedicated analysis algorithms and possibly further improve the performance of the electronic detection device 1.
(58) The various embodiments described above can be combined to provide further embodiments. These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.