System and method for detecting an impending tip over of a vehicle
10507826 ยท 2019-12-17
Assignee
Inventors
- Carlos Maximiliano Giorgio Bort (Levico Terme, IT)
- Claudio Maffei (Tenno, IT)
- Alessandro Massei (Riva del Garda, IT)
- Giulio ORNELLA (Arco, IT)
- Lorenzo Serrao (Nago-Torbole, IT)
Cpc classification
B60W50/14
PERFORMING OPERATIONS; TRANSPORTING
B60W30/04
PERFORMING OPERATIONS; TRANSPORTING
B60W50/12
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60G17/016
PERFORMING OPERATIONS; TRANSPORTING
G06F17/00
PHYSICS
B60W30/04
PERFORMING OPERATIONS; TRANSPORTING
G06F7/00
PHYSICS
B62C3/00
PERFORMING OPERATIONS; TRANSPORTING
B66F17/00
PERFORMING OPERATIONS; TRANSPORTING
B60W50/12
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A method and system of detecting an impending tip over of a vehicle with the following steps and apparatus. Acquiring first measurement data, the first measurement data having strain data and at least one of attitude data and acceleration data. Acquiring second measurement data, the second measurement data having strain data and at least one of attitude data and acceleration data. Determining, based on the first measurement data and based on the second measurement data, if the second measurement data is indicative of an impending tip over of the vehicle. Only if it is determined that the second measurement data is indicative of an impending tip over of the vehicle, triggering an alarm signal, overriding a control command or overwriting a control command.
Claims
1. A method of detecting an impending tip over of a vehicle, in particular for identifying false positives during tip over detection, the method comprising the steps: acquiring first measurement data using at least one first sensor, the first measurement data comprising vehicle axle strain data, and at least one of attitude data and acceleration data; acquiring second measurement data using at least one second sensor, the second measurement data comprising vehicle axle strain data, and at least one of attitude data and acceleration data; using an electronic control unit to determine, based on the first measurement data and based on the second measurement data, if the second measurement data is indicative of an impending tip over of the vehicle; and only when the electronic control unit determines that the second measurement data is indicative of an impending tip over of the vehicle, using the electronic control unit to trigger an alarm signal, to override a control command or to overwrite a control command.
2. The method of claim 1, wherein the step of acquiring the first measurement data using the at least one first sensor comprises using the at least one first sensor to acquire a plurality of first data sets, wherein for each of the first data sets acquiring the first data set comprises acquiring, at the same point in time, vehicle axle strain data, and at least one of attitude data and acceleration data; wherein the electronic control unit saves those first data sets of the plurality of first data sets which are indicative of an impending tip over of the vehicle in a database and marks them with a first label; and wherein the electronic control unit determines if the second measurement data is indicative of an impending tip over based on the second measurement data and at least on the first data sets marked with the first label.
3. The method of claim 2, the electronic control unit identifies a first data set of the plurality of first data sets as being indicative of an impending tip over and marks it with the first label based on an input command provided by an operator.
4. The method of claim 2, wherein the electronic control unit automatically identifies a first data set of the plurality of first data sets as being indicative of an impending tip over and wherein the electronic control unit automatically marks said first data set with the first label when at least one the values, measured by the at least one first sensor and comprised in said first data set falls outside a predetermined range.
5. The method of claim 2, wherein the electronic control unit saves the first data sets which are not indicative of an impending tip over in the database and marks them with a second label; and wherein the electronic control unit determines if the second measurement data is indicative of an impending tip over based on the second measurement data, on the first data sets, and on the labels assigned to the first data sets.
6. The method of claim 2, wherein the step of acquiring the second measurement data using the at least one second sensor comprises using the at least one second sensor to acquire a second data set, wherein acquiring the second data set comprises acquiring, at the same point in time, vehicle axle strain data, and at least one of attitude data and acceleration data; and wherein the step of the electronic control unit determining if the second measurement data is indicative of an impending tip over comprises: using the electronic control unit to determine, based on the first data sets marked with the first label, at least one continuous subset of a measurement data space, the measurement data space comprising the first data sets and the second data set, wherein the electronic control unit determines the continuous subset such that the continuous subset does not comprise the data sets labeled with the first label; and using the electronic control unit to identify the second data set as being indicative of an impending tip over if the second data set falls outside the continuous subset, and using the electronic control unit to identify the second data set as not being indicative of an impending tip over when the second data set falls within the continuous subset.
7. The method of claim 6, wherein the step of acquiring the second measurement data using the at least one second sensor comprises using the at least one second sensor to acquire a second data set, wherein acquiring the second data set comprises acquiring, at the same point in time, vehicle axle strain data, and at least one of attitude data and acceleration data; and wherein, when the electronic control unit determines that the second data set is indicative of an impending tip over and when the electronic control unit determines that the second data set does not fall within a neighborhood of any of the data sets labeled with the first label, the electronic control unit updates the database by saving the second data set in the database and by labeling the newly saved second data set with the first label.
8. The method of claim 6, wherein the step of acquiring the second measurement data using the at least one second sensor comprises using the at least one second sensor to acquire a second data set, wherein acquiring the second data set comprises acquiring, at the same point in time, vehicle axle strain data, and at least one of attitude data and acceleration data; and wherein, when the electronic control unit determines that the second data set is indicative of an impending tip over, when the electronic control unit determines that the second data set falls within a neighborhood of a data set X saved in the database and labeled with the first label, and when the electronic control unit determines that a frequency of the event that a second data set falls within the neighborhood of the data set X is above a threshold frequency, the electronic control unit updates the database by re-labeling the data set X with the second label.
9. The method of claim 6, further including the step of: using the electronic control unit to update the continuous subset such that the updated continuous subset does not comprise the data sets labeled with the first label.
10. A sensor system for detecting an impending tip over of a vehicle, and in particular for identifying false positives during tip over detection, the sensor system comprising: at least one strain sensor for acquiring vehicle axle strain data; at least one further sensor, the further sensor comprising at least one of a gyrometer for acquiring attitude data and an accelerometer for acquiring acceleration data; and a control unit; wherein the sensors are configured to acquire first measurement data and second measurement data, the first measurement data and the second measurement data each including vehicle axle strain data, and at least one of attitude data and acceleration data; and wherein the control unit is configured to control the strain sensor and the at least one further sensor.
11. The sensor system of claim 10, further comprising at least one of: one or more steering sensors for acquiring vehicle steering data; one or more speed sensors for acquiring vehicle speed data; one or more tire pressure sensors for acquiring tire pressure data; and an input device for controlling a working implement of the vehicle; wherein the first and the second measurement data include at least one of vehicle steering data, vehicle speed data, tire pressure data and working implement control data.
12. The sensor system of claim 10, wherein the strain sensor includes at least two strain gauges disposed on a common mechanical support, wherein the strain gauges are spaced apart from each other so that the strain gauges are configured to simultaneously acquire vehicle axle strain data at different positions on a vehicle axle.
13. The sensor system of claim 12, wherein the strain sensor, the at least one further sensor and the control unit are disposed on the common mechanical support, thereby forming a sensor platform.
14. The sensor system of claim 13, comprising two or more sensor platforms of the aforementioned type, the sensor platforms being configured to exchange data with each other, thereby forming a distributed sensor network.
15. The sensor system of claim 14, further comprising a central vehicle control unit and a CAN bus, wherein one of the sensor platform control units is configured to function as a master control unit of the sensor network, wherein the master control unit is configured to communicate with the central vehicle control unit via the CAN bus.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Preferred embodiments of the presently proposed system and method are described in the following detailed description and are depicted in the accompanying drawing in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
DETAILED DESCRIPTION OF THE INVENTION
(17)
(18) The sensor system 7 includes sensor platforms 8a-d disposed mid-length on different semi axles of the front axle 2 and of the rear axle 3, a steering sensor 9 for detecting a steering angle of the vehicle 1, speed sensors 10a-d for measuring a speed of the wheels 4a-d and a tire pressure sensor 11 for detecting a pneumatic pressure of the tires. In alternative embodiments the sensor system 7 may include a smaller number of sensor platforms. However, the sensor system 7 generally includes at least one sensor platform of the type described herein. Also, in alternative embodiments the sensor system 7 may include none of the sensors 9, 10a-d, 11 or only some of them.
(19) The sensor system 7 further includes a central vehicle control unit 12 and a CAN bus 13. The sensor platforms 8a-d, the sensors 9, 10, 11 and the central vehicle control unit 12 are mutually connected through the CAN bus 13, thereby forming a distributed sensor network. Specifically, the sensor platforms 8a-d, the sensors 9, 10, 11 and the central vehicle control unit 12 may exchange measurement data and/or processed measurement data through the CAN bus 13. The sensor system 7 further includes an alarm device (not shown) which is configured to trigger an alarm when the sensor system 7 detects that the vehicle 1 is in danger of tipping over. The alarm device may be configured to trigger an optical alarm signal or an acoustic alarm signal, for example.
(20) The central vehicle control unit 12 may include one or more input devices through which an operator of the vehicle 1 may control the dynamics of the vehicle 1, the working hydraulics of the vehicle 1 including the boom 6, and the sensor system 7. The central vehicle control unit 12 may further include an electronic control unit such as a microprocessor or an FPGA configured to send electronic control signals to the sensor platforms 8a-d, to the sensors 9, 10, 11 of the sensor system 7 and to one or more actuators for controlling the movement of the boom 6.
(21) The input devices of the central vehicle control unit 12 configured to control the dynamics of the vehicle 1 may include at least one of a steering wheel, an accelerator pedal, a brake and a speed direction changing device. The input devices for controlling the working hydraulics of the vehicle 1 including the boom 6 may comprise at least one of a joystick, a touchscreen, knobs, switches, levers, pedals or the like. The input devices for entering control commands aimed at controlling the sensor system 7 may likewise include at least one of a joystick, a touchscreen, knobs, switches, levers, pedals or the like.
(22)
(23) The sensor platform 8c comprises a mechanical support 14, an electronic control unit 15, a strain sensor 16 and an inertia measurement unit (IMU) 17. The control unit 15, the strain sensor 16 and the IMU 17 are disposed on and attached to the common mechanical support 14. The strain sensor 16 is configured to measure a mechanical strain of the rear axle 3. Specifically, the strain sensor 16 includes two elongate strain gauges 16a, 16b arranged in a plane and spaced apart from one another. The IMU 17 includes a microelectromechanical accelerometer 17a and a microelectromechanical gyrosensor or gyrometer 17b. The accelerometer 17a is configured to measure an acceleration of the platform 8c along an x-axis 18, along a y-axis 19 and along a z-axis 20, wherein the axes 18, 19, 20 span a right-handed Cartesian coordinate system. The gyrometer 17b is configured to measure a pitch angle and a roll angle of the platform 8c with respect to the horizon, wherein the pitch angle designates an angle of rotation with respect to the x-axis 18 and the roll angle designates an angle of rotation with respect to the y-axis 19.
(24) During operation of the sensor system 7 one of the control units of the sensor platforms 8a-d, for example the control unit 15 of the sensor platform 8c, may function as a master control unit of the sensor network, wherein the master control unit is configured to communicate with the central vehicle control unit 12 via the CAN bus 13. The control units of the remaining sensor platforms 8ab and 8d may then send the measurement data acquired by means of their sensors to the master control unit 15 of the sensor platform 8c. The master control unit may then fuse and process the measurement data acquired by means of the sensor platforms 8a-d and by means of at least one of the steering sensor 9, the speed sensors 10a-d and tire pressure sensor 11. In particular, the master control unit may be configured to process the acquired measurement data and detect an impending tip over of the vehicle 1, as described further below.
(25) In order to increase the robustness of the sensor network, each of the control units of the sensor platforms 8a-d may be configured to function as the master control unit of the sensor network. The central vehicle control unit 12 may be configured to test a health status of each of the control units of the sensor platforms 8a-d and to select, based on the health status of the sensor platform control units, one of the sensor platform control units as the master control unit of the sensor network. This allows replacing the current master control unit in case this master control unit is malfunctioning, for example. In order to test the health status of the platform control units, the central vehicle control unit 12 and/or the platform control units may be configured to send health status monitoring messages to the other platform control units via the common CAN bus 13. The health status of a given platform control unit may comprise a score that is based on the number of responses of that platform control unit to the health status monitoring messages received by that platform control unit.
(26)
(27) In
(28) In
(29) In addition to the parallel strain gauges 16a, 16b or as an alternative to the parallel strain gauges 16a, 16b the sensor platform 8c may include three or more strain gauges arranged in a planar star-like or rosette-like formation. Rosette-like strain gauge arrangements of this sort, which are generally known in the art, allow the computation of the principal components of the planar strain tensor. Non-vertical loads caused by vehicle dynamics such as traction and cornering and/or caused by road characteristics are known to affect the orientation and the module of the principal components of the planar strain tensor. Therefore, additional information regarding vehicle dynamics and road characteristics may be extracted from a mechanical strain measured by a rosette-type strain sensor.
(30) The sensor system 7 is configured to perform a method capable of detecting an impending tip over of the vehicle 1 with improved specificity as compared to tip over detection systems and methods known from the prior art. The method includes the application of a machine learning algorithm. During a first learning phase, also termed supervised learning phase, an operator may drive the vehicle 1 on a training ground and expose the vehicle 1 to a plurality of safe situations in which the vehicle 1 is stable and to a plurality of dangerous situations in which the vehicle 1 is in danger of tipping over. Preferably, during the supervised learning phase the operator exposes the vehicle 1 to a number of situations in which the vehicle 1 is stable and not in danger of tipping over and in which the axles 2, 3 of the vehicle 1 are deformed by normal maneuvers such as driving the vehicle 1 around a bend or driving the vehicle 1 on a slope. In many such cases, tip over detection systems known from the prior art would trigger a false alarm by alerting the operator of the vehicle 1 to an impending tip over, because these known systems are not capable of distinguishing a deformation of the axles 2, 3 caused by a shift of the center of mass of the vehicle 1 from a deformation of the axles 2, 3 caused by traction forces, steering forces or the like. The operator of the vehicle 1 may mark the beginning and the end of the supervised learning phase by entering corresponding input commands through the central vehicle control unit 12, for example.
(31) As the vehicle 1 is driven on the training ground during the supervised learning phase, the master control unit of the sensor system 7, for example the control unit 15 of the sensor platform 8c, controls the strain sensors and the IMUs of the sensor platforms 8a-d and optionally at least one of the steering sensor 9, the speed sensors 10a-d and the tire pressure sensor 11 to acquire first measurement data. The master control unit 15 then processes the first measurement data and stores the first measurement data and/or the processed first measurement data in the data storage device of the control unit 15.
(32) The first measurement data comprises a plurality of data sets p.sub.1, . . . , p.sub.k (k being a positive integer index), each of comprises a plurality of measured values. The measured values comprised in a given data set of the data sets p.sub.1, . . . , p.sub.k are measured or acquired at the same time. For example, the measured values included in the data set p.sub.1 are measured at a point in time t.sub.1, the measured values included in the data set p.sub.2 are measured at a point in time t.sub.2, the measured values included in the data set p.sub.3 are measured at a point in time t.sub.3, etc. where t.sub.1<t.sub.2<t.sub.3 and so on.
(33) The measured values comprised in the data sets p.sub.1, . . . , p.sub.k include: deformation values measured by the strain sensors of the sensor platforms 8a-d, acceleration values measured by the accelerometers of the sensor platforms 8a-d, attitude values measured by the gyrometers of the sensor platforms 8a-d, a steering angle of the vehicle 1 measured by the steering sensor 9, speed values measured by the speed sensors 10a-d and tire pressure values measured by the tire pressure sensor 11. In alternative embodiments the data sets p.sub.1, . . . , p.sub.k may include fewer measurement values or additional measurement values. However, the data sets p.sub.1, . . . , p.sub.k typically include at least one or more strain values or deformation values and at least one of an acceleration value and/or an attitude value. It is likewise conceivable that the data sets p.sub.1, . . . , p.sub.k include data which is derived from the above described measured values. For instance, the data sets p.sub.1, . . . , p.sub.k may comprise the differential strain 11c mentioned above. Additionally or alternatively the data sets p.sub.1, . . . , p.sub.k may comprise a rate of change of the measured values derived from data sets which are acquired shortly after one another. For example, the data sets p.sub.1, . . . , p.sub.k may comprise a first, second or higher derivative of the deformation of the axles 2, 3 or of the pitch angle and/or the of roll angle of the vehicle 1.
(34)
(35) Specifically,
(36) In
(37) In
(38) In
(39) During the supervised learning phase depicted in
(40) Furthermore, the master control unit 15 assigns one of a first label and a second label to each of the data sets p.sub.1, . . . , p.sub.k acquired during the supervised learning phase. A data set of the plurality of data sets p.sub.1, . . . , p.sub.k is assigned the first label if the corresponding data set is associated with an impending tip over of the vehicle 1. By contrast, a data set of the plurality of data sets p.sub.1, . . . , p.sub.k is assigned the second label if the corresponding data set is associated with the vehicle 1 being stable. The labels assigned to the data sets p.sub.1, . . . , p.sub.k are saved in the database along with the data sets p.sub.1, . . . , p.sub.k.
(41) A given data set of the plurality of data sets p.sub.1, . . . , p.sub.k acquired during the supervised learning phase may be identified as being indicative of an impending tip over and marked with the first label based on an input command from the operator of the vehicle 1. For example, the operator may manually enter a corresponding input command through the central vehicle control unit 12 once one or more of the wheels 4a-d of the vehicle 1 start lifting from the ground. Also, the master control unit 15 may display at least some of the values measured by the sensor platforms 8a-d and/or the sensors 9, 10a-d, 11 or values derived from the measured values on an output device of the central vehicle control unit 12, and the operator may manually enter an input command to label the corresponding data set with the first label if one or more of the measured values or of the values derived from the measured values falls outside a predetermined range. For example, when one or more of the measured values or the of the values derived from the measured values falls outside the predetermined range during the supervised learning phase, the master control unit 15 may alert the operator by triggering an alarm signal, such as an optical alarm signal and/or an acoustic alarm signal.
(42) It is likewise conceivable that the master control unit 15 of the sensor system 7 automatically marks a given data set of the plurality of data sets p.sub.1, . . . , p.sub.k acquired during the supervised learning phase as dangerous by labeling it with the first label if one or more of the measured values comprised in that data set or if one or more of the values derived from the measured values comprised in that data set (such as the differential strain or a rate of change of one or more of the measured values) falls outside a predetermined range or outside a predetermined subset of a measurement data space, wherein the measurement data space is a multidimensional (vector) space that includes the data sets p.sub.1, . . . , p.sub.k. A dimension n (n being a positive integer) of the measurement data space corresponds to the number of measured values and/or derived values which are comprised in each of the data sets p.sub.1, . . . , p.sub.k.
(43) The data sets acquired during the supervised learning phase which are associated with the vehicle 1 being stable may be marked with the second label manually or automatically in an analogous manner. Typically, the master control unit 15 automatically marks a given data set of the plurality of data sets p.sub.1, . . . , p.sub.k with the second label by default unless it is marked with the first label as described above.
(44) In
(45) Typically, the region or regions of the n-dimensional measurement data space which represent data sets associated with dangerous situations form one or more first continuous subsets of the n-dimensional measurement data space. Analogously, the region or regions of the n-dimensional measurement data space which represent data sets associated with safe situations form one or more second continuous subsets of the n-dimensional measurement data space, wherein the first and the second continuous subsets are disjoint or complementary subsets of the n-dimensional measurement data space. To identify these disjoint or complementary continuous subsets the master control unit 15 runs a classification algorithm which determines the generally n-dimensional geometry of the first and the second continuous subspace.
(46)
(47) It is conceivable that the master control unit 15 determines the geometry of the first subset 75 and of the second subset 76 based on the data sets 72 associated with dangerous situations only. For example, the master control unit 15 may determine the geometry of the first subset 75 such that the boundary 74 encloses the data sets 72 and minimizes the n-dimensional volume of the first subset 75.
(48) In general, the continuous subsets 75, 76 are n-dimensional subsets of the n-dimensional measurement data space and the boundary 74 separating the first continuous subset 75 from the second continuous subset 76 comprises one or more continuous (n1)-dimensional subsets embedded in the n-dimensional measurement data space. In
(49) Once the master control unit 15 has determined the continuous subsets 75, 76 the sensor system 7 is ready to be used for tip over detection during normal operation of the vehicle 1, as illustrated in
(50) In
(51) If the newly acquired second data set falls within the first continuous subset 75 the master control unit 15 classifies the newly acquired second data set as being indicative of an impending tip over of the vehicle 1. In this case, the master control unit 15 triggers a warning signal to alert the operator of the vehicle 1. Additionally or alternatively, the master control unit 15 may override or overwrite an input command entered by the operator. For example, if the master control unit 15 detects that the vehicle 1 is in danger of tipping over due to an over-extension of the boom 6, the master control unit 15 may send an electronic signal to the central vehicle control unit 12 to command the central vehicle control unit 12 to immediately inhibit any further extension of the boom 6 or to immediately cause the boom 6 to be pulled in to prevent the vehicle 1 from tipping.
(52) After the master control unit 15 has classified the newly acquired second data set as being indicative of an impending tip over, the master control unit 15 labels this newly acquired second data set with the first label and saves this newly acquired second data set including the label in the database. In
(53) By contrast, if a second data set acquired during normal operation of the vehicle 1 falls within the second continuous subset 76, the master control unit 15 classifies this second data set as not being indicative of an impending tip over of the vehicle 1. The master control unit 15 then labels this newly acquired second data set with the second label and saves the newly acquired second data set including the label in the database. In
(54) The master control unit 15 of the sensor system 7 may use the second data sets 77, 78 acquired during normal operation of the vehicle 1, i. e. after completion of the supervised learning phase, to continuously update the classifier. For this reason, the phase of the learning algorithm following the completion of the supervised learning phase and executed during normal operation of the vehicle 1 may be termed reinforcement learning phase. Specifically, the master control unit 15 may use the second data sets 77, 78 to update the geometry of the continuous subsets 75, 76, in particular the geometry or shape of the boundary 74 separating the continuous subsets 75, 76, each time one or more newly acquired second data sets 77, 78 have been added to the database. Updating the geometry of the continuous subsets 75, 76 may include determining the geometry of the continuous subsets 75, 76 based on the updated database, that is based on the (n-dimensional) positions of the data sets saved in the updated database and based on the labels assigned to the data sets saved in the updated database.
(55) Updating the continuous subsets 75, 76 may further include determining if a second data set 77 which, upon its acquisition, falls within the first subset 75, falls within a predetermined neighbourhood 79 of any of the data sets 72, 77 which are saved in the database and which are marked with the first label. If this is not the case, the master control unit 15 may simply mark the corresponding data set 77 with the first label and save it in the database as described above.
(56) However, if the master control unit 15 determines that a newly acquired second data set 77 falls within a predetermined neighbourhood 79 of any of the data sets 72, 77 which are saved in the database and which are marked with the first label, the master control unit 15 may additionally determine if the total number of data sets saved in the database and falling within this neighbourhood is above a predefined threshold frequency . In the present example, this threshold frequency may be given by a fixed value of three data sets per neighbourhood, for example. As can be seen in
(57) The result of the above described process of updating the continuous subsets 75, 76 can be seen in