Sensing method and sensing device for human driven vehicles under partial VANET (vehicular ad hoc network) environment
11634144 · 2023-04-25
Assignee
Inventors
Cpc classification
G06N7/01
PHYSICS
G08G1/096708
PHYSICS
G08G1/096758
PHYSICS
G06N3/049
PHYSICS
H04W4/021
ELECTRICITY
B60W2554/80
PERFORMING OPERATIONS; TRANSPORTING
International classification
G06N3/049
PHYSICS
Abstract
A sensing method and a sensing device for HDVs (human driven vehicles) under a partial VANET environment are provided. According to the method, an existence sensing module and a location sensing module are constructed, based on a long-short-term-memory recurrent neural network, with utilizing historical information of motion states of a single CAV (connected and autonomous vehicle) as an input, existence and exact locations of surrounding HDVs of the CAV are outputted. The method is not only applicable to sensing the surrounding HDVs of the single CAV, but also the surrounding HDVs of the multiple CAVs. An estimation result of each CAV is firstly obtained, then the estimation results of the CAVs are checked with confliction criterion, according to checking results, the estimation results of the multiple CAVs are fused, and information about the surrounding HDVs of each CAV is finally outputted.
Claims
1. A sensing method for HDVs (human driven vehicles) under a partial VANET (vehicular ad hoc network) environment comprises steps of: constructing an existence sensing module and a location sensing module, wherein: both of the existence sensing module and the location sensing module adopt state information of a CAV (connected and autonomous vehicle) as an input an output of the existence sensing module is existence of surrounding HDVs of the CAV; and an output of the location sensing module is probability density distributions of distances between the CAV and the surrounding HDVs; for a scenario that a single CAV exists, adopting a first sensing procedure, specifically comprising steps of: estimating existence of each surrounding HDV of the CAV with the existence sensing module; estimating a location of each surrounding HDV with the location sensing module; continuously conducting the first sensing procedure, so as to output estimation results of the surrounding HDVs of the CAV in real-time; for a scenario that multiple CAVs exist, adopting a second sensing procedure, specifically comprising steps of: applying the first sensing procedure to each CAV, so as to obtain existence and location information of surrounding HDVs of each CAV; checking whether there is a confliction among the estimation results from the CAVs with confliction criterion; if the confliction exists, fusing conflicted estimation results, and obtaining final existence and location information of each HDV, wherein: the existence sensing module is constructed based on a LSTM RNN (long-short-term-memory recurrent neural network), comprising two layers, wherein: a first layer is a LSTM layer; an input of the first layer is historical motion information of the CAV, comprising lateral displacement, longitudinal displacement, normalized speed and acceleration; a sequence length of the first layer is set manually; because state decision of the CAV needs to consider five vehicles, respectively an ego-lane leader, a left-lane leader, a left-lane follower, a right-lane leader, and a right lane follower of the CAV, an output of the first layer only adopts the last five data; and a second layer is a sigmoid layer, for mapping the output of the first layer to an interval of [0,1]; and an output of the second layer is five scalars, respectively representing existence probabilities of the HDVs in five surrounding directions of the CAV.
2. A sensing method for HDVs (human driven vehicles) under a partial VANET (vehicular ad hoc network) environment comprises steps of: constructing an existence sensing module and a location sensing module, wherein: both of the existence sensing module and the location sensing module adopt state information of a CAV (connected and autonomous vehicle) as an input an output of the existence sensing module is existence of surrounding HDVs of the CAV; and an output of the location sensing module is probability density distributions of distances between the CAV and the surrounding HDVs; for a scenario that a single CAV exists, adopting a first sensing procedure, specifically comprising steps of: estimating existence of each surrounding HDV of the CAV with the existence sensing module; estimating a location of each surrounding HDV with the location sensing module; continuously conducting the first sensing procedure, so as to output estimation results of the surrounding HDVs of the CAV in real-time; for a scenario that multiple CAVs exist, adopting a second sensing procedure, specifically comprising steps of: applying the first sensing procedure to each CAV, so as to obtain existence and location information of surrounding HDVs of each CAV; checking whether there is a confliction among the estimation results from the CAVs with confliction criterion; if the confliction exists, fusing conflicted estimation results, and obtaining final existence and location information of each HDV, wherein: the location sensing module is constructed based on a LSTM RNN (long-short-term-memory recurrent neural network), comprising three layers, wherein: a first layer is a LSTM layer; an input of the first layer is historical motion information of the CAV, comprising lateral displacement, longitudinal displacement, normalized speed and acceleration; a second layer is a feed forward layer; the second layer adopts an output of the first layer as an input; and an output of the second layer is five classes of variables, respectively corresponding to five surrounding directions of the CAV; and a third layer is a mixture density layer, which constructs a probability density distribution function of locations of the HDVs based on a GMM (Gaussian mixture model) with utilizing the output of the second layer, and obtains estimates.
3. A sensing method for HDVs (human driven vehicles) under a partial VANET (vehicular ad hoc network) environment comprises steps of: constructing an existence sensing module and a location sensing module, wherein: both of the existence sensing module and the location sensing module adopt state information of a CAV (connected and autonomous vehicle) as an input an output of the existence sensing module is existence of surrounding HDVs of the CAV; and an output of the location sensing module is probability density distributions of distances between the CAV and the surrounding HDVs; for a scenario that a single CAV exists, adopting a first sensing procedure, specifically comprising steps of: estimating existence of each surrounding HDV of the CAV with the existence sensing module; estimating a location of each surrounding HDV with the location sensing module; continuously conducting the first sensing procedure, so as to output estimation results of the surrounding HDVs of the CAV in real-time; for a scenario that multiple CAVs exist, adopting a second sensing procedure, specifically comprising steps of: applying the first sensing procedure to each CAV, so as to obtain existence and location information of surrounding HDVs of each CAV; checking whether there is a confliction among the estimation results from the CAVs with confliction criterion; if the confliction exists, fusing conflicted estimation results, and obtaining final existence and location information of each HDV, wherein the confliction criterion is: if two CAVs simultaneously satisfy following three rules, a confliction exists between estimation results of the two CAVs, wherein: a first rule is that the two CAVS are separated by at most one lane; a second rule is that a longitudinal distance between the two CAVs is smaller than a distance threshold; and a third rule is that the two CAVs and surrounding HDVs thereof are probabilistic close; a meaning of probabilistic close is defined as follows:
4. The sensing method, as recited in claim 3, wherein: when estimation results of N CAVs are conflicted, one result with maximum probability is selected from 1+N+1 possible results as a final estimation result; the 1+N+1 possible results are respectively: (1) maintaining all of the estimation results of the N CAVs; (2) maintaining an estimation result of one CAV, and discarding estimation results of the other CAVs, totally N possibility; and (3) weighting probability densities in the estimation results of the N CAVs, and obtaining a final probability density and location estimate of each HDV.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The patent of application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
(18) The present invention is further illustrated with accompanying drawings. The embodiments described below are only preferred embodiments of the present invention and the present invention is not limited thereto. For one of ordinary skill in the art, variants made without departing from the present invention should be all encompassed in the protection scope of the present invention.
(19)
(20) A purpose of the present invention is to estimate and obtain the existence and exact locations of the HDVs, if they exist. The sensing method can be deployed in two ways. The first way is to deploy the sensing method inside each CAV, so that the CAVs can exchange the historical motion state information and cooperatively accomplish the task of sensing the HDVs. The second way is to deploy the sensing method inside the road side unit 6 shown in
(21)
(22) According to the sensing method of the present invention, the existence sensing module and the location sensing module are firstly constructed. The existence sensing module is constructed based on a LSTM RNN (long-short-term-memory recurrent neural network), as shown in
(23) a first layer is a LSTM layer; an input of the first layer is a sequence with a length of K; an input of a first LSTM cell is:
(24)
(25) wherein: the input is a vector with a length of 4; the subscript t−K+1 represents a moment; t represents a current moment; δx and δy respectively represent the lateral displacement and the longitudinal displacement of the
(26)
represents the normalized speed; v represents the real-time speed of the CAV; v.sub.max represents the road speed limit; and a represents the acceleration;
(27) a second layer is a sigmoid layer, for mapping the output of the first layer to an interval of [0,1]; an output of the second layer is five scalars, respectively
(28)
shown in
(29) The location sensing module is constructed based on the LSTM RNN, as shown in
(30) a first layer is for processing a sequence input; a second layer is for calculating parameters of Gaussian mixture density; and a third layer is for calculating a final value of the Gaussian mixture density;
(31) the first layer is a common LSTM layer, which is same as the first layer of the existence sensing module;
(32) the second layer is a common feed forward layer; an output of the second layer is five classes of variables, respectively corresponding to the five surrounding directions of the CAV, expressed as:
(33)
(34) if the Gaussian mixture distribution has k mixtures (see equation (2)), the number of the outputted variables of the second layer in the equation (1) is k*3*5; “3” represents weight, mean value and standard deviation; “5” represents the five surrounding directions of the CAV; namely five classes; in each class of variables, the superscripts β, μ and σ is respectively represent the weight, mean value and standard deviation of the Gaussian mixture density;
(35) the third layer is a mixture density layer, which constructs a probability density distribution function of locations of the HDVs based on a GMM (Gaussian mixture model) with utilizing the output of the second layer (the output of the third layer is five probability density functions, as shown in
(36)
(37) wherein: k is the number of mixtures in the GMM;
(38)
represents a Gaussian distribution with the mean value of μ.sub.M.sub.
(39)
represents the weight of a j.sup.th Gaussian distribution,
(40)
represents the mean value of the j.sup.th Gaussian distribution, and
(41)
represents the variance of the j.sup.th Gaussian distribution, which are obtained through calculating the output of the second layer, expressed as:
(42)
(43) at the moment, the location estimate {circumflex over (x)}M.sub.EV of the vehicle M is:
(44)
(45)
(46)
(47)
(48) The confliction criterion is used to check whether there is a confliction. If the two CAVs, EV1 and EV2, simultaneously satisfy following three rules, it is considered that a confliction exists between the estimation results of the two CAVs, wherein:
(49) a first rule is that the two CAVS are separated by at most one lane; when there are two lanes between EV1 and EV2, it is impossible that the estimation results of the two CAVs are conflicted;
(50) a second rule is that a longitudinal distance between the two CAVs is smaller than a distance threshold, namely Δx.sub.EV1,EV2(t)=|x.sub.EV1−x.sub.EV2|<
(51) a third rule is that one vehicle in ExNeighboring(EV1) and one vehicle in ExNeighboring(EV2) are probabilistic close; wherein: ExNeighboring(EV) represents the set containing the EV and the HDVs in the five surrounding directions; M.sub.EV1 is assumed as one surrounding HDV of EV1; N.sub.EV2 is assumed as one surrounding HDV of EV2;
(52)
respectively represent location estimates of M.sub.EV1 and N.sub.EV2; a meaning of probabilistic close is defined as follows:
(53)
(54) wherein:
(55)
(56) a first possible result is to maintain
(57)
and a corresponding probability is
(58)
a second possible result is to maintain
(59)
and discard
(60)
and a corresponding probability is
(61)
(62) a third possible result is to maintain
(63)
and discard
(64)
and a corresponding probability is
(65)
(66) a fourth possible result is to fuse
(67)
so as to form a new location probability density P.sub.EV1,M+EV2,N(x), and obtain a final location estimate
(68)
of the vehicle; wherein:
(69)
(70)
are output results of the existence sensing module;
(71)
(72) a corresponding probability of the fourth possible result is
(73)
(74) Among the four possible results, one result with maximum probability is selected as a final estimation result, and a final output is shown in
(75) Similarly, when the estimation results of the N CAVs are conflicted, one result with the maximum probability is selected from 1+N+1 possible results as the final estimation result, wherein the 1+N+1 possible results are respectively:
(76) (1) maintaining all of the estimation results of the N CAVs;
(77) (2) maintaining the estimation result of one CAV, and discarding the estimation results of the other CAVs, totally N possibility; and
(78) (3) weighting the probability densities in the estimation results of the N CAVs, and obtaining the final probability density and location estimate of each HDV.