Electronic device and method for monitoring a scene via a set of electronic sensor(s), related computer program
11263468 · 2022-03-01
Assignee
Inventors
- Cem Karaoguz (Palaiseau, FR)
- Hoang-Lan Pham (L'Hay les Roses, FR)
- Alexis Beauvillain (Massy, FR)
- Olivier Le Cornec (Palaiseau, FR)
Cpc classification
G06V10/751
PHYSICS
G01C21/387
PHYSICS
International classification
Abstract
An electronic device for monitoring a scene via a set of sensor(s) includes an acquisition module, of at least one representation of the scene via the sensor set, and a module for converting each representation into a respective occupancy grid. Each grid includes several zones, each corresponding to a respective portion of the representation, and each zone being in an occupied state if said portion contains an object and in an unoccupied state otherwise. The device also includes a module for calculating a differential grid corresponding to a difference between a current occupancy grid and a reference occupancy grid, by ignoring each zone of the reference grid which is in the occupied state and for which the corresponding zone of the current grid is in the unoccupied state, and a module for detecting a change in the scene, starting from the differential grid.
Claims
1. An electronic device for monitoring a scene via a set of N electronic sensor(s), where N is an integer greater than or equal to 1, the device being intended to be connected to the set of N sensor(s) and comprising: an acquisition module configured to acquire, from the set of N sensor(s), at least one representation of the scene, a conversion module configured to convert each acquired representation into a respective occupancy grid, each occupancy grid comprising a plurality of zones each corresponding to a respective portion of the representation, each zone of the occupancy grid being in an occupied state if said portion contains an object and in an unoccupied state otherwise, a calculation module configured to calculate a differential grid corresponding to a difference between a current occupancy grid and a reference occupancy grid, by ignoring each zone of the reference occupancy grid which is in the occupied state and for which the corresponding zone of the current occupancy grid is in the unoccupied state, and a detection module configured to detect a change in the scene from the calculated differential grid, wherein the differential grid comprises a plurality of zones each corresponding to a respective portion of the representation of the scene, each zone of the differential grid being in an active state or an inactive state, the detection module being configured to detect the appearance of an object in the scene when a corresponding zone of the differential grid is in the active state, and wherein the occupancy grids and the differential grid are each in the form of a bit string, each bit being associated with a respective zone, and the calculation module is configured to calculate the differential grid according to the following table: TABLE-US-00006 B.sup.cur B.sup.ref AB 0 0 0 0 1 0 1 0 1 1 1 0 where B.sup.cur and B.sup.ref represent a bit of the current occupancy grid and respectively a corresponding bit of the reference occupancy grid, the bit 0 denoting the unoccupied state and the bit 1 denoting the occupied state, and ΔB represents the bit of the differential grid associated with the respective bits B.sup.cur and B.sup.ref, the bit 0 denoting the inactive state and the bit 1 denoting the active state.
2. The device according to claim 1, wherein the calculation module is configured to calculate the differential grid by ignoring each zone of the reference occupancy grid for which the corresponding zone of the current occupancy grid is in the unoccupied state.
3. The device according to claim 1, wherein the calculation module is configured to calculate a respective zone of the differential grid in the active state only if the corresponding zone of the current occupancy grid is in the occupied state and if the corresponding zone of the reference occupancy grid is in the unoccupied state.
4. The device according to claim 1, wherein the occupancy grids and the differential grid are each represented in the form of a tree, each tree having a plurality of nodes distributed into several levels, each node corresponding to a respective zone, a child node being connected to a single parent node of higher level, and the calculation module is further configured to apply subsequent processing to the calculated differential grid by setting in active state each parent node having at least one child node in the active state, from the lowest level 1 to the highest level.
5. The device according to claim 1, wherein the reference occupancy grid is an occupancy grid resulting from several representations acquired successively and prior to the current representation associated with the current occupancy grid.
6. The device according to claim 5, wherein the reference occupancy grid is an average of several previous occupancy grids, each resulting from a respective representation acquired prior to the current representation associated with the current occupancy grid.
7. The device according to claim 1, wherein N is an integer greater than or equal to 2, and the acquisition module is configured to acquire, from each sensor, at least one representation of the scene, and the conversion module being configured to convert the acquired representations of the different sensors into the respective occupancy grid for said scene.
8. The device according to claim 7, wherein the conversion module is configured for converting each acquired representation in an intermediate occupancy grid for each sensor and to combine the intermediate occupancy grids in the respective occupancy grid for said scene.
9. A monitoring method for monitoring a scene via a set of N electronic sensor(s), where N is an integer greater than or equal to 1, the method being implemented by an electronic monitoring device intended to be connected to the set of N sensor(s), and comprising: acquiring, from the set of N sensor(s), at least one representation of the scene, converting each acquired representation into a respective occupancy grid, each occupancy grid comprising a plurality of zones each corresponding to a respective portion of the representation, each zone of the occupancy grid being in an occupied state if said portion contains an object and in an unoccupied state otherwise, calculating a differential grid corresponding to a difference between a current occupancy grid and a reference occupancy grid, by ignoring each zone of the reference occupancy grid which is in the occupied state and for which the corresponding zone of the current occupancy grid is in the unoccupied state, and detecting a change in the scene from the calculated differential grid, wherein the differential grid comprises a plurality of zones each corresponding to a respective portion of the representation of the scene, each zone of the differential grid being in an active state or an inactive state, the step of detecting comprises detecting an appearance of an object in the scene when a corresponding zone of the differential grid is in the active state, and wherein the occupancy grids and the differential grid are each in the form of a bit string, each bit being associated with a respective zone, and the step of calculating comprises calculating the differential grid according to the following table: TABLE-US-00007 B.sup.cur B.sup.ref ΔB 0 0 0 0 1 0 1 0 1 1 1 0 where B.sup.cur and B.sup.ref represent a bit of the current occupancy grid and respectively a corresponding bit of the reference occupancy grid, the bit 0 denoting the unoccupied state and the bit 1 denoting the occupied state, and ΔB represents the bit of the differential grid associated with the respective bits B.sup.cur and B.sup.ref, the bit 0 denoting the inactive state and the bit 1 denoting the active state.
10. An electronic device for monitoring a scene via a set of N electronic sensor(s), where N is an integer greater than or equal to 1, the device being intended to be connected to the set of N sensor(s) and comprising: an acquisition module configured to acquire, from the set of N sensor(s), at least one representation of the scene, a conversion module configured to convert each acquired representation into a respective occupancy grid, each occupancy grid comprising a plurality of zones each corresponding to a respective portion of the representation, each zone of the occupancy grid being in an occupied state if said portion contains an object and in an unoccupied state otherwise, a calculation module configured to calculate a differential grid corresponding to a difference between a current occupancy grid and a reference occupancy grid, by ignoring each zone of the reference occupancy grid which is in the occupied state and for which the corresponding zone of the current occupancy grid is in the unoccupied state, and a detection module configured to detect a change in the scene from the calculated differential grid, wherein the differential grid comprises a plurality of zones each corresponding to a respective portion of the representation of the scene, each zone of the differential grid being in an active state or an inactive state, the detection module being configured to detect the appearance of an object in the scene when a corresponding zone of the differential grid is in the active state, and wherein the calculation module is configured to calculate the differential grid according to the following equation:
11. A monitoring method for monitoring a scene via a set of N electronic sensor(s), where N is an integer greater than or equal to 1, the method being implemented by an electronic monitoring device intended to be connected to the set of N sensor(s), and comprising: acquiring, from the set of N sensor(s), at least one representation of the scene, converting each acquired representation into a respective occupancy grid, each occupancy grid comprising a plurality of zones each corresponding to a respective portion of the representation, each zone of the occupancy grid being in an occupied state if said portion contains an object and in an unoccupied state otherwise, calculating a differential grid corresponding to a difference between a current occupancy grid and a reference occupancy grid, by ignoring each zone of the reference occupancy grid which is in the occupied state and for which the corresponding zone of the current occupancy grid is in the unoccupied state, and detecting a change in the scene from the calculated differential grid, wherein the differential grid comprises a plurality of zones each corresponding to a respective portion of the representation of the scene, each zone of the differential grid being in an active state or an inactive state, the step of detecting comprises detecting an appearance of an object in the scene when a corresponding zone of the differential grid is in the active state, and wherein the step of calculating comprises calculating the differential grid according to the following equation:
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These features and advantages of the invention will become more apparent upon reading the description which follows, given solely by way of non-limiting example, and with reference to the appended drawings, in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
DETAILED DESCRIPTION
(9)
(10) The electronic monitoring device 10 comprises an acquisition module 20 configured to acquire, from the set 14 of N sensor(s) 16, at least one representation of the scene.
(11) The electronic monitoring device 10 comprises a conversion module 22 configured to convert each acquired representation into a respective occupancy grid G, each occupancy grid G comprising a plurality of zones Z visible in
(12) The electronic monitoring device 10 also comprises a calculation module 28 configured to calculate a differential grid ΔG corresponding to a difference between a current occupancy grid G.sup.cur and a reference occupancy grid G.sup.ref.
(13) The electronic monitoring device 10 comprises a detection module 30 configured to detect a change in the scene from the differential grid ΔG calculated by the calculation module 28.
(14) In the example of
(15) The electronic monitoring device 10 comprises a transceiver 38, configured, in particular, for transmitting, in the form of radio waves, data intended for one or more autonomous motor vehicles 40 located in or near the road infrastructure 12 monitored by the electronic monitoring device 10.
(16) The road infrastructure 12 comprises one or more lanes 42, each lane 42 allowing the circulation of a traffic element 44, in particular of a motor vehicle, such as a self-driving motor vehicle 40, or alternatively a cyclist or pedestrian. In the example of
(17) The set 14 comprises N electronic sensor(s) 16, N being an integer greater than or equal to 1. In the example of
(18) Each electronic sensor 16 is, for example, a remote sensing device laser, better known as lidar (light detection and ranging), or radar (radio detection and ranging), or a stereoscopic camera. Each electronic sensor 16 is known per se.
(19) Those skilled in the art will understand that the electronic sensor(s) 16 of the set 14 are, for example, all of the same type, for example all lidars, all radars, or all stereoscopic cameras.
(20) Alternatively, the set 14 comprises a mixture of different types of electronic sensors 16, with, for example, at least two distinct types among lidar, radar and stereoscopic cameras. This variant makes it possible to have a redundancy of types of electronic sensors 16, and thus offers higher reliability.
(21) Each sensor 16 is, for example, disposed in the vicinity of or within the scene to be monitored, such as near or inside the road infrastructure 12. Each sensor 16 is arranged along a path 42 in the example of
(22) Those skilled in the art will generally understand that the number of sensors 16, whether lidar(s), radar(s) or stereoscopic camera(s), is chosen according to the scene to be monitored, and, for example, in agreement with the number of lanes 42 forming the road infrastructure 12.
(23) Each sensor 16 is then able to perform one or more measurements to deliver a representation of the scene to the corresponding acquisition module 20.
(24) Each data link 18 between a respective electronic sensor 16 and the electronic monitoring device 10 may be, for example, a wire link, as in the example of
(25) In the example of
(26) In a variant not shown, the acquisition module 20, the conversion module 22, the calculation module 28 and the detection module 30 are each made in the form of a programmable logic component, such as an FPGA (Field Programmable Grid Array, or in the form of a dedicated integrated circuit, such as an ASIC (Application Specific Integrated Circuit), a GPU (Graphic Processing Unit), or a GPGPU (General Purpose Computing on Graphic Processing Unit).
(27) When the electronic monitoring device 10 is made in the form of one or more software programs, it is also able to be recorded on a computer-readable medium, not shown. The computer-readable medium is, for example, a medium capable of storing the electronic instructions and being coupled to a bus of a computer system. By way of example, the readable medium may be an optical disk, a magneto-optical disk, a ROM memory, a RAM memory, any type of non-volatile memory (for example EPROM, EEPROM, FLASH, NVRAM), a magnetic card or an optical card. A computer program with software instructions is then stored on the readable medium.
(28) In the example of
(29) Alternatively, not shown, the acquisition module 20 on the one hand, and the conversion module 22, the calculation module 28 and the detection module 30, on the other hand, are separately embedded in two separate electronic computers.
(30) According to this variant, the acquisition module 20 is, for example, disposed near the sensor(s) 16, being connected to each of the sensors 16 by a data link 18. In addition, the acquisition module 20 is, for example, built into a corresponding sensor 16.
(31) According to this variant, the conversion module 22, the calculation module 28 and the detection module 30 are then, for example, arranged within a supervision computer, positioned at a greater distance from the sensor(s) 16. The supervision computer is, for example, a platform of a control center. In addition and optionally, the supervision computer may be connected to several acquisition modules 20, and the conversion of each acquired representation in the respective occupancy grid G is then performed according to each representation acquired for each of the acquisition modules 20.
(32) The acquisition module 20 is configured to acquire at least one representation of the scene from the set 14 of N sensor(s) 16.
(33) When the set 14 comprises several sensors 16, the acquisition module 20 is configured, in particular, to acquire the representations of the scene from the different sensors 16.
(34) In the example of
(35) In the example of
(36) In the example of
(37) In the example of
(38) In the example of
(39) The conversion module 22 is configured to convert each acquired representation in the respective occupancy grid G, each zone Z of the occupancy grid G being in an occupied state if the portion of the representation corresponding to this zone Z contains an object 26, and to an unoccupied state, otherwise.
(40) When the set 14 comprises several sensors 16, the conversion module 22 is configured to convert all the acquired representations in the respective occupancy grid G, each zone Z of the occupancy grid G then being in the occupied state if the portion corresponding to this zone Z contains an object 26 for at least one of the acquired representations, and in the unoccupied state, otherwise. In other words, when the set 14 comprises several sensors 16, the conversion module 22 is configured to position the value of a zone Z of the occupancy grid G in the unoccupied state only if the portion corresponding to this zone Z contains no object 26 for all the representations acquired by the acquisition module 20 from the plurality of sensors 16.
(41)
(42) In a variant or additionally, the conversion module 22 is configured to convert each representation acquired by the different sensors 16 into an intermediate occupancy grid G.sup.int for each sensor 16, and then to combine the intermediate occupancy grids G.sup.int in the respective occupancy grid G for said scene.
(43) Each zone Z corresponds to a single measuring cell of the corresponding sensor(s) 16, or to a plurality of measuring cells of the corresponding sensor(s) 16. When the sensor 16 is a lidar, or respectively a radar, a measurement cell corresponds, for example, to the measurement resulting from the emission of a lidar beam, or respectively of a radar beam. When the sensor 16 is a stereoscopic camera, the measurement cell corresponds, for example, to a pixel of a matrix photodetector of the camera.
(44) Each zone Z of a occupancy grid G.sup.cur, G.sup.ref or of the differential grid ΔG, then comprises a single cell 50 or an aggregate 24 of several cells 50, each cell 50 corresponding to a respective measuring cell of the corresponding sensor(s) 16.
(45) Each occupancy grid G.sup.cur, G.sup.ref, as well as the differential grid ΔG, is a multidimensional grid, i.e. a two-dimensional grid, as in the example of
(46) When the grid is a two-dimensional grid, each zone Z is preferably then in the form of a polygon, for example a rectangle or a square, as shown in
(47) Similarly, when the multidimensional grid is a three-dimensional grid, each zone Z is, for example, in the form of a polyhedron, such as a rectangular parallelepiped or a cube.
(48) Each object 26 that can be monitored by the monitoring device 10 and belonging to the scene is, for example, a mobile object, such as a traffic element 44, or a static object, such as a building or an element of vegetation, along a respective traffic lane 42.
(49) Those skilled in the art will understand that “object” generally means any element capable of being detected by a respective electronic sensor 16, i.e. in particular any element capable of reflecting a beam emitted by the sensor 16, whether it is a lidar or a radar, or any element able to be detected by a stereoscopic camera.
(50) The calculation module 28 is configured to calculate the differential grid ΔG corresponding to the difference between the current occupancy grid G.sup.cur and the reference occupancy grid G.sup.ref, in particular by ignoring each zone Z of the occupancy grid of reference G.sup.ref which is in the occupied state and for which the corresponding zone Z of the current occupancy grid G.sup.cur is in the unoccupied state.
(51) In optional addition, the calculation module 28 is configured to calculate the differential grid ΔG by ignoring each zone Z of the reference occupancy grid G.sup.ref for which the corresponding zone Z of the current occupancy grid G.sup.cur is in an unoccupied state.
(52) The differential grid ΔG comprises a plurality of zones Z each corresponding to a respective portion of the representation of the scene, each zone Z of the differential grid ΔG being in an active state or in an inactive state.
(53) In optional addition, the calculation module 28 is configured to calculate a respective zone Z of the differential grid ΔG in the active state only if the corresponding zone Z of the current occupancy grid G.sup.cur is in the occupied state and if the corresponding zone Z of the reference occupancy grid G.sup.ref is in the unoccupied state.
(54) The occupancy grids G.sup.cur, G.sup.ref and the differential grid ΔG are, for example, each in the form of a bit string 48, each bit being associated with a zone Z or with a respective cell 50, as represented in the example of
(55) In optional addition, the calculation module 28 is, for example, configured to calculate the differential grid ΔG according to Table 1 below:
(56) TABLE-US-00002 TABLE 1 B.sup.cur B.sup.ref ΔB 0 0 0 0 1 0 1 0 1 1 1 0
(57) where B.sup.cur and B.sup.ref represent a bit of the current occupancy grid and respectively a corresponding bit of the reference occupancy grid, the bit 0 denoting the unoccupied state and the bit 1 denoting the occupied state, and
(58) ΔB represents the bit of the differential grid associated with the respective bits B.sup.cur and B.sup.ref, the bit 0 denoting the idle state and the bit 1 denoting the active state.
(59) As a variant, the calculation module 28 is configured to calculate the differential grid ΔG according to the following equation:
(60)
(61) where P.sup.cur and P.sup.ref represent a probability that a corresponding Z zone of the current occupancy grid is occupied, and respectively a probability that the same zone Z of the reference occupancy grid is occupied, with 0≤P.sup.cur1 and 0≤P.sup.ref1,
(62) ΔP represents the state of said zone Z of the differential grid ΔG associated with the respective probabilities P.sup.cur and P.sup.ref, the value 0 denoting the inactive state and the value 1 denoting the active state, and
(63) β is a decimal value strictly between 0 and 1; 0<β<1.
(64) According to this variant, the electronic sensor(s) 16 are modeled in a probabilistic manner. Each measurement made by the corresponding sensor 16 is assigned a probability of occupying the corresponding zone Z as a function of the distance from the zone Z to the sensor 16, instead of assigning a binary value, such as 1 for a lidar or radar impact. The probability associated with the measurement made by the sensor 16 is, for example, equal to 1 for an object 26 detected in a zone Z close to the sensor 16, to 0.9 for an object 26 detected in a zone Z a little farther from the sensor 16, to 0.8 for an object 26 detected in a zone Z even further away from the sensor 16, and so on. The probability 0 corresponds to an absence of object detection for the corresponding zone Z. The probability values P.sup.cur and P.sup.ref are, for example, predefined by successive ranges of distance values between the zone Z and the sensor 16 considered.
(65) The reference occupancy grid G.sup.ref is, for example, an occupancy grid resulting from a single representation acquired at a previous time instant, i.e. anterior to that of the current representation associated with the current occupancy grid G.sup.cur.
(66) In a variant, the reference occupancy grid G.sup.ref is an occupancy grid resulting from several representations acquired successively and prior to the current representation associated with the current occupancy grid G.sup.cur, i.e. acquired at successive time instants and prior to that of the current representation.
(67) According to this variant, the calculation module 28 is then, for example, configured to calculate the reference occupancy grid G.sup.ref by averaging several previous occupancy grids G1, G2, G3, G4, each resulting from a representation respectively acquired prior to the current representation associated with the current occupancy grid G.sup.cur.
(68) In the example of
(69) The calculation module 28 is then configured to perform an average of the plurality of previous occupancy grids G1, G2, G3, G4, preferably zone Z by zone Z, as will be explained later in the example of
(70) In the example of
(71) TABLE-US-00003 TABLE 2 t Z1 Z2 t1 0 1 t2 1 1 t3 0 0 t4 0 1
(72) The calculation module 28 is then, for example, configured to perform a quadratic average of the different successive states of each zone of the previous occupancy grids, for example according to the following equation:
(73)
(74) where i is an integer index of value between 1 and N denoting the previous occupancy grid Gi considered,
(75) j is an integer index denoting the zone Z considered of the previous occupancy grid Gi considered,
(76) N is the previous occupancy grid number Gi considered to calculate the reference occupancy grid G.sup.ref,
(77) Gj,i represents the value, equal to 0 for the unoccupied state or to 1 for the occupied state, of the zone Z of index j of the previous occupancy grid Gi of index i, and
(78) The calculation module 28 is then configured to determine the binary value, i.e. the state, of the corresponding zone in the reference occupancy grid G.sup.ref by comparing the average value obtained for said zone with a first threshold S.sub.1, said zone of the reference occupancy grid G.sup.ref being, for example, in the occupied state if the average value is greater than said predefined first threshold S.sub.1 and in the unoccupied state otherwise, according to the following equation:
(79)
(80) where
(81) S.sub.1 denotes the first threshold, and
(82) G.sub.j.sup.ref represents the value calculated for the zone Z of index j of the reference occupancy grid G.sup.ref, the value 0 corresponding to the unoccupied state and the value 1 to the occupied state.
(83) With an average calculated according to equation (2), the value obtained in the example of
(84) TABLE-US-00004 TABLE 3 t Z1 Z2 t1 0 1 t2 1 1 t3 0 0 t4 0 1
(85) As a variant, the calculation module 28 is configured to perform a weighted average of the states, each represented in the form of a successive binary value of each zone Z of the previous occupancy grids G1 to G4, by applying a weight w, to each successive binary value for the corresponding zone Z, the weight w, preferably having a greater value for the last representations acquired among the plurality of representations acquired successively and prior to the current representation.
(86) The calculation module 28 is then, for example, configured to calculate the average value of each zone according to the following equation:
(87)
(88) where i, j, N, Gj,i and
(89) w.sub.1 represents the weight applied to the value Gj,i;
(90) the applied weight w.sub.1 satisfying, for example, the following equation:
(91)
(92) The calculation module 28 is then, analogously, configured to calculate the binary value, i.e. the state of each zone Z of the reference occupancy grid G.sup.ref by comparing the average and calculated value for the corresponding zone Z with a second threshold S.sub.2, said zone of the reference occupancy grid G.sup.ref being, for example, in the occupied state if the average value is greater than said predefined second threshold S.sub.2 and in the unoccupied state otherwise, according to the following equation:
(93)
(94) where
(95) S.sub.2 denotes the second threshold, and
(96) G.sub.j.sup.ref represents the value calculated for the zone Z of index j of the reference occupancy grid G.sup.ref, the value 0 corresponding to the unoccupied state and the value 1 to the occupied state;
(97) the second threshold S.sub.2 satisfying, for example, the following equation:
(98)
(99) where w.sub.1 represents the weight applied to the value Gj,i.
(100) With an average calculated according to equation (4), the value obtained in the example of
(101) TABLE-US-00005 TABLE 4 t.sub.i w.sub.i Z1 Z2 1 0 0 1 2 0.5 1 1 3 0.6 0 0 4 0.75 0 1
(102) This variant then makes it possible to give more importance, in the reference occupancy grid G.sup.ref, to the representations that have been acquired at the most recent time instants among the different acquired representations considered to calculate said reference occupancy grid G.sup.ref.
(103) Those skilled in the art will then observe that, in the examples described above with reference to
(104) In optional complement, the current occupancy grid G.sup.cur and reference grid G.sup.ref, as well as the differential grid ΔG, are each represented in the form of a tree 52, visible in
(105) In the example of
(106) The tree 52 has several levels L1, L2, L3, and preferably three levels, as in the example of
(107) With the representation in the form of the tree 52, each node 54 of the lowest level L3 preferably corresponds to a single respective cell 50.
(108) The representation in the form of the tree 52 of
(109) Those skilled in the art will then observe that the representation octree can represent both a three-dimensional volume as shown in
(110) The calculation module 28 is preferably configured to calculate the differential grid ΔG by comparing zones Z of identical scale for the current occupancy grid G.sup.cur and the reference occupancy grid G.sup.ref, but the compared zones Z do not necessarily have the same resolution, i.e. the same number of cells 50, between the current occupancy grid G.sup.cur and the reference occupancy grid G.sup.ref. An identical scale between the two zones Z corresponds, for example, to an identical level among the levels L1, L2, L3 of the tree 52 for these two zones Z.
(111)
(112) When the resolution of the zone Z of the current occupancy grid G.sup.cur and that of the zone Z of the reference occupancy grid G.sup.ref are identical, the calculation of the differential grid ΔG follows from the above, with a calculation effected by comparing cells 50 one by one, for example according to Table 1 or Equation (1).
(113) When the resolution of the zone Z of the current occupancy grid G.sup.cur is distinct from that of the zone Z of the reference occupancy grid G.sup.ref, as in the example of
(114) In this example, the calculation module 28 is then configured to perform the calculation of the differential grid ΔG by determining the resulting state of each zone Z of the differential grid ΔG by a bit-by-bit calculation, i.e. cell 50 by cell 50.
(115) In the example of
(116) Similarly, in the example of
(117) The calculation module 28 is preferably configured to use the representation 52, as represented in
(118) In optional addition, the calculation module 28 is further configured to apply subsequent processing to the calculated differential grid ΔG by setting in the active state each parent node 54 having at least one child node in the active state, from the lowest level L3 to the highest level L1.
(119) In the example of
(120) The detection module 30 is then configured to detect a change in the scene, from the differential grid ΔG calculated by the calculation module 28.
(121) The detection module 30 is, for example, configured to detect the appearance of an object 26 in the scene when a corresponding zone Z of the differential grid ΔG is in the active state.
(122) In addition, the transceiver 38 is able to receive from a respective vehicle, such as an autonomous motor vehicle 40, additional positioning and/or dimensional information, the conversion module 22 being then configured to use this additional positioning and/or dimensional information in order to complete and/or corroborate the content of at least part of a corresponding occupancy grid G.sup.cur, G.sup.ref. This additional positioning and/or dimensional information comprises, for example, a geographical position of the respective vehicle and/or dimensions of the respective vehicle. The geographical position of the vehicle is then, after a possible change of marker, used as an occupied state of the corresponding zone Z. The conversion module 22 is configured to further calculate, from the dimensions of the vehicle, a number of zones Z in the occupied state around said zone Z corresponding to the geographical position. In addition or alternatively, the conversion module 22 is configured to exclude the Z zone occupied by the vehicle(s) during the calculation of the reference occupancy grid G.sup.ref, the vehicles being dynamic objects preferably being taken into account in the reference occupancy grid G.sup.ref.
(123) Each traffic element 44 is an element able to circulate and/or to cross a respective lane 42. Each traffic element 44 is, in particular, an element capable of being in the scene. Each traffic element 44 is, for example, selected from the group consisting of: a motorized vehicle, a non-motorized vehicle, a pedestrian and an animal.
(124) The operation of the electronic monitoring device 10 according to the invention will now be explained with the aid of
(125) During an initial step 100, the electronic monitoring device 10 acquires, via its acquisition module 20, the scene or representations of the scene from the set 14 of N electronic sensor(s) 16.
(126) The monitoring device 10 then converts, in the next step 110 and via its conversion module 22, the acquired representation(s) into a respective occupancy grid G.sup.cur, G.sup.ref.
(127) When the set 14 comprises several electronic sensors 16, the conversion of the different acquired representations into the occupancy grid G.sup.cur, G.sup.ref respectively, is carried out as described previously with reference to
(128) In the next step 120, the electronic monitoring device 10 then calculates, via its calculation module 28, the differential grid ΔG by the difference between the current occupancy grid G.sup.cur and the reference occupancy grid G.sup.ref. The calculation of this differential grid is, for example, carried out using Table 1 above, or else Equation (1).
(129) In optional addition, during this step 120, prior to the calculation of the differential grid ΔG, the calculation module 28 calculates the reference occupancy grid G.sup.ref if necessary, i.e. if no reference occupancy grid G.sup.ref has yet been calculated or if the reference occupancy grid G.sup.ref needs to be updated. The calculation of the reference occupancy grid G.sup.ref is, for example, carried out from several previous occupancy grids G1 to G4, corresponding to several representations successively acquired and prior to the current representation associated with the current occupancy grid G.sup.cur, as previously described with reference to
(130) The calculation module 28 is also able to calculate the differential grid ΔG as well in the case where the corresponding zones Z of the current occupancy grid G.sup.cur and reference occupancy grid G.sup.ref have the same resolution, as in the case where they have resolutions as explained above with respect to
(131) As a further optional addition, the calculation module 28 applies the subsequent processing to the differential grid ΔG calculated by setting in the active state each parent node having at least one child node in the active state, from the lowest level L3 to the highest level, L1 as illustrated in
(132) The electronic monitoring device 10 finally detects, in the next step 130 and via its detection module 30, a possible change in the scene, from the differential grid ΔG calculated in step 120. The detection module 30 detects, in particular, the appearance of an object 26 in the scene when a corresponding zone Z of the differential grid ΔG is in the active state.
(133) Thus, the electronic monitoring device 10 according to the invention makes it possible to detect a change in the scene more quickly via the use, on the one hand, of the current occupancy grid G.sup.cur for the current representation of the scene, and on the other hand, of the reference occupancy grid G.sup.ref for the reference representation of the scene, i.e. of the background to which the current representation of the scene must be compared, then via the calculation of the differential grid ΔG.
(134) The calculation of the differential grid ΔG is performed, in particular, by ignoring each zone Z of the reference occupancy grid G.sup.ref in the occupied state for which the corresponding zone Z of the current occupancy grid G.sup.cur is in the unoccupied state, which makes it possible to more effectively detect a change in the scene observed by the electronic sensor(s) 16, and, in particular, to reduce the associated calculation time.