MM-wave radar based guiding system
20200166636 ยท 2020-05-28
Assignee
Inventors
Cpc classification
H01Q1/3233
ELECTRICITY
G01S13/876
PHYSICS
G01S7/411
PHYSICS
G01S13/874
PHYSICS
G01S13/75
PHYSICS
G01S7/415
PHYSICS
G01S13/42
PHYSICS
International classification
G01S13/75
PHYSICS
H01Q21/06
ELECTRICITY
Abstract
The present invention discloses mm-wave radar sensor system and its method of operation, comprising utilization of the passive markers, being placed on known objects. The proposed system can track distance and 3D orientation of the known objects under observation, can differentiate the shape classes of the previously passively marked known objects, and can improve navigation redundancy and autonomous driving in pre-defined environments, by using passive markers being placed on the traffic environment. Generic object can also be human being, having cloths having passive markers.
Claims
1: mm-Wave System comprising the one apparatus 100 with mm-wave HW radar functionality, and at least two apparatuses 2000 being placed physically at the distance from apparatus 100, where mm-wave declares operation between 30 and 300 GHz, where first apparatus 100 contains: At least one high-gain planar antenna for transmitting mm-wave radio signals 21, where the high-gain planar antenna has at least two radiation elements; At least one high-gain planar antenna for receiving mm-wave radio signals 110, where the high-gain planar antenna has at least two radiation elements; Integrated mm-wave radio front end 10, implemented in arbitrary semiconductor technology, having on-chip integrated mm-wave voltage control oscillator, mm-wave power amplifier, at least one mm-wave IQ demodulator, digital control interface, power supply; Digital processing functionality 30 with arbitrary hard wired and SW digital processing capability, being able to digitally process the signal coming out of the entity 10, including controlling functionality and calculation and memory capacity for performing digital signal processing by arbitrary type of the realization options Wired communication interface 60 to connect first Apparatus 100 to the infrastructure entity 1000, being outside the apparatus 100, being released by the plurality of the technologies and communication protocols Supporting circuitry 50, including mechanical interface to infrastructure environment 1000, where the first Apparatus 100 is connected to the infrastructure environment, and supporting electronic circuitry for provide the power supply from the vehicle environment 1000 to the first apparatus 100. where the second apparatus 2000: is a passive, without power supply, and without capability of charging by the illumination of the mm-waves being released by plurality of realization options, having a key feature to reflect the incident mm-wave waves coming from apparatus 100, in the same direction, where mm-waves are approaching the apparatus 2000. where at least two apparatuses 2000 are attached to the known and pre-defined object 300.
2: System according to claim 1, where where at least two apparatuses 2000 are attached to the known and pre-defined apparatus 2000 positions inside known and pre-defined environment for vehicle 301, movement and parking.
3: System according to claim 1, where where are least three apparatuses 2000 are attached to the known and pre-defined at least two classes of known object classes 304 and 305, where they are placed on the each object surface in the way to define unique combination of the shape, allowing object class recognising, by recognising unique positions of the apparatuses 2000 at the object classes surface.
4: System according to claim 1, where where at least one apparatus 2000 are attached to cloths of the human being 307, allowing its marking, and stronger radar cross sections reflection on the predefined distance to the apparatus 100, as compared to the case where at the same distance related marking is not present 308.
5: System according to claim 1, where where at least one apparatus 2000 are attached to cloths of the human being 307, and human being 308, allowing its marking, in the way that they have different geometrical positions on the cloths, allowing apparatus 100 to detected at least two different geometrical positions of the apparatuses 2000.
6: System according to claim 1, where where at least two apparatus 2000 are attached, dense one to another and integrated in the vehicle environment infrastructure 311 and 310, to ensure larger radar cross section, as in the case if they are not present, being illuminated by apparatus 100, where apparatus 100 is on the other vehicle platform.
7: System according to claim 6, where apparatus 100 is on the other static traffic infrastructure, observing and illuminated by mm-waves the vehicle 311, having integrated apparatuses 2000.
8: System according to claim 1, where at least two apparatus 2000 are attached, dense one to another and integrated in the static traffic infrastructure known objects 315, with known exact positions, close to the traffic roads 316, to ensure larger radar cross section, as in the case if apparatuses 2000 are not present on object 315, being illuminated by apparatus 100, where apparatus 100 is on the moving vehicle platform, and where the known objects 315, are arbitrary shape and size and arbitrary but known micro position related to the traffic roads 316.
9: System according to claim 8, where at least two groups of apparatuses 2000, each group having more than two apparatuses 2000, are realized on the known objects 315, being able by the illumination by the apparatus 100, with the same distance to the object 315, to generate clear differentiation in the receiving signal pattern, able to differentiate different class of objects 315, depending of the geometrical arrangements of the groups of apparatuses 2000, between them.
10: System according to claim 1, where at least one apparatus 2000 is integrated in the safety belt, which is part of the vehicle seat 317, and where apparatus 100 is illuminating vehicle seat 317, being integrated in the vehicle environment and connected to the vehicle infrastructure 1000.
11: Method of operation, utilizing the System being described in claim 1 where method of operation comprising three operation steps: marking of the known object being declared as a first operation step, position detection of each apparatus 2000, by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and method for calculation of the 3D position of the known object 300, being declared as third operation step to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two apparatuses 2000, at the surface of the known object 300, where the surface of the object 300 is in the direction of the illumination of the apparatus 100, and where the apparatuses 2000 are placed at the largest possible distance one from the another, where its geometrical distance is predefined and known where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; Digital signal processing of the signal in 30, by detecting position of each apparatus 2000, where the position definition can be reduced to angular position definition of each apparatus 2000, if the distance 500 and 501 is not changing. Information of the position of each apparatus 2000 is optionally communicated to the infrastructure environment 1000, by means of entity 60 where third operation step being executed after the second operation step, has following sub-set of operations: Having position of the apparatuses 2000 calculated, and having its known geometrical position of the illuminated surface of the known object 300, the entity 30, will calculate 3D position of the known object 300, meaning object 300 orientation, being defined by the angles 502, 503, and 504, as well as the distance 501, if 501 changes. Information of the 3D position of the known object 300 is communicated to the infrastructure environment 1000, by means of entity 60
12: Method of operation, utilizing the System being described in claim 2 where method of operation comprising three operation steps: marking of the known vehicle moving environment being declared as a first operation step, position detection of each apparatus 2000, by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and method for calculation of the vehicle 301 trajectory moving within known and marked environment, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two apparatuses 2000, at the predefined positions of the known area to be used by the vehicles 301, 302, 303, surface of the apparatus 2000 are in the direction of the expected illumination of the apparatus 100, and where apparatus 100 is integrated in the moving vehicle 301 where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; Digital signal processing of the signal in 30, by detecting position of each apparatus 2000, in the illumination area, in front of the moving vehicle trajectory 2001, of the vehicle 301, where the position definition can be reduced to angular position definition of each apparatus 2000, due to the fact that their position in pre-defined environment is known Information of the position of each apparatus 2000 is communicated to the vehicle 301 environment, by means of entity 60 where third operation step being executed after the second operation step, has following sub-set of operations: Having position of the apparatuses 2000 calculated, and having its known position in the known area for moving vehicles, the vehicle system is calculating vehicle 301 position in the known vehicle movement area The vehicle 301 is calculating the ongoing movement by calculating the vehicle trajectory, to avoid obstacles in the predefined known vehicle moving area, allowing optional autonomous driving of the vehicle 301 in the predefined known area.
13: Method of operation, like in claim 12 where the predefined vehicle moving environment is a parking facility.
14: Method of operation, utilizing the System being described in claim 3 where method of operation comprising three operation steps: marking of the known object classes being declared as a first operation step, position detection of each apparatus 2000, by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and method for selection of the known object classes, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least three apparatuses 2000, at the predefined known class of the objects 304 on the object surface in the direction of the expected illumination of the apparatus 100, each class of the known object with different geometrical orientation of the apparatuses 2000 where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; Digital signal processing of the signal in 30, by detecting position of each apparatus 2000, in the illumination area, of the objects under observation, where the position definition can be reduced to angular position definition of each apparatus 2000, since their distance to the apparatus 100 could be known where third operation step being executed after the second operation step, has following sub-set of operations: Having position of the apparatuses 2000 calculated, the environment system 1000 is calculating detected pattern of the positions of the apparatuses 2000, identifying the class of the object under observation The environment system 1000 is initiated further actions of the platform having apparatus 100, depending of the identification of the pre-defined class of object.
15: Method of operation, like in claim 14 where the platform having apparatus 100 is crane and one of the class of pre-defined objects is container.
16: Method of operation, like in claim 14 where the platform having apparatus 100 is a robot.
17: Method of operation, utilizing the System being described in claim 4 where method of operation comprising three operation steps: marking of the cloths of the human being being declared as a first operation step, position detection of each apparatus 2000, by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and method for selection of the known object classes, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least one apparatus 2000, at the cloths of selected human being 307 on the object surface in the direction of the expected illumination of the apparatus 100, where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; Digital signal processing of the signal in 30, by detected receiver power level where third operation step being executed after the second operation step, has following sub-set of operations: Having receiver strength being calculated, the environment system 1000 is selecting if the human being in predefined distance area has marked cloths The environment system 1000 is initiated further actions of the platform having apparatus 100, depending of the identification of marked cloths.
18: Method of operation, utilizing the System being described in claim 5 where method of operation comprising three operation steps: marking of the cloths of the human being being declared as a first operation step, position detection of each apparatus 2000, by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and selection of the marked cloth class, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two apparatuses 2000, at the predefined positions of the cloths of the human being in the direction of the expected illumination of the apparatus 100, where the geometrical positions of the apparatuses 200 is different for each class of the marked cloths where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; Digital signal processing of the signal in 30, by detecting position of each apparatus 2000, and its geometrical positions where third operation step being executed after the second operation step, has following sub-set of operations: Having position of the apparatuses 2000 calculated, event of detection specific geometrical pattern being mapped to the specific class of marked cloths is calculated The environment system 1000 is initiated further actions of the platform having apparatus 100, depending of the identification of marked cloths.
19: Method of operation, utilizing the System being described in claim 6 where method of operation comprising three operation steps: placing markers in the vehicles body being declared as a first operation step, reflection detection by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and event detection, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two apparatuses 2000, in the vehicle body where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 receiver chain; Digital signal processing of the signal in 30, by detecting reflection at least two apparatuses 2000 where third operation step being executed after the second operation step, has following sub-set of operations: Detecting the reflection and distance to the vehicle in the direction of the observation The environment system 1000 is initiated further actions of the platform having apparatus 100
20: Method of operation, utilizing the System being described in claim 8 where method of operation comprising three operation steps: placing markers in the known object with known position close to traffic roads being declared as a first operation step, reflection detection by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and event detection and position calculations, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two apparatuses 2000, in the known object 315 having known position where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 receiver chain; Digital signal processing of the signal in 30, by detecting reflection at least two apparatuses 2000 where third operation step being executed after the second operation step, has following sub-set of operations: Detecting the reflection from the known object 315 and distance to the known object Using relative distance to the known object, an known object position from the available navigation information from the vehicle, recalculate and enhance the position of the vehicle having apparatus 100.
21: Method of operation, utilizing the System being described in claim 9 where method of operation comprising three operation steps: placing group of markers in the known object with known position close to traffic roads being declared as a first operation step, group of markers detection by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and event detection with position calculations, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: placing at least two groups each having at least two apparatuses 2000, in the known object 315, having known position where the second operation step has following sub-set of operations: Transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and 120 receiver chain; Digital signal processing of the signal in 30, by detecting reflection from the known object 315 and detection the positions of the group of apparatuses 2000 where third operation step being executed after the second operation step, has following sub-set of operations: Recognising if more than one group of the apparatuses 2000 are presented on the known object 315 on its known position. if the more than one group of the apparatuses are detected on the known object 315 calculate their relative positions Encode the event being coded by the position of the groups of apparatuses 2000 on the known object 315 Using relative distance to the known object, an known object position from the available navigation Information from the vehicle, recalculate and enhance the position of the vehicle having apparatus 100, and take the measures being related to the encoded event.
22: Method of operation, utilizing the System being described in claim 10 where method of operation comprising three operation steps: seat occupation detection being declared as a first operation step, group of markers detection by apparatus 100 being declared as second operation step, to be executed after the first step is executed, and event detection with combined seat occupation and safety belt lock detection, being declared as third operation step, to be executed after the second step is executed, where the first operation step has following sub-set of operations: illumination of the vehicle seat 317 by the apparatus 100, transmission of mm-wave signals generated in 10 using 21; Receiving mm-wave signals reflected from observation area using at least 110 and 120 receiver chain; and detection of the seat occupancy by the extraction of at least one of the vital signs, and in case of detection providing this information to the vehicle infrastructure 1000 where the second operation step has following sub-set of operations: vehicle infrastructure 1000, in case of positive seat occupation detection by human being, is initializing detection of the apparatus 2000 in the field of the apparatus 100 illumination by the apparatus 100 where third operation step being executed after the second operation step, has following sub-set of operations: If the detection of the apparatus 2000 in the second operation step two is positive, this information is sent to the vehicle infrastructure 1000, and vehicle infrastructure is initialising further actions, having information that the seat under observation is occupied by the human being and the human being has safety belt in the position determining safety belt locking. If the detection of the apparatus 2000 in the second operation step two is negative, this information is sent to the vehicle infrastructure 1000, and vehicle infrastructure is initialising further actions, having information that the seat under observation is occupied by the human being and the human being dies not have safety belt in the position determining safety belt is locked.
23: like in all previous claims where the passive apparatus 2000 is realized as corner, having front side toward the illumination being metal coated, and being realized by the plurality of the realization options.
24: like in claim 1, where the passive apparatus 2000 is realized as printed planar structure, reflected ways in the same polarization as received.
25: like in claim 1, where the passive apparatus 2000 is realized as printed planar structure, reflected ways in the cross polarization as received.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0058]
[0059]
[0060]
[0061]
[0062]
[0063]
[0064]
[0065]
[0066]
[0067]
[0068]
[0069]
[0070]
[0071]
[0072]
[0073]
[0074]
[0075]
[0076]
DESCRIPTION OF EMBODIMENTS
[0077] mm-Wave System comprising the one apparatus 100 with mm-wave HW radar functionality, and at least two apparatuses 2000 being is placed physically at the distance from apparatus 100, where mm-wave declares operation between 30 and 300 GHz like in
where the second apparatus 2000 is a passive, without power supply, and without capability of charging by the illumination of the mm-waves being released by plurality of realization options, having a key feature to reflect the incident mm-wave waves coming from apparatus 100, in the same direction, where mm-waves are approaching the apparatus 2000.
[0084] At least two apparatuses 2000 are attached to the known and pre-defined object 300. The Method of operation related to the
where the second operation step has following sub-set of operations: [0086] Transmission of mm-wave signals generated in 10 using 21; [0087] Receiving mm-wave signals reflected from observation area using at least 110 and at least 120 receiver chains; [0088] Digital signal processing of the signal in 30, by detecting position of each apparatus 2000, where the position definition can be reduced to angular position definition of each apparatus 2000, if the distance 500 and 501 is not changing. If the distance is changing, we need to calculate the distance by calculated three distances to the marked objects. If the possible movement of the object 300 is limited to the one rotation or other type of one way of freedom movement, two apparatuses 2000 would be enough for the detecting and characterizing the movement of the known object 300. If the full 3D movement may appear, the angular and distance position for at least three attached apparatuses would need to be calculated, which would mean that all for receiver for special angle detections to the apparatuses 2000 would be required. [0089] Information of the position of each apparatus 2000 is optionally communicated to the infrastructure environment 1000, by means of entity 60
where third operation step being executed after the second operation step, has following sub-set of operations: [0090] Having position of the apparatuses 2000 calculated and having its known geometrical position of the illuminated surface of the known object 300, the entity 30, will calculate 3D position of the known object 300, meaning object 300 orientation, being defined by the angles 502, 503, and 504, as well as the distance 501, if 501 changes. [0091] Information of the 3D position of the known object 300 is communicated to the infrastructure environment 1000, by means of entity 60.
[0092] In the praxis proposed system and method operation could be applied to the class of applications, where for example the sensor is monitoring orientation of the moving object doing translation movements and rotation in one plane having constant distance to the sensor. The proposed scenario will work also in case when the moving platform, being assessed from the top has metal parts or the area where the moment is happening contact metal parts. The today based radar sensor would have difficulties to detect the movement of the object, in virtually same distance to the sensor.
[0093] In the
[0094]
[0095]
[0096]
[0097]
[0098] Furthermore, to described applications, where proposed system, being defined through its apparatuses and method of operation, is used, the calculated information and events may be used for the statistical evaluation of the data.
[0099] This includes: [0100] Statistic evaluation of the object positions mapped with data being used for the calculation, providing profiling of the events and measured objects. [0101] Statistic evaluation of the object class being recognized, with the data being used for the calculation, to enable machine learning in recognizing the data with better accuracy [0102] Counting of the object or class of object being detected [0103] Statistic evaluation of the observed object classes
[0104] By using artificial intelligence algorithmics, with machine learning in the place, the proposed system, being defined by its apparatuses and methods of operations, can be advantageously used for moving robots and machines, in industrial and daily life environments.
[0105] By using artificial intelligence algorithmics, with machine learning in the place, the proposed system, being defined by its apparatuses and methods of operations, can be advantageously used for autonomous driving.
[0106] By using artificial intelligence algorithmics, with machine learning in the place, the proposed system, being defined by its apparatuses and methods of operations, can be advantageously used for updating real time mapping data, where vehicle has on the board apparatus 100, and apparatuses 2000 are positioned close or across the roads.