Roadway information detection sensor device/system for autonomous vehicles

Abstract

A system for an autonomous vehicle by providing lane markers on the road for which a vehicle will read and navigate the road. The vehicle transmits a discovery signal and is returned from the marker to indicate the position on the road and how to proceed on the road. The system uses either an autonomous control system or 3D map navigation database to determine the direction of the vehicle in real time.

Claims

1. Sensor devices strategically placed on the vehicle whereby the road information is processed by a hub, passing the processed information on to either the autonomous control system and/or 3D map navigation database system to determine the direction of the vehicle in real-time, the system comprises of: A. The hub includes processing and storage capability; B. Lane markers are placed on the road; C. Sensor devices consisting of components that will transmit a discovery signal, where the discovery signal will be transmitted from the vehicle where the lane marker on the roadway can be discovered through signal processing of the reflected signals; D. Wherein the hub, once the roadway information is processed it is then communicated back to the autonomous control system and/or 3D map navigation database system where a roadway path is formulated a navigation path; and E. Wherein road information is captured and mapped in real-time for use and updated to the network.

2. The system of sensor devices of claim 1, wherein the lane markers are made of a passive component.

3. The system of sensor devices of claim 2, wherein the passive components are of conductive or non-conductive material.

4. The system of sensor devices of claim 3, wherein the passive components are of ferrous or non-ferrous material.

5. The system of sensor devices of claim 4, wherein the passive components are of non-ferrous or ferrous base paint.

6. The system of sensor devices of claim 3, wherein the passive components are embedded metals or embedded non-metal material.

7. The system of sensor devices of claim 1, wherein the active sensor components use sonar technology.

8. The system of sensor devices of claim 1, wherein the active sensor components use laser technology.

9. The system of sensor devices of claim 1, wherein the active sensor components use RF technology.

10. The system of sensor devices of claim 1, wherein the active sensor components use infrared technology.

11. A method comprising: A. Placing sensor devices strategically on an autonomous vehicle to read road information; B. Placing the lane markers on the roads; C. Connecting the Sensor devices to Hub whereby this information is then processed by the hub; D. Passing the processed information from the hub onto either the autonomous control system and/or 3D map navigation database system to determine the best navigation route in real-time manner; E. Providing the hub with processing and storage capability; F. The sensor devices consisting of components that will transmit a discovery signal, where the discovery signal will be transmitted from the vehicle where lane markers on the roadway can be discovered through signal processing of the reflected signals; G. Processing roadway information in the hub which is then communicated back to the autonomous control system and/or 3D map navigation database system, where a roadway path is formulated for navigation; and H. Capturing and mapping road information in real-time for use and updated to the network.

12. The method for sensor devices of claim 17, wherein the lane markers are made of a passive component.

13. The method for sensor devices of claim 18, wherein the passive components are of conductive and non-conductive material.

14. The method for sensor devices of claim 19, wherein the passive components are of ferrous or non-ferrous material.

15. The method for sensor devices of claim 20, wherein the passive components are of non-ferrous or ferrous base paint.

16. The method for sensor devices of claim 18, wherein the passive components are embedded metals or embedded non-metal material.

17. The method for sensor devices of claim 17, wherein the active sensor components use sonar technology.

18. The method for sensor devices of claim 17, wherein the active sensor components use laser technology.

19. The method for sensor devices of claim 17, wherein the active sensor components use RF technology.

20. The method for sensor devices of claim 17, wherein the active sensor components use infrared technology.

Description

DESCRIPTION OF DRAWINGS

[0028] The description herein makes reference to the accompanying drawings below wherein like reference numerals refer to like parts throughout the several views, and wherein:

[0029] FIG. 1 is a block diagram of the sensor strategically mounted on the vehicle (in this case at the front) pointing down towards the road. Also shown is the RF transmitted wave impinging on the lane markers (installed along the roadway) and being reflected back towards the sensor antenna. This reflected signal is used by the central processing hub and autonomous control system for further processing and mapping of the roadway for navigation.

[0030] FIG. 2 illustrates how the sensors not only require to detect the lane markers immediately adjacent to the vehicle, but they also need to detect the lane markers that are either one or multiple lane(s) over from the current lane that the vehicle is on.

[0031] FIG. 3 is a block diagram illustrating the systems embodiment of the invention.

[0032] FIG. 4 is a block diagram showing 4 antennas strategically placed on the vehicle to cover all 4 sides of the vehicle while pointing down towards the roadthe diagram illustrates along a straight road. Each antenna will have a certain beamwidth (in degrees) to encompass the side of the vehicle it is intended for and to ensure sufficient coverage overlap to pick up most of the lane markers for proper & accurate mapping of the roadway.

DETAILED DESCRIPTION

[0033] FIG. 1 demonstrates a scenario where the RF transmitted energy 3 from the vehicle rooftop sensor 2 is incident upon the lane marker(s) 5 and bounces back towards the sensor. The sensor can either be a complete unit system with an integrated sectorized antenna (a ruggedized design suitable for withstanding severe weather condition while strategically placed on the inside or outside of the vehicle), or it can simply be the sensor installed inside the vehicle 1 while a ruggedized, sectorized antenna (connected to the sensor via a RF cable) is strategically mounted on the vehicle exterior.

[0034] Based on the time of arrival and incident angle of the reflected signal 4, the distance between the vehicle and the lane marker(s) can be calculated. In order to have sufficient data points to formulate a mapping of the roadway, the transmitted signal 3 is required to be sent out frequently at multiple samples per second.

[0035] Note in order to cover the front, back, and sides of the vehicle, multiple sensors (and their associated antennas) will be required to be installed. The number of sensors required is dictated by the achievable data point resolution to accurately generate a 3-D map of the road. As such, the sensor antenna coverage beamwidth and gain (to resolve and coherently receive the reflected signal) performance will contribute to the number of sensors required.

[0036] FIG. 2 illustrates how the sensors not only require to detect the lane markers immediately adjacent to the vehicle, but they also need to detect the lane markers that are one or multiple lane(s) over from the current lane that the vehicle is on. Although FIG. 2 only shows the one lane over to the left of the current lane (that the vehicle is on), the same scenario or concept applies to the lane over to the right of the current lane. And similar to FIG. 1, the front, back, and sides of the vehicle must be accounted for by the sensors. This is necessary for making proper lane changes.

[0037] The circle 12 in FIG. 3 is the embodiment of the invention. In the circle, we have the sensors 8, hub 9, processor 10 and memory 11 where the roadway information is acquired, identified and processed. Once the information is processed and the information parsed and identified then it is sent to the Autonomous Control System (ACS) 6 and/or the 3D map navigation database system 7. Below briefly explains the function of each entity and how each interacts with one another.

[0038] The sensor sends out the discovery signal from the autonomous vehicle to discover the lane marker(s) as explained in FIG. 1 above.

[0039] All the received data from the sensors are processed by the hub. The main goal of the system is to identify the lane markers. After the lane markers are identified and processed, this information is passed to the Autonomous Control System and/or the 3D map navigation system. This has to happen in real time and in advance of the path the vehicle is traveling on.

[0040] The 3D map navigation database system, where the road networks are detailed and created into three dimensional so that the autonomous vehicle can use to traverse to its destination. In the scenario where the autonomous vehicle relies on using the 3D detailed mapping database system to obtain the lane information as it is traveling, then the proposed system in the circle 12 will compare the lane marking information on the 3D map to see if it is up to date with the newly acquired information. In the event the lane markers are out of date, the system thus flags the changes for the 3D mapping system to make the updated changes.

[0041] In a scenario where the autonomous vehicle is acquiring the road information in real time, the identified lane marker information is passed directly to the Autonomous Control System (ACS) for use in navigating the roadway. Once the autonomous vehicle has successfully navigated the roadway, then this information is passed to the 3D mapping system to compare and update lanes marking information for future use via locally stored or, via other 3D mapping system on the network.

[0042] FIG. 4 shows the coverage angle of each transmitted beam from the autonomous vehicle to the lane markers for all sides 13. The reflected signal from the passive lane markers is processed, and from this the relative distance of each lane marker to the vehicle is determined. The sensors send out discovery signals to find out the lane markers from all sides of the vehicle to indicate that the vehicle is within the corresponding lane markers. As the lane markers are learnt then adjustments are made through the autonomous control system and may involve reducing the speed of the vehicle.

[0043] In the event the vehicle is required to go in the reverse direction it would have all the needed information to complete its task.

[0044] As all the lane markers are learnt from all sides of the vehicle, this information can be stored in a 3D map navigation database, or the autonomous control system depending on which database is being used. Further, with the mapping the vehicle can update the mapping process for other vehicles in real time if there have been changes to the road due to construction or other such adjustments.

[0045] Based on the above, in the referred embodiment depicted, the system will work even under severe adverse weather conditions. The active sensor devices in the autonomous vehicle continue to read the lane and roadway information at certain frequency interval in real-time. The sensor devices in the autonomous vehicle can function independently as a stand-alone system or in conjunction with other existing navigation system (such as the GPS or Lidar system for example) to give it finer details of the roadway that it is travelling on. The proposed system is superior to other existing systems because, unlike other existing systems, this system will continue to work autonomously even under severe weather conditions such as heavy snowstorm, ice, fog or any other inclement weather.

[0046] It is important for the autonomous vehicle to have the latest road network details to navigate. These sensor devices can be strategically placed in, or mounted on, the vehicle to enable them to read the most accurate road information for either a straight or bent road.

[0047] Note that the proposed system does not require modification to the existing road networks, with the exception of changing the paint based material used for painting the lane lines/markers. As well, the lane markers could also be made of metallic lane markers. Thus, to summarize, the following is a sequence of steps that must happen for the autonomous vehicle to navigate the roadway in the most effective manner: [0048] 1. The sensor devices would send a discovery signal ahead using sonar technology for example. [0049] 2. The metallic paints or metallic lane markers bounces the discovered information back to the source. [0050] 3. The sensor device in the vehicle receives the discovered information signal (bounced off the lane markers) and passes it on to the processing hub. [0051] 4. The hub interprets/processes the information as it receives it in real time. [0052] 5. The processed information is translated to a format that is consumable by the autonomous control system or 3D map navigation database system. [0053] 6. The autonomous control system or 3D map navigation database system processes the information and makes decision based on the received discovered signals from the proposed sensor devices.

[0054] In order to have the most effective and accurate road information, the sensors would read the information from ahead and from both sides of the vehicle to determine the lane structures. Each side of the road may provide different information as the vehicle travels ahead. Once the information is obtained by the autonomous control system and/or 3D map navigation database system, it then processes it and formulates a decision on how to best navigate. The proposed system will work under any weather condition.

[0055] Although described with reference to referred embodiments of the invention, it should be readily understood that various changes and/or modifications can be made to the invention without departing from the spirit thereof. In general, the invention is only intended to be limited by the scope of the following claims.

[0056] Thus, the following outlines a set of claims that will help or evolve the self-driving, autonomous vehicles to navigate the road in a more effective manner under normal or sever weather and luminous condition: