LANE-LEVEL NAVIGATION METHOD AND SYSTEM INCORPORATING ADAS FINE-SENSORY DATA

Abstract

The disclosure provides a lane-level navigation method and system incorporating ADAS fine-sensory data, which comprises the following steps: collecting the real-time road images in front of the vehicle, and pretreating the real-time road images which are collected; extracting lane feature points and determining lane information from the preprocessed images; extracting feature points and contour edge lines of road signs in the lane area where the vehicle is located in the preprocessed images, and combining with lane signs to generate lane sign feature point information; identifying and outputting the corresponding lane number and lane function, and transmitting recognized information to the vehicle navigation center control platform, or transmitting to a mobile terminal navigation APP; generating automatic navigation instructions to provide a driver with precise lane-level movements. By effectively fusing ADAS data, the method of the present invention has the advantages of low cost, good compatibility.

Claims

1. A lane-level navigation method incorporating advanced driver assistance system (ADAS) fine-sensory data, wherein the lane-level navigation method comprises the following steps: step S1: collecting real-time road images of a front of a vehicle, and preprocessing the real-time road images which are collected, so as to obtain preprocessed images; step S2: extracting lane feature points and determining lane information of the preprocessed images, wherein the lane information include a lane line number, a lane position and a lane type; step S3: extracting feature points and contour edge lines of road signs in a lane area of the vehicle in the preprocessed image, combining with lane signs, and extracting rules to generate lane sign feature point information; step S4: identifying and outputting a lane number and a lane function corresponding to the lane line number, the lane position, the lane type, lane sign feature point information and a preset lane number and preset lane indicator function numbering rules; step S5: transmitting the lane number, the lane function which are identified, forward vehicle information automatically acquired by a ADAS module, and longitude and latitude information of the vehicle to a vehicle navigation center control platform or a mobile terminal navigation APP; step S6: generating automatic navigation instructions according to the lane position of the vehicle, the lane function which are standardized combined with the forward vehicle information and the longitude and latitude information of the vehicle by a navigation module, and providing drivers with an accurate lane-level movement guidance.

2. The lane-level navigation method according to claim 1, wherein in the step S1, a monocular camera mounted on a vehicle's front windshield is used to capture the real-time road image of the front of the vehicle.

3. The lane-level navigation method according to claim 1, wherein in the step S2, the lane information further includes a position information of a lane where the vehicle is currently located.

4. The lane-level navigation method according to claim 1, wherein in the step S4, by matching the lane position, the lane line number, the lane type and the lane sign feature point information with the preset lane number and a lane indicator function, so as to identify the lane number and a lane function information which are currently corresponding to the vehicle.

5. The lane-level navigation method according to claim 1, wherein in the step S5, the lane line number, the lane function which are identified, the forward vehicle information acquired by the ADAS module, the longitude and latitude information of the vehicle, a longitudinal distance, and relative speed information of adjacent vehicles in front of each of lanes are transmitted to the vehicle navigation center control platform through a CAN bus or transmitted to the mobile terminal navigation APP through WIFI or Bluetooth.

6. A lane-level navigation system incorporating ADAS fine-sensory data, wherein the lane-level navigation system includes an ADAS module, a data processing module, a data interaction module and a navigation module; wherein the ADAS module comprises: an image acquisition module, which is used for collecting real-time road scene images of a front of a vehicle; an image pre-processing module, which is used for pretreating the real-time road images which are collected, so as to obtain preprocessed images; a lane line extraction module, which is used to detect lane line in the preprocessed images and to extract lane line feature points to determine lane line information, wherein the lane line information include a lane line number, lane line position and lane type; a lane sign extraction module, which is used to extract feature points and contour edge lines of road signs in a lane area of the vehicle in the preprocessed images, and to generate lane sign feature point information based on combining lane signs and extracting rules; wherein the data processing module is used for combining a preset lane number and preset lane indication sign function numbering rules according to the lane line number, the lane position, the lane type and the lane sign feature point information, identifying and outputting a lane number and a lane function; wherein the data interactive module is used for transmitting the lane number, the lane function which are identified, forward vehicle information automatically acquired by the ADAS module and longitude and latitude information of the vehicle to a vehicle navigation center control platform, or to a mobile terminal navigation APP; wherein the navigation module is used for generating automatic navigation instructions according to the lane position of the vehicle, the lane function which are standardized combined with the forward vehicle information and the longitude and latitude information of the vehicle, so as to provide an accurate lane level movement guidance to drivers.

7. The lane-level navigation system according to claim 6, wherein the image acquisition module is a monocular camera mounted on a front windshield of the vehicle.

8. The lane-level navigation system according to claim 6, wherein the data processing module arranges and matches the lane line number, the lane position, and lanes with a rule that the lanes are numbered sequentially from left to right to get the lane number where the vehicle is located, and matches the lane sign feature point information with indicating mark numbering rules to output the lane function.

9. The lane-level navigation system according to claim 6, wherein the data interaction module connects the ADAS module to the vehicle navigation center control platform through a CAN bus or WIFI, or connects the ADAS module to the mobile terminal navigation APP via WIFI or Bluetooth.

10. A computer storage medium, recording computer program to be loaded by a processor of a computer system to execute the lane-level navigation method of wherein the computer storage medium stores in the medium and can be executed by a processor, the computer program executes the lane-level navigation method of claim 1.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0033] FIG. 1 is a flowchart illustrating a lane-level navigation method incorporating advanced driver assistance system (ADAS) fine-sensory data according to an embodiment of the invention.

[0034] FIG. 2 is a schematic diagram illustrating a lane-level navigation system incorporating ADAS fine-sensory data according to an embodiment of the invention.

DESCRIPTION OF THE EMBODIMENTS

[0035] In order to make the purposes, technical scheme and advantages of the invention more clear, the invention is further explained in detail in combination with the attached drawing and the embodiment. It should be understood that the specific embodiments described herein are used only to explain the invention and not to qualify it.

[0036] Based on the function of vehicle ADAS, the invention provides a lane-level navigation method which fuses ADAS fine-sensory data. The method can realize the fusion of forward sensing target and existing vehicle navigation system by effectively fusing ADAS data, it has the advantages of low cost and good compatibility, and can effectively solve the problem of low accuracy of lane positioning in vehicle navigation technology. In particular, the invention adds the functions of image acquisition, image processing and image recognition to the existing ADAS system to realize real-time lane level and high-precision navigation of lane function, no need of high-precision electronic map can achieve lane-level positioning and lane function of high-precision navigation, can provide more sophisticated lane-level guidance, not only make navigation system more humane, but also reduce the cost requirements.

[0037] As shown in FIG. 1, a lane-level navigation method for incorporating ADAS fine-sensory data includes the following steps:

[0038] Step S1: real-time images of the road ahead are collected during the vehicle is moving, and it preprocesses the real-time images which are collected is preprocessed, so as to obtain preprocessed images.

[0039] It needs to be explained that the camera mounted on the front windshield can be used for image acquisition. The collected image is mainly the front lane information of the vehicle. The image pre-processing is mainly to gray the original image, image enhancement and image filtering.

[0040] Step S2: the lane line feature points are extracted by a lane line extraction module, and the lane line number, lane position and lane type are obtained.

[0041] It needs to be explained that the lane line extraction module mainly obtains lane line number, lane position, lane Type (including lane's true and false, single and double, color, etc.) and lane area position, etc.

[0042] Step S3: Feature points and edge lines of road signs are extracted by a lane signs extraction module, and feature points information of lane signs is obtained from rules according to lane signs.

[0043] Step S4: The lane line number and lane function can be obtained by matching the lane information extracted from the step S2 and the step S3 with the lane number and a lane sign rules.

[0044] It needs to be explained that the original straight, left, right, straight left, straight right, straight right, left turn, left turn, left turn, bus lane, and so on are numbered respectively. The default lane line numbering rules can be left to right numbered 123 . . . , the lane indicator setting rules are straight 1, left turn 2, Right Turn 3, Straight Left Turn 4, Straight Right Turn 5, left turn 6, straight ahead, left turn, seven, bus lane eight.

[0045] Step S5: the vehicle lane line number, lane function and other information are sent to the navigation module through the data interaction module;

[0046] It needs to be explained that the data interaction module mainly carries on the data interaction through CAN bus, WIFI and Bluetooth three kinds of forms, through CAN bus the ADAS system CAN be connected with the vehicle navigation center control platform, connecting ADAS to a mobile navigation APP via WIFI or Bluetooth allows for real-time and efficient navigation data exchange.

[0047] Step S6: The navigation module combines the lane line number and function information with the forward vehicle information and the vehicle position information obtained by ADAS module to provide the accurate lane-level navigation information for the driver.

[0048] It needs to be explained that the forward vehicle information includes information such as the distance between the vehicle and the vehicle in front, the relative speed, and the latitude and longitude information obtained from the vehicle's positioning module (GPS or Beidou Satellite), to make precise navigation decisions at the lane level. It is mainly based on the information of the forward vehicles to judge whether it is safe to change lanes to other lanes, for example, when the driver needs to change lanes near a turning junction or a high-speed ramp, it is suggested that the driver can press the lane and whether he needs to change lanes, and the ability to change lanes.

[0049] As shown in FIG. 2, a lane-level navigation system incorporating ADAS fine sensing data comprises an ADAS module, a data processing module, a data interaction module and a navigation module.

[0050] ADAS module, used for image acquisition, image processing and image recognition, mainly extract the lane information in the image and identify, and obtain with each lane in front of the adjacent vehicle longitudinal distance, relative speed and the car latitude and longitude and so on.

[0051] The ADAS module not only has the functions of the original ADAS system, but also includes image acquisition module, image preprocessing module, lane line extraction module, Lane indication and sign extraction module.

[0052] Among them:

[0053] the image acquisition module is used for collecting the real-time image of the road ahead of the vehicle, and the image acquisition module is a monocular camera;

[0054] the image pre-processing module is used for pre-processing the collected vehicle front road image;

[0055] the lane line extraction module is used to extract lane feature points, output lane feature points information, and determine lane line number, lane position and lane type;

[0056] the lane indicator extraction module is used to extract the feature points and contour edge lines of lane indicator marks in lane area, calculate the coordinate of feature points of marking lines, and generate the information of traffic marking feature points.

[0057] The data processing module is used to match the lane line number and lane position with the lane line number to get the lane line number information It is also used to match the lane indicator feature point information with the lane indicator function setting rules, and to calculate the lane function of the vehicle location.

[0058] The data interactive module is used to transmit lane line number, lane function and lane line information to vehicle navigation center platform through CAN bus, or to mobile terminal navigation APP through WIFI or Bluetooth.

[0059] The navigation module is used to receive lane line numbers and lane functions, and provides accurate lane-level navigation information by combining the distance, relative speed, and latitude and longitude information obtained by ADAS, the navigation module that can be supported includes vehicle navigation center platform and mobile terminal navigation APP. Mobile terminals can be hand-held devices such as mobile phones and tablets.

[0060] In summary, the invention collects the road image in front of the vehicle through the camera on the ADAS vehicle, extracts the lane line and lane indication sign information by using the image processing module, and then obtains the lane line number and lane function of the vehicle, then the information is transmitted to the navigation module through the data interaction module. The navigation module combines the forward vehicle information acquired by the ADAS module with the longitude and latitude information of the vehicle to make the lane-level navigation service with high precision. Compared with the prior art, the invention can also interact the acquired information in real time through CAN bus, WIFI and Bluetooth, and can realize lane-level high-precision navigation without the aid of high-precision map.

[0061] It should be understood that, for ordinary technicians in the field, improvements or transformations may be made on the basis of the above description, and that all such improvements and transformations shall fall within the protection of the claims annexed to the present invention.