AUTONOMOUS DRIVING METHOD FOR AVOIDING STOPPED VEHICLE AND APPARATUS FOR THE SAME
20230008458 · 2023-01-12
Inventors
Cpc classification
B60W30/0956
PERFORMING OPERATIONS; TRANSPORTING
B60W30/18154
PERFORMING OPERATIONS; TRANSPORTING
B60W60/0011
PERFORMING OPERATIONS; TRANSPORTING
B60W30/18163
PERFORMING OPERATIONS; TRANSPORTING
B60W30/09
PERFORMING OPERATIONS; TRANSPORTING
B60W60/001
PERFORMING OPERATIONS; TRANSPORTING
B60W60/0015
PERFORMING OPERATIONS; TRANSPORTING
B60W2556/50
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W60/00
PERFORMING OPERATIONS; TRANSPORTING
B60W30/09
PERFORMING OPERATIONS; TRANSPORTING
B60W30/095
PERFORMING OPERATIONS; TRANSPORTING
Abstract
Disclosed herein are an autonomous driving method for avoiding a stopped vehicle and an apparatus for the same. The autonomous driving method for avoiding a stopped vehicle is performed by an autonomous driving control apparatus provided in an autonomous vehicle, and includes obtaining taillight recognition information for a stopped vehicle identified ahead of the autonomous vehicle, determining whether the stopped vehicle is to be avoided in consideration of the taillight recognition information, when it is determined that the stopped vehicle is to be avoided, setting an avoidance method in consideration of whether lane returning is to be performed, which is determined based on an autonomous driving task, and setting an avoidance time point corresponding to the avoidance method and controlling the autonomous vehicle to avoid the stopped vehicle by traveling along an avoidance path generated in conformity with the avoidance time point.
Claims
1. An autonomous driving method for avoiding a stopped vehicle, the autonomous driving method being performed by an autonomous driving control apparatus provided in an autonomous vehicle, the autonomous driving method comprising: obtaining taillight recognition information for a stopped vehicle identified ahead of the autonomous vehicle; determining whether the stopped vehicle is to be avoided in consideration of the taillight recognition information; when it is determined that the stopped vehicle is to be avoided, setting an avoidance method in consideration of whether lane returning is to be performed, which is determined based on an autonomous driving task; and setting an avoidance time point corresponding to the avoidance method and controlling the autonomous vehicle to avoid the stopped vehicle by traveling along an avoidance path generated in conformity with the avoidance time point.
2. The autonomous driving method of claim 1, wherein the avoidance method is any one of a first avoidance method for returning to an original lane after avoiding the stopped vehicle and a second avoidance method for performing lane changing while avoiding the stopped vehicle.
3. The autonomous driving method of claim 2, wherein: the first avoidance method avoids the stopped vehicle by generating an avoidance local path at an avoidance time point that is set in consideration of a time to brake to avoid a collision with the stopped vehicle, and the second avoidance method avoids the stopped vehicle by generating a lane-change local path at a time point for lane changing.
4. The autonomous driving method of claim 3, wherein each of the avoidance local path and the lane-change local path is generated in consideration of an available avoidance space and an avoidance direction that are measured using a high-precision lane level map or a drivable space.
5. The autonomous driving method of claim 4, further comprising: when the avoidance method is set to the first avoidance method, deploying a virtual autonomous vehicle having a size identical to a size of the autonomous vehicle in the avoidance available space, generating a virtual lane central line based on a central line of the virtual autonomous vehicle, and generating the avoidance local path for moving from a lane central line corresponding to the original lane to the virtual lane central line.
6. The autonomous driving method of claim 4, further comprising: when the avoidance method is set to the second avoidance method, generating the lane-change local path for moving from a lane central line corresponding to the original lane to a lane central line corresponding to a target lane in which to travel.
7. The autonomous driving method of claim 5, further comprising: when the avoidance method is set to the first avoidance method, generating a return local path for moving from the virtual lane central line to a lane central line corresponding to the original lane after avoidance of the stopped vehicle has been completed, and performing returning along the return local path.
8. The autonomous driving method of claim 4, further comprising: calculating a risk of a collision with an additional vehicle traveling in a lane in the avoidance direction, and performing avoidance when the collision risk is less than or equal to a preset reference risk.
9. The autonomous driving method of claim 1, wherein the taillight recognition information includes emergency-light flashing information, taillight on/off information, turn-signal flashing information, and brake-light on/off information.
10. The autonomous driving method of claim 1, wherein the stopped vehicle is identified based on obstacle information that is detected based on at least one of a camera sensor, a lidar sensor or a radar sensor, or a combination thereof
11. The autonomous driving method of claim 2, further comprising: extracting a partial image corresponding to a taillight portion of the stopped vehicle by projecting the obstacle information onto an image; and generating the taillight recognition information based on successive data of an image scene corresponding to the partial image.
12. An autonomous driving control apparatus comprising: a processor configured to obtain taillight recognition information for a stopped vehicle identified ahead of an autonomous vehicle, determine whether the stopped vehicle is to be avoided in consideration of the taillight recognition information, when it is determined that the stopped vehicle is to be avoided, set an avoidance method in consideration of whether lane returning is to be performed, which is determined based on an autonomous driving task, set an avoidance time point corresponding to the avoidance method, and control the autonomous vehicle to avoid the stopped vehicle by traveling along an avoidance path generated in conformity with the avoidance time point; and a memory configured to store the taillight recognition information, the avoidance time point, and the avoidance path.
13. The autonomous driving control apparatus of claim 12, wherein the avoidance method is any one of a first avoidance method for returning to an original lane after avoiding the stopped vehicle and a second avoidance method for performing lane changing while avoiding the stopped vehicle.
14. The autonomous driving control apparatus of claim 13, wherein: the first avoidance method avoids the stopped vehicle by generating an avoidance local path at an avoidance time point that is set in consideration of a time to brake to avoid a collision with the stopped vehicle, and the second avoidance method avoids the stopped vehicle by generating a lane-change local path at a time point for lane changing.
15. The autonomous driving control apparatus of claim 14, wherein each of the avoidance local path and the lane-change local path is generated in consideration of an available avoidance space and an avoidance direction that are measured using a high-precision lane level map or a drivable space.
16. The autonomous driving control apparatus of claim 15, wherein the processor is configured to, when the avoidance method is set to the first avoidance method, deploy a virtual autonomous vehicle having a size identical to a size of the autonomous vehicle in the avoidance available space, generate a virtual lane central line based on a central line of the virtual autonomous vehicle, and generate the avoidance local path for moving from a lane central line corresponding to the original lane to the virtual lane central line.
17. The autonomous driving control apparatus of claim 15, wherein the processor is configured to, when the avoidance method is set to the second avoidance method, generate the lane-change local path for moving from a lane central line corresponding to the original lane to a lane central line corresponding to a target lane in which to travel.
18. The autonomous driving control apparatus of claim 16, wherein the processor is configured to, when the avoidance method is set to the first avoidance method, generate a return local path for moving from the virtual lane central line to a lane central line corresponding to the original lane after avoidance of the stopped vehicle has been completed, and control the autonomous vehicle to perform returning along the return local path.
19. The autonomous driving control apparatus of claim 15, wherein the processor is configured to calculate a risk of a collision with an additional vehicle traveling in a lane in the avoidance direction, and perform avoidance when the collision risk is less than or equal to a preset reference risk.
20. The autonomous driving control apparatus of claim 12, wherein the taillight recognition information includes emergency-light flashing information, taillight on/off information, turn-signal flashing information, and brake-light on/off information.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The above and other objects, features and advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
[0037]
[0038]
[0039]
DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0040] The present invention will be described in detail below with reference to the accompanying drawings. Repeated descriptions and descriptions of known functions and configurations which have been deemed to make the gist of the present invention unnecessarily obscure will be omitted below. The embodiments of the present invention are intended to fully describe the present invention to a person having ordinary knowledge in the art to which the present invention pertains. Accordingly, the shapes, sizes, etc. of components in the drawings may be exaggerated to make the description clearer.
[0041] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
[0042]
[0043] Referring to
[0044] Here, the stopped vehicle may be identified based on obstacle information that is detected based on at least one of a camera sensor, a lidar sensor or a radar sensor, or combination thereof.
[0045] Here, a partial image corresponding to the taillight portion of the stopped vehicle may be extracted by projecting the obstacle information onto an image, and taillight recognition information may be generated based on successive data of image scenes corresponding to the partial image.
[0046] For example, an obstacle detected using a camera sensor, a lidar sensor or a radar sensor provided on the autonomous vehicle may be projected onto the image. A partial image may be extracted by cutting only the taillight portion of the stopped vehicle, which is detected in the corresponding image. Thereafter, taillight recognition information indicating the state of the taillights of the stopped vehicle may be obtained through inference of machine learning by inputting the successive data of the image scenes corresponding to the partial image to a machine-learning-based detection module.
[0047] Here, the taillight recognition information may include emergency-light flashing information, taillight on/off information, turn-signal flashing information, and brake light on/off information.
[0048] For example, the state of taillights depending on the taillight recognition information may be obtained to correspond to {taillight ON/OFF, emergency-light flashing, left/right-turn-signal flashing, and brake light ON/OFF}.
[0049] Further, in the autonomous driving method for avoiding a stopped vehicle according to the embodiment of the present invention, the autonomous driving control apparatus provided in the autonomous vehicle determines whether avoidance of the stopped vehicle is to be performed in consideration of the taillight recognition information at step S120.
[0050] In an example, as in CASE #1 illustrated in
[0051] In another example, as in CASE #2 illustrated in
[0052] In a further example, as in CASE #3 illustrated in
[0053] In yet another example, as in CASE #4 illustrated in
[0054] Furthermore, in the autonomous driving method for avoiding a stopped vehicle according to the embodiment of the present invention, the autonomous driving control apparatus provided in the autonomous vehicle determines whether avoidance of the stopped vehicle is required at step S125, and sets an avoidance method in consideration of whether lane returning is to be performed, which is determined based on the autonomous driving task when it is determined that avoidance is required at step S130.
[0055] Here, the avoidance method may be any one of a first avoidance method for returning to the original lane after avoiding the stopped vehicle, and a second avoidance method for performing lane changing while avoiding the stopped vehicle.
[0056] That is, depending on whether the autonomous vehicle is determined to return to the original lane after avoidance, whether the first avoidance method corresponding to the avoidance task illustrated in
[0057] Here, the case may be considered in which, after avoidance of the stopped vehicle, the autonomous driving task (next task) is performed within a preset threshold distance (e.g., 1 km) and corresponds to ‘turning right at an intersection’, ‘turning left’, ‘making a U-turn’, or ‘arriving at the destination’.
[0058] In an example, when, in the situation of
[0059] In another example, when, in the situation of
[0060] In a further example, when, in the situation of
[0061] In yet another example, because the situation of
[0062] Hereinafter, the respective situations in which it is and is not required to return to the original lane, after avoidance of a stopped vehicle will be described in detail with reference to
[0063] First, referring to
[0064] Referring to
[0065] Here, the operation of going through the intersection, such as that illustrated in
[0066] Next, in the autonomous driving method for avoiding a stopped vehicle according to the embodiment of the present invention, the autonomous driving control apparatus provided in the autonomous vehicle sets an avoidance time point based on the avoidance method, and avoids the stopped vehicle by traveling along an avoidance path generated in conformity with the avoidance time point at step S140.
[0067] Here, the first avoidance method may avoid the stopped vehicle by generating an avoidance local path at the avoidance time point, determined in consideration of the time to brake to avoid a collision with the stopped vehicle.
[0068] For example, as illustrated in
[0069] Here, the second avoidance method may perform avoidance of the stopped vehicle by generating a lane-change local path at a lane-change time point.
[0070] That is, unlike the avoidance time point, the lane-change time point may be the time point at which to change lane, without considering the Time-to-Brake (TTB) to avoid a collision with the stopped vehicle or the like.
[0071] Here, the avoidance local path and the lane-change local path may be generated in consideration of an available avoidance space and an avoidance direction, which are measured using a high-precision lane-level map or a drivable space.
[0072] In an example, when the high-precision lane level map is used, an avoidance space present to the left or right of the stopped vehicle 300, 400, 500, or 600 is detected, as illustrated in
[0073] In another example, the drivable space may be extracted through real-time inference based on artificial-intelligence learning using semantic segmentation. Based on this, as illustrated in
[0074] In this case, when the avoidance method is set to a first avoidance method, a virtual autonomous vehicle having the same size as the autonomous vehicle is deployed in the available avoidance space, a virtual lane central line may be generated based on the central line of the virtual autonomous vehicle, and an avoidance local path for moving from the lane central line corresponding to the original lane to the virtual lane central line may be generated.
[0075] Hereinafter, a process of generating an avoidance local path is separated into four steps, and will be described in detail with reference to
[0076] First, a marginal distance (MARGIN) may be set between an avoidance target vehicle (=stopped vehicle) and a virtual autonomous vehicle to be deployed in an available avoidance space so as to maintain avoidance stability at step S1010.
[0077] Here, the marginal distance may be set sufficiently large to prevent a collision even if the autonomous vehicle is located alongside the stopped vehicle in consideration of the size of the stopped vehicle and the size of the autonomous vehicle.
[0078] Next, the virtual autonomous vehicle may be deployed at an interval of the set marginal distance at step S1020, and a virtual lane central line may be generated based on the central line of the virtual autonomous vehicle at step S1030.
[0079] Thereafter, an avoidance local path for moving from the lane central line corresponding to the original lane to the virtual lane central line may be generated at step S1040.
[0080] Here, the avoidance local path may be generated as a traceable path using the kinematics model of the autonomous vehicle.
[0081] Here, when the avoidance method is set to a first avoidance method, a return local path for moving from the virtual lane central line to the lane central line corresponding to the original lane after completion of avoidance of the stopped vehicle may be generated, and lane returning may be performed along the return local path.
[0082] The process of generating the return local path may be identical to the process of generating the avoidance local path.
[0083] Here, when the autonomous vehicle is located in the lane central line corresponding to the original lane, the avoidance task corresponding to the first avoidance method may be completed.
[0084] Here, when the avoidance method is set to a second avoidance method, a lane-change local path for moving from the lane central line corresponding to the original lane to a lane central line corresponding to the target lane in which to travel may be generated.
[0085] Here, a risk of collision with another vehicle traveling in the lane in the avoidance direction may be calculated, and avoidance may be performed when the collision risk is less than or equal to a preset reference risk.
[0086] For example, referring to
[0087] Here, the Time-To-Collision (TTC) may be calculated as the ‘distance to additional vehicle/(autonomous vehicle velocity—additional vehicle velocity)’.
[0088] In another example, referring to
[0089] Here, the method for analyzing the collision risk may employ and use various methods, such as a probability calculation method or an artificial intelligence deep learning method, in addition to the method using TTC used in the example.
[0090] Furthermore, when it is determined at step S125 that avoidance is not required, the current process is terminated.
[0091] In addition, although not illustrated in
[0092] By means of the autonomous driving method for avoiding a stopped vehicle, a path for avoiding a stopped vehicle present in a driving lane for an autonomous vehicle may be generated and provided, thus allowing the autonomous vehicle to travel in an autonomous driving mode without changing the driving mode from the autonomous driving mode to a manual driving mode until arriving at the destination.
[0093] Further, by recognizing taillights of a stopped vehicle, the accuracy of determination for avoidance may be improved, and autonomous driving for performing an avoidance task may be performed.
[0094]
[0095] Referring to
[0096] Thereafter, the autonomous vehicle may perform autonomous driving for avoiding a stopped vehicle while continuing to determine whether the autonomous vehicle has arrived at the destination at step S1315.
[0097] When it is determined at step S1315 that the autonomous vehicle has arrived at the destination, autonomous driving for avoiding a stopped vehicle may be completed.
[0098] When it is determined at step S1315 that the autonomous vehicle has not arrived at the destination, the autonomous driving control apparatus may control the autonomous vehicle by generating a local path depending on the autonomous driving task for moving to the destination at step S1320.
[0099] Thereafter, among forward obstacles (e.g., a vehicle, a pedestrian, or the like) detected using a camera sensor, a lidar sensor, a radar sensor, or the like provided on the autonomous vehicle, a stopped vehicle moving at a velocity of ‘0’ may be detected at step S1330.
[0100] Thereafter, taillight recognition information may be generated by recognizing taillights of the stopped vehicle at step S1340, and whether the stopped vehicle is to be avoided may be determined based on the taillight recognition information at step S1345.
[0101] For example, when the taillights of the stopped vehicle are in a state such as {taillight OFF} or {emergency-light flashing}, or a state such as {right-turn-signal flashing} in the curb lane, it may be determined that the stopped vehicle is to be avoided.
[0102] When it is determined at step S1345 that the stopped vehicle is not to be avoided, the autonomous driving control apparatus may control the autonomous vehicle by generating a local path corresponding to the autonomous driving task at step S1320.
[0103] Further, when it is determined at step S1345 that the autonomous vehicle is controlled to avoid the stopped vehicle, whether returning to the original lane is required after avoidance of the stopped vehicle may be determined at step S1355.
[0104] When it is determined at step S1355 that returning to the original lane after avoidance is required, the autonomous driving control apparatus may control the autonomous vehicle to avoid the stopped vehicle by generating an avoidance local path at an avoidance time point, which is determined based on a first avoidance method, at step S1360.
[0105] Here, the avoidance time point may be determined in consideration of Time-to-Brake (TTB), which is calculated using the current location and velocity of the autonomous vehicle, the distance to the stopped vehicle, etc. Further, the avoidance local path may be generated by setting the size of the stopped vehicle and a margin for avoiding the stopped vehicle.
[0106] Next, whether avoidance has been completed may be determined at step S1365, and step S1360 may be repeatedly performed until avoidance of the stopped vehicle is completed when it is determined that avoidance has not been completed.
[0107] On the other hand, when it is determined at step S1354 that avoidance has been completed, the autonomous vehicle control apparatus may control the autonomous vehicle so that the autonomous vehicle returns to the original lane by generating an avoidance return local path at step S1370.
[0108] Here, when the autonomous vehicle is located alongside the stopped vehicle, or passes the stopped vehicle, it may be determined that avoidance has been completed.
[0109] Thereafter, whether avoidance returning has been completed is determined at step S1375. When avoidance returning has not been completed, step S1370 may be repeatedly performed until avoidance returning is completed.
[0110] Here, when the autonomous vehicle is located on the lane central line of the original lane, it may be determined that avoidance returning has been completed.
[0111] Further, when it is determined at step S1355 that returning to the original lane after avoidance is not required, the autonomous driving control apparatus may control the autonomous vehicle to avoid the stopped vehicle by generating a lane-change local path at a lane-change time point, which is determined based on a second avoidance method, at step S1380.
[0112] Thereafter, whether lane changing has been completed may be determined at step S1385, and step S1380 may be repeatedly performed until lane changing is completed when it is determined that lane changing has not been completed.
[0113] Here, when the autonomous vehicle is located on the lane central line of the changed lane, it may be determined that lane changing has been completed.
[0114]
[0115] Referring to
[0116] Accordingly, an embodiment of the present invention may be implemented as a non-transitory computer-readable storage medium in which methods implemented using a computer or instructions executable in a computer are recorded. When the computer-readable instructions are executed by the processor, the computer-readable instructions may perform a method according to at least one aspect of the present invention.
[0117] The processor 1410 obtains taillight recognition information for a stopped vehicle identified ahead of the autonomous vehicle.
[0118] Here, the taillight recognition information may include emergency-light flashing information, taillight on/off information, turn-signal flashing information, and brake light on/off information.
[0119] Here, the stopped vehicle may be identified based on obstacle information that is detected based on at least one of a camera sensor, a lidar sensor or a radar sensor, or combination thereof.
[0120] Here, a partial image corresponding to the taillight portion of the stopped vehicle may be extracted by projecting the obstacle information onto an image, and taillight recognition information may be generated based on successive data of image scenes corresponding to the partial image.
[0121] Further, the processor 1410 determines whether a stopped vehicle is to be avoided in consideration of the taillight recognition information.
[0122] When it is determined that the stopped vehicle is to be avoided, the processor 1410 sets an avoidance method in consideration of whether lane returning is to be performed, which is determined based on the autonomous driving task when it is determined that avoidance is required.
[0123] Here, the avoidance method may be any one of a first avoidance method for returning to the original lane after avoiding the stopped vehicle, and a second avoidance method for performing lane changing while avoiding the stopped vehicle.
[0124] Furthermore, the processor 1410 may set an avoidance time point corresponding to the avoidance method, and may avoid the stopped vehicle by traveling along the avoidance path generated in conformity with the avoidance time point.
[0125] The first avoidance method may avoid the stopped vehicle by generating an avoidance local path at the avoidance time point, determined in consideration of the time to brake to avoid a collision with the stopped vehicle.
[0126] The second avoidance method may perform avoidance of the stopped vehicle by generating a lane-change local path at a lane-change time point.
[0127] Here, the avoidance local path and the lane-change local path may be generated in consideration of an available avoidance space and an avoidance direction, which are measured using a high-precision lane-level map or a drivable space.
[0128] In this case, when the avoidance method is set to the first avoidance method, a virtual autonomous vehicle having the same size as the autonomous vehicle is deployed in the available avoidance space, a virtual lane central line may be generated based on the central line of the virtual autonomous vehicle, and an avoidance local path for moving from the lane central line corresponding to the original lane to the virtual lane central line may be generated.
[0129] Here, when the avoidance method is set to the second avoidance method, a lane-change local path for moving from the lane central line corresponding to the original lane to a lane central line corresponding to the target lane in which to travel may be generated.
[0130] Here, when the avoidance method is set to the first avoidance method, a return local path for moving from the virtual lane central line to the lane central line corresponding to the original lane after completion of avoidance of the stopped vehicle may be generated, and lane returning may be performed along the return local path.
[0131] Here, a risk of collision with another vehicle traveling in the lane in the avoidance direction may be calculated, and avoidance may be performed when the collision risk is less than or equal to a preset reference risk.
[0132] Because the process for performing autonomous driving to avoid a stopped vehicle by the processor 1410 is identical to that of
[0133] The memory 1430 stores the taillight recognition information, the avoidance time point, and the avoidance path.
[0134] Further, as described above, the memory 1430 stores various types of information generated by the autonomous driving control apparatus according to the embodiment of the present invention, as described above.
[0135] In accordance with an embodiment, the memory 1430 may be configured independently of the autonomous driving control apparatus, thus supporting functions for autonomous driving to avoid a stopped vehicle. Here, the memory 1430 may function as separate mass storage, and may include a control function for performing related operations.
[0136] Meanwhile, the autonomous driving control apparatus may include memory installed therein, whereby information may be stored therein. In an embodiment, the memory is a computer-readable medium. In an embodiment, the memory may be a volatile memory unit, and in another embodiment, the memory may be a nonvolatile memory unit. In an embodiment, a storage device is a computer-readable recording medium. In different embodiments, the storage device may include, for example, a hard-disk device, an optical disk device, or any other kind of mass storage device.
[0137] By utilizing the autonomous driving control apparatus, a path for avoiding a stopped vehicle present in a driving lane for an autonomous vehicle may be generated and provided, thus allowing the autonomous vehicle to travel in an autonomous driving mode without changing the driving mode to a manual driving mode until arriving at the destination.
[0138] Further, by recognizing a taillight of a stopped vehicle, the accuracy of determination for avoidance may be improved, and autonomous driving of performing an avoidance task may be performed.
[0139] In accordance with the present invention, there can be provided a method for performing autonomous driving to a destination, without changing the driving mode from an autonomous driving mode to a manual driving mode, by generating and providing a path for avoiding a stopped vehicle present in the driving lane of an autonomous vehicle.
[0140] Further, in accordance with the present invention, there can be provided an autonomous driving method that improves the accuracy of determination for avoidance by recognizing taillights of a stopped vehicle, and performs an avoidance task.
[0141] As described above, in the autonomous driving method for avoiding a stopped vehicle and the apparatus for the autonomous driving method according to the present invention, the configurations and schemes in the above-described embodiments are not limitedly applied, and some or all of the above embodiments can be selectively combined and configured such that various modifications are possible.