Lane keeping assist/support system, vehicle including the same, and method for controlling the same
10086834 ยท 2018-10-02
Assignee
Inventors
Cpc classification
B60W2420/403
PERFORMING OPERATIONS; TRANSPORTING
G06V20/588
PHYSICS
G06V20/56
PHYSICS
B60W2554/80
PERFORMING OPERATIONS; TRANSPORTING
International classification
A01B69/00
HUMAN NECESSITIES
B62D11/00
PERFORMING OPERATIONS; TRANSPORTING
G05D1/00
PHYSICS
B63H25/04
PERFORMING OPERATIONS; TRANSPORTING
G06F7/00
PHYSICS
Abstract
A lane keeping assist/support (LKAS) system for preventing lane departure of a vehicle includes: an LKAS controller determining whether an adjacent vehicle is present by analyzing around-view images of the vehicle acquired by an around-view monitoring (AVM) system; a vehicle position calculator calculating a position of the vehicle; an adjacent vehicle position calculator calculating a position of the adjacent vehicle; a torque controller determining whether a proximity index generated according to the calculated position of the vehicle and the calculated position of the adjacent vehicle is less than a threshold value and correcting an initial torque timing and an initial torque based on the calculated position of the vehicle when the proximity index is less than the threshold value; and a steering apparatus controlling steering of the vehicle according to the corrected initial torque timing and the corrected initial torque.
Claims
1. A lane keeping assist/support (LKAS) system for preventing lane departure of a vehicle, comprising: an LKAS controller determining whether an adjacent vehicle is present by analyzing around-view images of the vehicle acquired by an around-view monitoring (AVM) system installed in the vehicle; a vehicle position calculator calculating a position of the vehicle; an adjacent vehicle position calculator calculating a position of the adjacent vehicle when the adjacent vehicle is determined to be present; a torque controller determining whether a proximity index generated according to the calculated position of the vehicle and the calculated position of the adjacent vehicle is less than a threshold value and correcting an initial torque timing and an initial torque based on the calculated position of the vehicle when the proximity index is determined to be less than the threshold value; and a steering apparatus controlling steering of the vehicle according to the corrected initial torque timing and the corrected initial torque, wherein the torque controller receives a relative vertical distance of the adjacent vehicle with respect to the vehicle from the adjacent vehicle position calculator, wherein the torque controller advances the initial torque timing and increases the initial torque if the relative vertical distance is a positive value, and wherein the torque controller delays the initial torque timing and decreases the initial torque if the relative vertical distance is a negative value.
2. The LKAS system according to claim 1, wherein the vehicle position calculator calculates the position of the vehicle by analyzing a photographed front view image showing a front view of the vehicle.
3. The LKAS system according to claim 1, wherein the adjacent vehicle position calculator calculates the position of the adjacent vehicle by analyzing the around-view images acquired by the AVM system.
4. The LKAS system according to claim 1, wherein: the position of the vehicle includes a first distance between a center of the vehicle and a left lane and a second distance between the center of the vehicle and a right lane, and the position of the adjacent vehicle includes at least one of a third distance corresponding to a horizontal distance between the vehicle and a left adjacent vehicle and a fourth distance corresponding to a horizontal distance between the vehicle and a right adjacent vehicle.
5. The LKAS system according to claim 4, wherein: the proximity index includes a first proximity index and a second proximity index, and the torque controller generates the first proximity index by subtracting the first distance from the third distance and generates the second proximity index by subtracting the second distance from the fourth distance.
6. The LKAS system according to claim 5, wherein the torque controller corrects the initial torque timing and the initial torque based on the position of the vehicle using a timing correction value and a torque correction value determined according to the first proximity index when the first proximity index is less than a first threshold value.
7. The LKAS system according to claim 6, wherein the torque controller increases or decreases the initial torque timing and the initial torque according to the timing correction value and the torque correction value on the basis of the relative vertical distance generated by analyzing the around-view images.
8. The LKAS system according to claim 5, wherein the torque controller corrects the initial torque timing and the initial torque based on the position of the vehicle using a timing correction value and a torque correction value determined according to the second proximity index when the second proximity index is less than a second threshold value.
9. A vehicle, comprising: an AVM system configured to acquire around-view images of the vehicle; an LKAS controller determining whether an adjacent vehicle is present by analyzing the around-view images of the vehicle acquired by the AVS system; a vehicle position calculator calculating a position of the vehicle; an adjacent vehicle position calculator calculating a position of the adjacent vehicle when the adjacent vehicle is determined to be present; a torque controller determining whether a proximity index generated according to the calculated position of the vehicle and the calculated position of the adjacent vehicle is less than a threshold value and correcting an initial torque timing and an initial torque based on the calculated position of the vehicle when the proximity index is determined to be less than the threshold value; and a steering apparatus controlling steering of the vehicle according to the corrected initial torque timing and the corrected initial torque, wherein the torque controller receives a relative vertical distance of the adjacent vehicle with respect to the vehicle from the adjacent vehicle position calculator, wherein the torque controller advances the initial torque timing and increases the initial torque if the relative vertical distance is a positive value, and wherein the torque controller delays the initial torque timing and decreases the initial torque if the relative vertical distance is a negative value.
10. A method of controlling an LKAS system for preventing lane departure of a vehicle, comprising: determining whether an adjacent vehicle is present by analyzing around-view images of the vehicle acquired by an AVM system installed in the vehicle; calculating a position of the vehicle; calculating a position of the adjacent vehicle when the adjacent vehicle is determined to be present; determining whether a proximity index generated according to the calculated position of the vehicle and the calculated position of the adjacent vehicle is less than a threshold value; correcting an initial torque timing and an initial torque based on the calculated position of the vehicle when the proximity index is determined to be less than the threshold value; and controlling steering of the vehicle according to the corrected initial torque timing and the corrected initial torque, wherein the initial torque timing is advanced and the initial torque is increased when a relative vertical distance between the adjacent vehicle and the vehicle is a positive value, and wherein the initial torque timing is delayed and the initial torque is decreased when the relative vertical distance between the adjacent vehicle and the vehicle is a negative value.
11. The method according to claim 10, wherein the calculating of the position of the vehicle comprises calculating the position of the vehicle by analyzing a photographed front view image showing a front view of the vehicle.
12. The method according to claim 10, wherein the calculating of the adjacent vehicle comprises calculating the position of the adjacent vehicle by analyzing the around-view images acquired by the AVM system.
13. The method according to claim 10, wherein: the position of the vehicle includes a first distance between a center of the vehicle and a left lane and a second distance between the center of the vehicle and a right lane, and the position of the adjacent vehicle includes at least one of a third distance corresponding to a horizontal distance between the vehicle and a left adjacent vehicle and a fourth distance corresponding to a horizontal distance between the vehicle and a right adjacent vehicle.
14. The method according to claim 13, wherein: the proximity index includes a first proximity index and a second proximity index, and the determining whether the proximity index is less than the threshold value comprises generating the first proximity index by subtracting the first distance from the third distance and generating the second proximity index by subtracting the second distance from the fourth distance.
15. The method according to claim 14, wherein the correcting of the initial torque timing and the initial torque comprises correcting the initial torque timing and the initial torque based on the position of the vehicle using a timing correction value and a torque correction value determined according to the first proximity index when the first proximity index is less than a first threshold value.
16. The method according to claim 15, wherein the initial torque timing and the initial torque are increased or decreased according to the timing correction value and the torque correction value on the basis of the relative vertical distance generated by analyzing the around-view images.
17. The method according to claim 14, wherein the correcting of the initial torque timing and the initial torque comprises correcting the initial torque timing and the initial torque based on the position of the vehicle using a timing correction value and a torque correction value determined according to the second proximity index when the second proximity index is less than a second threshold value.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
DETAILED DESCRIPTION OF THE EMBODIMENTS
(5) Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. Although the suffixes module and unit are used for constituent elements described in the following description, this is intended only for ease of description of the specification.
(6) As used herein, the singular forms a, an, and the are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms comprises and/or comprising, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term and/or includes any and all combinations of one or more of the associated listed items.
(7) It is understood that the term vehicle or vehicular or other similar term as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g., fuels derived from resources other than petroleum). As referred to herein, a hybrid vehicle is a vehicle that has two or more sources of power, for example both gasoline-powered and electric-powered vehicles.
(8) Additionally, it is understood that one or more of the below methods, or aspects thereof, may be executed by at least one controller. The term controller may refer to a hardware device that includes a memory and a processor. The memory is configured to store program instructions, and the processor is specifically programmed to execute the program instructions to perform one or more processes which are described further below. Moreover, it is understood that the below methods may be executed by an apparatus comprising the controller in conjunction with one or more other components, as would be appreciated by a person of ordinary skill in the art.
(9) Referring now to the presently disclosed embodiments,
(10) As shown in
(11) The LKAS system 100 is an assistive apparatus for supporting safe driving by sensing driver attentiveness. To prevent lane departure of the vehicle 10, the LKAS system 100 may control the driving of the vehicle to keep the current lane in which the vehicle is traveling by applying a torque to a steering apparatus upon determining that lane departure will occur. The LKAS system 100 detects lane departure on the basis of images photographed by a camera provided to the front of the vehicle 10. In addition, the LKAS system 100 may detect the position of a vehicle which is traveling in an adjacent lane and use the detected position for torque control with respect to the steering apparatus. The LKAS system 100 may acquire information about the adjacent vehicle which is traveling in the adjacent lane from the AVM system 200.
(12) The AVM system 200 provides an AVM function during vehicle driving. The AVM function refers to a function of photographing around-view images of the vehicle 10 (i.e., image(s) showing the surrounding environment of the vehicle) when the vehicle 10 is parked or started and providing an image like a bird's eye view using the photographed images. The AVM system 200 may photograph around-view images of the vehicle 10 and provide the photographed images to the LKAS system 100 at the request of the LKAS system 100 even when the vehicle 10 is not parked or started.
(13)
(14) As shown in
(15) The LKAS switch 105 is an interface for receiving a control signal for activating or deactivating the LKAS function from a user and may be included as a part of a vehicle head unit (not shown). The LKAS switch 105 may receive a signal for controlling the LKAS function from the user and send the signal to the LKAS controller 110. The LKAS switch 105 may be implemented as a separate type switch or a user setting menu (USM) switch in a cluster.
(16) The LKAS controller 110 may control the overall operation of the LKAS system 100 and may be activated or deactivated by the LKAS function control signal sent from the LKAS switch 105. When the LKAS controller 110 is activated, the LKAS controller 110 may operate the LKAS system 100 in a normal mode or a composite mode. Here, the LKAS controller 110 may request the AVM system 200 to photograph around-view images and determine an operation mode based on the around-view images.
(17) The normal mode refers to a mode in which the position of the vehicle 10 with respect to the lane in which the vehicle 10 is traveling on the basis of only an image photographed by the front camera 115 and torque is controlled. Meanwhile, the composite mode refers to a mode in which torque is controlled in consideration of not only the image photographed by the front camera 115, but also information acquired from the around-view images.
(18) The LKAS controller 110 may analyze the around-view images, that is, images photographed within visibility ranges of front, rear, left, and/or right cameras of the AVM system 200, enter the normal mode when an adjacent vehicle is present, and enter the composite mode when no adjacent vehicle is present.
(19) A sequential description will be given of operation of the LKAS system 100 in the normal mode and operation of the LKAS system 100 in the composite mode.
(20) In the normal mode, the LKAS controller 110 may activate the vehicle position calculator 120 and deactivate the adjacent vehicle position calculator 130. The vehicle position calculator 120 may detect a lane in which the vehicle 10 is traveling by analyzing a front view image photographed by the front camera 115 showing a front view of the vehicle.
(21) For example, the vehicle position calculator 120 may detect the lane in which the vehicle 10 is traveling from the front view image in such a manner that the vehicle position calculator 120 removes noise from the front view image, generates a multi-resolution image from the noise-removed image, separates the multi-resolution image, and extracts a lane edge from the multi-resolution image while maintaining the multi-resolution image.
(22) The vehicle position calculator 120 may calculate a distance between the detected lane in which the vehicle 10 is traveling and the center of the vehicle 10. In
(23) A torque timing determination unit 142 and a torque determination unit 144 of the torque controller 140 may determine a torque timing and a torque necessary to locate the vehicle 10 at the center of the lane in which the vehicle 10 is traveling on the basis of the first distance a and the second distance b.
(24) The torque timing refers to a torque control start timing. The torque timing may be advanced as a difference (absolute value) between the ratio of the first distance a to the second distance b and one increases and may be delayed as the difference between the ratio of the first distance a to the second distance b and one decreases. That is, the difference between the ratio of the first distance a to the second distance b and one is a value indicating how close the vehicle 10 is to the left or right lane.
(25) The torque refers to a degree of torque applied during torque control. The torque may increase as the difference (absolute value) between the ratio of the first distance a to the second distance b and one increases and may decrease as the difference between the ratio of the first distance a to the second distance b and one decreases.
(26) The torque timing and torque determined by the torque controller 140 are sent to the steering controller 150. The steering controller 150 outputs a signal for controlling the steering apparatus 170 according to the torque timing and the torque. In addition, the steering controller 150 may output the signal to the control state display 160.
(27) The control state display 160 may be implemented as a display, a speaker, a haptic module of the dashboard of the vehicle 10, or the like. For example, a torque control state according to the steering controller 150 may be displayed through the display of the dashboard of the vehicle 10 and, when an emergency torque control situation is generated, a warning sound may be output through the speaker or haptic alarm may be output.
(28) The steering apparatus 170 is a means for assisting steering of the vehicle 10 and may include at least one of an electric power steering (EPS) and a motor driven power steering (MDPS). The steering apparatus 170 may locate the vehicle 10 at the center of the lane in which the vehicle is traveling under the control of the steering controller 150.
(29) In the composite mode, the LKAS controller 110 may activate both the vehicle position calculator 120 and the adjacent vehicle position calculator 130.
(30) The vehicle position calculator 120 calculates the first distance a and the second distance b and delivers the first and second distances a and b to the torque controller 140, as described above.
(31) The adjacent vehicle position calculator 130 may calculate a distance between the vehicle 10 and an adjacent vehicle traveling in proximity to the vehicle 10 according to the around-view images of the AVM system 200.
(32) As shown in
(33) If only one of the first and second adjacent vehicles is present, only the horizontal distance between the vehicle 10 and the present adjacent vehicle is calculated. The adjacent vehicle position calculator 130 may send the calculated third and fourth distances c and d to the torque controller 140.
(34) The torque controller 140 may generate a first proximity index and a second proximity index according to the first to fourth distances a to d and may determine whether the first and second proximity indices are respectively less than first and second threshold values.
(35) When the first and second proximity indices are respectively less than the first and second threshold values and predetermined conditions are satisfied, the torque controller 140 may correct the torque timing and torque. If the first and second proximity indices exceed the first and second threshold values and the predetermined conditions are satisfied, the torque controller 140 may determine the torque timing and torque in the same manner as the normal mode instead of correcting the torque timing and torque.
(36) Specifically, the torque controller 140 may generate the first proximity index by subtracting the first distance a from the third distance c. Referring to
(37) Similarly, the torque controller 140 may generate the second proximity index by subtracting the second distance b from the fourth distance d. Referring again to
(38) The torque controller 140 may determine whether the first proximity index c-a is less than the first threshold value v and determine whether the second proximity index d-b is less than the second threshold value w. That is, the torque controller 140 may determine whether the first adjacent vehicle and the second adjacent vehicle are traveling excessively close to the left and right lanes.
(39) The first threshold value v and the second threshold value w may be determined in consideration of the width of the vehicle 10, the speed of the vehicle 10, the width of the lane, and driving style of the driver and may be identical to each other. However, the scope of the present disclosure is not limited thereto.
(40) The torque timing determination unit 142 and the torque determination unit 144 respectively determine the torque timing and the torque on the basis of the first distance a and the second distance b as in the normal mode. The torque timing and the torque determined in this manner are respectively defined as initial torque timing t1 and initial torque 1.
(41) Here, the torque includes information about a torque control direction, that is, information about whether torque control is performed for the vehicle in the left direction or right direction. For example, when the torque is positive (+), the torque control direction may be the left direction. When the torque is negative (), meanwhile, the torque control direction may be the right direction.
(42) When the first proximity index is less than the first threshold value v and the torque control direction determined on the basis of the first distance a and the second distance b is the left direction, the torque controller 140 may control the torque timing determination unit 142 and the torque determination unit 144 to respectively correct the initial torque timing t1 and the initial torque 1. In this case, the torque timing determination unit 142 may perform timing correction to advance or delay the initial torque timing by a timing correction value t. While the timing correction value t may be inversely proportional to the first proximity index, the scope of the present disclosure is not limited thereto.
(43) In addition, the torque timing determination unit 142 may receive a relative vertical distance of the first adjacent vehicle with respect to the vehicle 10 from the adjacent vehicle position calculator 130 and perform timing correction to advance or delay the initial torque timing by the timing correction value t based on the relative vertical direction. The relative vertical distance is a value obtained by subtracting the Y-coordinate value of the center of the first adjacent vehicle from the Y-coordinate value of the center of the vehicle 10. The vehicle 10 precedes the first adjacent vehicle when the relative vertical distance is a positive value, and the first adjacent vehicle precedes the vehicle 10 when the relative vertical distance is a negative value.
(44) Therefore, when the vehicle 10 precedes the first adjacent vehicle, torque control needs to be performed quickly since the first adjacent vehicle is not visible to the driver of the vehicle 10. Conversely, when the first adjacent vehicle precedes the vehicle 10, torque control may be performed slowly since the first adjacent vehicle is visible to the driver of the vehicle 10. That is, the torque timing determination unit 142 may advance the initial torque timing by the timing correction value t when the relative vertical distance between the first adjacent vehicle and the vehicle 10 is a positive value but may delay the initial torque timing by the timing correction value t when the relative vertical distance between the first adjacent vehicle and the vehicle 10 is a negative value.
(45) In this case, the torque determination unit 144 may perform torque correction to increase or decrease the initial torque by a torque correction value . While the torque correction value may be inversely proportional to the first proximity index, the scope of the present disclosure is not limited thereto.
(46) In addition, the torque determination unit 144 may receive the relative vertical distance between the first adjacent vehicle and the vehicle 10 from the adjacent vehicle position calculator 130 and perform torque correction to increase or decrease the initial torque by the torque correction value according to the relative vertical distance. Therefore, when the vehicle 10 precedes the first adjacent vehicle, torque control quantity needs to be increased since the first adjacent vehicle is not visible to the driver of the vehicle 10. Conversely, when the first adjacent vehicle precedes the vehicle 10, torque control quantity needs to be decreased since the first adjacent vehicle is visible to the driver of the vehicle 10. That is, the torque determination unit 144 may increase the initial torque by the torque correction value when the relative vertical distance between the first adjacent vehicle and the vehicle 10 is a positive value and may decrease the initial torque by the torque correction value when the relative vertical distance between the first adjacent vehicle and the vehicle 10 is a negative value.
(47) When the second proximity index is less than the second threshold value w and the torque control direction determined on the basis of the first distance a and the second distance b is the right direction, the torque controller 140 may control the torque timing determination unit 142 and the torque determination unit 144 to respectively correct the initial torque timing t1 and the initial torque .
(48) The torque timing determination unit 142 and the torque determination unit 144 respectively correct the initial torque timing t1 and the initial torque in the same manner as the aforementioned method, and thus detailed description thereof is omitted. That is, when the first proximity index is less than the first threshold value v and the torque control direction determined on the basis of the first distance a and the second distance b is the left direction (i.e., first case), or when the second proximity index is less than the second threshold value w and the torque control direction determined on the basis of the first distance a and the second distance b is the right direction (i.e., second case), the torque timing determination unit 142 and the torque determination unit 144 may respectively send a corrected torque timing t2=t1t and a corrected torque 2=1, which are respectively obtained by correcting the initial torque timing t1 and the initial torque 1, to the steering controller 150.
(49) Since the correction operation need not be performed in cases other than the first and second cases, the torque timing determination unit 142 and the torque determination unit 144 may respectively send the initial torque timing t1 and the initial torque 1 to the steering controller 150. Since operations of the steering controller 150, the control state display 160 and the steering apparatus 170 are substantially the same as in the normal mode, a detailed description thereof is omitted.
(50) With the LKAS system according to embodiments of the present disclosure, when an adjacent vehicle is present around the vehicle 10, the torque control timing and torque control quantity may be varied according to the distance between the vehicle 10 and the adjacent vehicle such that the driver of the vehicle 10 does not feel uncomfortable about LKAS control.
(51)
(52) As shown in
(53) The LKAS controller 110 may determine whether vehicles are present in left and right lanes adjacent to the vehicle 10 on the basis of around-view images received from the AVM system 200 (S20).
(54) When no adjacent vehicle is present in the left and right lanes (No of S20), the LKAS controller 110 operates the LKAS system 100 in the normal mode. The normal mode operation has been described with reference to
(55) On the other hand, when adjacent vehicles are present in the left and right lanes (Yes of S20), the LKAS controller 110 operates the LKAS system 100 in the composite mode and may activate both the vehicle position calculator 120 and the adjacent vehicle position calculator 130.
(56) The vehicle position calculator 120 may calculate the first distance a and the second distance b corresponding to information about the position of the vehicle 10, and the adjacent vehicle position calculator 130 may calculate the third distance c and the fourth distance d corresponding to information about the positions of adjacent vehicles (i.e., a first adjacent vehicle and second adjacent vehicle) (S30).
(57) The torque controller 140 may generate the first proximity index and the second proximity index based on the first to fourth distances a to d and determine whether the first proximity index and the second proximity index are respectively less than the first threshold value and the second threshold value. When the first proximity index and the second proximity index are respectively less than the first threshold value and the second threshold value, the torque controller 140 may correct the torque timing and torque. When the first proximity index and the second proximity index respectively exceed the first threshold value and the second threshold value, the torque controller 140 may determine the torque timing and torque in the same manner as the normal mode instead of correcting the torque timing and torque.
(58) The torque controller 140 may generate the first proximity index and the second proximity index on the basis of the first to fourth distances a to d and determine whether the first proximity index and the second proximity index are respectively less than the first threshold value and the second threshold value (S40).
(59) When the first proximity index is less than the first threshold value v and a torque control direction determined on the basis of the first distance a and the second distance b is the left direction and in cases other than a case in which the second proximity index is less than the second threshold value w and the torque control direction determined on the basis of the first distance a and the second distance b is the right direction (No of S40), the torque timing determination unit 142 and the torque determination unit 144 may respectively send the initial torque timing t1 and the initial torque 1 to the steering controller 150 as in the normal mode.
(60) When the first proximity index is less than the first threshold value v and a torque control direction determined on the basis of the first distance a and the second distance b is the left direction or when the second proximity index is less than the second threshold value w and the torque control direction determined on the basis of the first distance a and the second distance b is the right direction (Yes of S40), the torque timing determination unit 142 and the torque determination unit 144 may respectively send a corrected torque timing t2=t1t and a corrected torque 2=1, which are respectively obtained by correcting the initial torque timing t1 and the initial torque 1, to the steering controller 150 (S50 and S60).
(61) The aforementioned method may be implemented as computer-readable code stored in a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording media storing data readable by a computer system. Examples of the computer-readable recording medium include a ROM, a RAM, a magnetic tape, a magnetic disk, a flash memory, an optical data storage device and the like. In addition, the computer-readable recording medium may be distributed to computer systems connected through a computer communication network, stored and executed as code readable in a distributed manner.
(62) Although aspects of the present disclosure have been described herein for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from essential characteristics of the disclosure. Thus, embodiments disclosed herein are only exemplary and not to be considered as limitative of the disclosure. Accordingly, the scope of the disclosure is not to be limited by the above aspects but by the claims and equivalents thereof.