Around view monitor system and monitoring method

Abstract

The present disclosure relates to an around view monitor (AVM) system that provides image information on the ambient conditions of a vehicle to a driver. In displaying a top-view image in which the front, rear, left, and right conditions of a vehicle are seen downward from a portion over the vehicle, an AVM system and method checks a driving state or driving direction of the vehicle on the basis of information received from sensors and elements included in the vehicle, and outputs the top-view image which is suitably edited depending on the driving conditions, thereby providing information necessary for driving to a driver.

Claims

1. An around view monitor (AVM) system, comprising: an image data receiver configured to receive image data captured by a camera; a vehicle information receiver configured to receive a speed of a vehicle, and steering angle information of the vehicle; and a controller configured to generate a top-down view image based on the image data, the top-down view image comprising an area surrounding the vehicle, determine a travel direction of the vehicle based on the vehicle speed and the steering angle information, modify the top-down view image such that a visible portion of the area surrounding the vehicle corresponding to the travel direction is increased in proportion to increased vehicle speed, and decreased in proportion to decreased vehicle speed, and display the modified top-down view image on a display, wherein the controller is further configured to: make a visible amount of a front portion of the top-down view image and a visible amount of the rear image different, by using a first reference speed α, a second reference speed ζ, and visible amount adjustment reference values δ and ε, and wherein the controller is further configured to: determine whether the vehicle speed is higher than or equal to a speed α+δ; determine whether the vehicle speed is higher than or equal to a speed α+2δ; and modify the top-down view image such that a visible amount of the front portion of the top-down view image increases in proportion to the speed α+δ and further increases in proportion to the speed α+2δ, as the vehicle speed becomes higher.

2. The around view monitor (AVM) system of claim 1, wherein the controller is further configured to: determine whether the vehicle speed is higher than or equal to a speed ζ+ε; determine whether the vehicle speed is higher than or equal to a speed ζ+2ε; and modify the top-down view image such that a visible amount of the rear portion of the top-down view image increases in proportion to the speed α+δ and further increases in proportion to the speed α+2δ, as the vehicle speed becomes higher.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is diagrams illustrating images that a related art AVM system displays on a screen.

(2) FIG. 2 is diagrams illustrating images that the related art AVM system displays on a screen depending on a driving state of a vehicle.

(3) FIG. 3 is a block diagram illustrating the related art AVM system.

(4) FIG. 4 is a block diagram illustrating a structure of an AVM system according to an embodiment of the present invention.

(5) FIG. 5 is diagrams illustrating respective images that the AVM system according to an embodiment of the present invention displays on a screen depending on a driving state of a vehicle.

(6) FIG. 6 is diagrams illustrating respective images that the AVM system according to an embodiment of the present invention displays on a screen depending on a driving speed of a vehicle.

(7) FIG. 7 is diagrams illustrating respective images that the AVM system according to an embodiment of the present invention displays on a screen depending on a driving direction of a vehicle.

(8) FIG. 8 is a flowchart illustrating an AVM method according to an embodiment of the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS

(9) The advantages, features and aspects of the present invention will become apparent from the following description of the embodiments with reference to the accompanying drawings, which is set forth hereinafter. The present invention may, however, be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present invention to those skilled in the art.

(10) The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

(11) Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

(12) FIG. 4 is a block diagram illustrating a structure of an AVM system according to an embodiment of the present invention and a flow of information regarding the AVM system.

(13) An AVM system 400 according to an embodiment of the present invention includes an image data receiver 401, a vehicle information receiver 402, and a controller 403.

(14) The image data receiver 401 receives data on an image (which is captured by a camera 410 attached to a vehicle) around the vehicle. The camera 410 is provided as at least one or more. Generally, four cameras that respectively capture the front, rear, left, and right regions of a vehicle are mounted on the vehicle.

(15) The image data receiver 401 transfers image data, received from the camera 410, to the controller 403.

(16) The vehicle information receiver 402 receives vehicle information from sensors and elements included in the vehicle. In a related art AVM system, a vehicle information receiver receives only gear information from a transmission 420. In the AVM system according to an embodiment of the present invention, the vehicle information receiver 402 receives information on a vehicle speed from a vehicle speed sensor 421, and/or receives information on a vehicle-steering angle from a steering wheel angle sensor 422 of the vehicle.

(17) The vehicle information receiver 402 transfers gear information, vehicle speed information, and steering angle information, which are from the sensors and elements included in the vehicle, to the controller 403.

(18) The controller 403 generates a top-view image shown to a driver inside the vehicle, on the basis of image data received from the image data receiver 401. The top-view image is displayed by a monitor 430 inside the vehicle.

(19) The controller 403 checks a driving state or driving direction of the vehicle on the basis of the vehicle information received from the vehicle information receiver 402.

(20) The controller 403 determines the driving state of the vehicle on the basis of the gear information or the gear information and the vehicle information.

(21) In determining the driving state of the vehicle, the controller 403 may check whether the gear information is driving or backing to determine the driving state of the vehicle. Alternatively, when the gear information is driving and the vehicle speed is higher than or equal to a first reference speed, the controller 403 may determine that the vehicle is driving, or when the gear information is backing and the vehicle speed is higher than or equal to a second reference speed, the controller 403 may determine that the vehicle is backing.

(22) When the driving state of the vehicle does not correspond to forward or reverse, the controller 403 determines the vehicle as being in a stop state. Also, when the gear information is a neutral state and the vehicle speed is lower than or equal to a third reference speed, the controller 403 may determine the vehicle as being in the stop state. Here, the third reference speed has a value lower than the first reference speed.

(23) The controller 403 may determine the driving direction of the vehicle on the further basis of the steering angle information as well as the gear information and vehicle information.

(24) In this case, the controller 403 checks whether the vehicle is forward or reverse on the basis of the gear information or the gear information and the vehicle speed information, and checks whether the vehicle is left steering or right steering on the basis of the steering angle information. Therefore, the controller 403 divides the driving state of the vehicle into six driving states such as a forward state, a forward left turn state, a forward right turn state, a reverse state, a reverse left turn, and a reverse right turn.

(25) The controller 403 determines the driving state or driving direction of the vehicle on the basis of the vehicle information, and differently edits top-view images displayed on a screen, on the basis of the driving conditions.

(26) FIG. 5 illustrates top-view images that the AVM system according to an embodiment of the present invention displays differently depending on a driving state of a vehicle.

(27) When the vehicle is in the stop state, the controller 403 outputs a top-view image (see a portion (b) of FIG. 5) in which the visible amount of a front image is the same as that of a rear image and the visible amount of a left image is the same as that of a right image. In this case, the front image may be displayed slightly broader than the rear image.

(28) When the vehicle is driving forward, the controller 403 edits and outputs the top-view image such that the visible amount of the front image is higher than that of the rear image (see a portion (a) of FIG. 5). When the vehicle is backing, the controller 403 edits and outputs the top-view image such that the visible amount of the rear image is higher than that of the front image (see a portion (c) of FIG. 5).

(29) FIG. 6 illustrates top-view images that the AVM system according to an embodiment of the present invention displays differently in consideration of a driving state and driving speed of a vehicle.

(30) The AVM system makes the visible amount of the front image and the visible amount of the rear image different depending on the vehicle speed, and thus, the controller 403 may edit and output the top-view image such that the visible amount of the front image and the visible amount of the rear image increase or decrease in proportion to the vehicle speed.

(31) Also, the controller 403 may make the visible amount of the front image and the visible amount of the rear image different, by using the first and second reference speeds α and ζ visible amount adjustment reference values δ and ε that are used as reference values in determining whether the vehicle is forward or reverse.

(32) When the vehicle is in a forward state, the controller 403 determines whether a vehicle speed is higher than or equal to “α+δ” or “α+2δ”, and edits and outputs the top-view image such that the visible amount of the front image increases as the vehicle speed becomes higher (see portions (a) and (b) of FIG. 6).

(33) When the vehicle is in a reverse state, the controller 403 determines whether a vehicle speed is higher than or equal to “ζ+ε” or “ζ+2ε”, and edits and outputs the top-view image such that the visible amount of the rear image increases as the vehicle speed becomes higher (see portions (c) and (d) of FIG. 6).

(34) FIG. 7 illustrates a top-view image that the AVM system according to an embodiment of the present invention displays differently depending on a driving state and driving direction of a vehicle.

(35) The controller 403 differently edits top-view images depending on six driving states of the vehicle that are obtained on the basis of the gear information and steering angle information or the gear information, vehicle speed information, and steering angle information. In this case, as illustrated in FIG. 7, the controller 403 edits and outputs the top-view images such that an image in a direction matched with the driving direction of the vehicle is relatively broader displayed on a screen.

(36) To provide a detailed description, when the driving direction of the vehicle is forward, the controller 403 edits and outputs the top-view image such that an image (drawing in a middle upper portion) captured by a front camera is displayed broader than images respectively captured by other cameras, on a screen. When the driving direction of the vehicle is forward left turn, the controller 403 edits and outputs the top-view image such that images (drawing in a left upper portion) respectively captured by the front camera and a left camera are displayed broader than images respectively captured by other cameras, on a screen. When the driving direction of the vehicle is forward right turn, the controller 403 edits and outputs the top-view image such that images (drawing in a right upper portion) respectively captured by the front camera and a right camera are displayed broader than images respectively captured by other cameras, on a screen. When the driving direction of the vehicle is reverse, the controller 403 edits and outputs the top-view image such that an image (drawing in a middle lower portion) respectively captured by a rear camera is displayed broader than images respectively captured by other cameras, on a screen. When the driving direction of the vehicle is reverse left turn, the controller 403 edits and outputs the top-view image such that images (drawing in a left lower portion) respectively captured by the rear camera and the left camera are displayed broader than images respectively captured by other cameras, on a screen. When the driving direction of the vehicle is reverse right turn, the controller 403 edits and outputs the top-view image such that images (drawing in a right lower portion) respectively captured by the rear camera and the right camera are displayed broader than images respectively captured by other cameras, on a screen.

(37) As described above, the controller 403 differently edits the top-view images depending on the driving state or the driving direction, and transfers the edited images to the monitor 430 inside the vehicle. A driver can obtain more ambient environment images in the driving direction of the vehicle by using the monitor 430. Accordingly, the driver can obtain more information necessary for driving, and thus, driving convenience can be provided to the driver. Also, the driver can perceive objects disposed in a relatively broader area in the driving direction, and thus can more safely drive the vehicle.

(38) FIG. 8 illustrates a flowchart of an AVM method according to an embodiment of the present invention.

(39) In operation S800, the AVM system receives data on images around a vehicle from front, rear, left, and right cameras attached to the vehicle. In operation S810, the AVM system generates top-view images (which are images seen downward from a portion over the vehicle on the basis of the image data) respectively showing the left, rear, left, and right conditions of vehicle.

(40) The AVM system receives gear information of the vehicle from a transmission of the vehicle, receives a vehicle speed information from a vehicle speed sensor of the vehicle, and receives steering angle information from a steering wheel angle sensor of the vehicle, in operation S820. The AVM system checks the driving condition of the vehicle on the basis of the vehicle information in operation S830. In this case, the AVM system determines whether the vehicle is a forward state, a rear state, or a stop state according to whether the gear information is driving or backing and whether the vehicle speed is higher than or lower than a reference speed.

(41) When it is determined that the driving state of the vehicle is driving forward in operation S840, the AVM system increases the visible amount of a front image among the top-view images, in operation S850. When it is determined that the driving state of the vehicle is backing in operation S841, the AVM system increases the visible amount of a rear image among the top-view images, in operation S851. When it is determined that the driving state of the vehicle is not forward or reverse, the AVM system identically maintains the visible amounts of the front image and rear images among the top-view images.

(42) The AVM system checks the left/right moving direction of the vehicle on the basis of the steering angle information from the steering wheel angle sensor in operation S860, and, by adjusting the visible amounts of the left image and the right image among the top-view images, the AVM system increases the visible amount of an image in a direction matched with the moving direction of the vehicle, in operation S870.

(43) In operation S880, the AVM system displays the top-view images, which are differently edited depending on the driving condition, on a monitor inside the vehicle. Accordingly, the AVM system provides image information, which is necessary for driving, to a driver.

(44) As described above, in editing an image captured by a camera attached to a vehicle to provide a top-view image, the present invention checks a driving state and driving direction of the vehicle on the basis of information received from sensors and elements included in the vehicle, and displays top-view images which is differently edited depending on the driving conditions, thus providing driving convenience to a driver and reducing the risk of an accident.

(45) A number of exemplary embodiments have been described above. Nevertheless, it will be understood that various modifications may be made. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents. Accordingly, other implementations are within the scope of the following claims.