METHOD AND SYSTEM FOR CALCULATING VEHICLE TRAILER ANGLE

Abstract

Determining the yaw angle of a trailer with respect to the longitudinal axis of a towing vehicle is disclosed. This includes capturing first and second images of the trailer using a camera. Trailer orientation with respect to the vehicle is different on the two images. First and second trailer features are determined which are visible on the two images. The first and second features are at different positions of the trailer. A first angle estimation is calculated characterizing the pivot angle in a horizontal plane between the first feature on the first image and the first feature on the second image relative to a towing vehicle fix point. A second angle estimation is calculated characterizing the pivot angle in a horizontal plane between the second feature on the first image and the second feature on the second image relative to the fix point. The yaw angle is calculated based on the first and second angle estimations.

Claims

1. A method for determining the yaw angle of a trailer with respect to a longitudinal axis of a towing vehicle, the method comprising: capturing at least a first and a second image of a trailer using a camera, an orientation of the trailer with respect to the towing vehicle being different on the at least two images; determining at least a first and a second feature of the trailer which are visible on the first and second images, wherein the first and second features are arranged at different positions of the trailer; calculating a first angle estimation, the first angle estimation characterizing a pivot angle in a horizontal plane between the first feature on the first image and the first feature on the second image with respect to a fix point of the towing vehicle; calculating a second angle estimation, the second angle estimation characterizing a pivot angle in a horizontal plane between the second feature on the first image and the second feature on the second image with respect to the fix point of the towing vehicle; and calculating a yaw angle (YA) based on the first and second angle estimations.

2. The method according to claim 1, wherein on the first or second image, the yaw angle of the trailer with respect to the towing vehicle is zero or any known yaw angle which is usable as reference angle.

3. The method according to claim 1, wherein the fix point is a position of the camera or a position of a towball on the towing vehicle.

4. The method according to claim 1, wherein calculating first and second angle estimations comprises determining optical rays between the fix point and the first and second features at the first and second images.

5. The method according to claim 4, wherein camera calibration information is used for converting a position of the first and/or second feature into optical rays.

6. The method according to claim 1, wherein in addition to the first and second features, at least one further feature of the trailer is used for calculating the yaw angle.

7. The method according to claims 1, wherein the yaw angle is calculated by establishing a median value based on the at least two angle estimations.

8. The method according to claim 1, wherein the yaw angle is calculated by establishing an average value of the at least two angle estimations or by using a statistical approach applied to the angle estimations.

9. The method according to claim 1, further comprising determining an angle window, the angle window comprising an upper and a lower bound around yaw angle, determining a set of features which lead to angle estimations within the angle window, and using the determined set of features for future yaw angle calculations.

10. The method according to claim 1, wherein a value of calculated yaw angle is increased by a certain portion or percentage in order to remedy underestimations.

11. The method according to claim 1, wherein the camera is the rear view camera of the towing vehicle.

12. A system for determining the yaw angle of a trailer with respect to the longitudinal axis of a towing vehicle, the system comprising a camera for capturing images of the trailer and a processing entity for processing the captured images, the system further being configured to execute a method comprising: capturing at least a first and a second image of the trailer using the camera, an orientation of the trailer with respect to the towing vehicle being different on the at least two images; determining at least a first and a second feature of the trailer which are visible on the first and second images, wherein the first and second features are arranged at different positions of the trailer; calculating a first angle estimation, the first angle estimation characterizing a pivot angle in a horizontal plane between the first feature on the first image and the first feature on the second image with respect to a fix point of the towing vehicle; calculating a second angle estimation, the second angle estimation characterizing a pivot angle in a horizontal plane between the second feature on the first image and the second feature on the second image with respect to the fix point of the towing vehicle; and calculating the yaw angle based on the first and second angle estimations.

13. A vehicle comprising a system according to claim 12.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Various aspects of the invention, including its particular features and advantages, will be readily understood from the following detailed description and the accompanying drawings, in which:

[0038] FIG. 1 shows an exemplary top view on a vehicle towing a trailer;

[0039] FIG. 2 schematically illustrates angle estimations based on a first and a second feature captured by camera images in different pivot angles between the trailer and the towing vehicle;

[0040] FIG. 3 shows a schematic block diagram illustrating the steps of a method for determining the yaw angle of a trailer with respect to the longitudinal axis of a towing vehicle.

DETAILED DESCRIPTION

[0041] The present invention will now be described more fully with reference to the accompanying drawings, in which example embodiments are shown. The embodiments in the figures may relate to example embodiments, while all elements and features described in connection with embodiments may be used, as far as appropriate, in combination with any other embodiment and feature as discussed herein, in particular related to any other embodiment discussed further above. However, this invention should not be construed as limited to the embodiments set forth herein. Throughout the following description similar reference numerals have been used to denote similar elements, parts, items or features, when applicable.

[0042] The features of the present invention disclosed in the specification, the claims, examples and/or the figures may both separately and in any combination thereof be material for realizing the invention in various forms thereof.

[0043] FIG. 1 shows a top view illustration of a vehicle 1 towing a trailer 2. The vehicle 1 includes a longitudinal axis LAV which runs through the centre of the vehicle 1. Similarly, the trailer 2 includes a longitudinal axis LAT which runs through the centre of the trailer 2. The trailer 2 is coupled with the vehicle 1 by means of a trailer hitch including a towball 4.

[0044] In certain driving situations, the longitudinal axis LAV of the vehicle and the longitudinal axis LAT of the trailer may not be aligned in parallel or may not fall into one another but the axes may confine a yaw angle YA. In other words, the yaw angle YA defines the angular deviation of the longitudinal axis LAT of the trailer 2 with respect to the longitudinal axis LAV of the vehicle 1. The yaw angle YA may be measured in a horizontal plane which includes the longitudinal axis LAT of the trailer 2 as well as the longitudinal axis LAV of the vehicle 1.

[0045] The knowledge of yaw angle YA is – inter alia – advantageous in trailer assistance systems, for example.

[0046] For determining the yaw angle YA, multiple images of at least a portion of the trailer 2 are captured by means of a camera 3. The camera 3 may be, for example, a rear view camera of the vehicle, which may be also used for capturing images of the surroundings of the car when driving backwards.

[0047] FIG. 2 shows a schematic diagram showing the angular relationship of a first and a second feature F1, F2 of the trailer at different points of time at which the trailer 2 has a different yaw angle with respect to the towing vehicle 1.

[0048] The camera 3 may capture two or more images at different points of time at which the angular position of the trailer 2 with respect to the vehicle 1 is different. For example, an image series may be captured.

[0049] In the present example, the second image may show an orientation of the trailer 2 with respect to the vehicle at a yaw angle YA = 0°. However, according to other embodiments, the yaw angle YA may be any other reference yaw angle which is known in advance and which can be used for determining the current yaw angle.

[0050] Features on the trailer are located and matched using a feature detection and matching algorithm. For example, the Harris Corner Detector, Scale-Invariant Feature Transform (SIFT) algorithm, Speeded Up Robust Features (SURF) algorithm, Binary Robust Invariant Scalable Keypoints (BRISK) algorithm, Binary Robust Independent Elementary Features (BRIEF), Oriented FAST and rotated BRIEF (ORB) algorithm or another suitable feature detection and matching algorithm could be used.

[0051] The feature detection and matching algorithm may detect image features that are on the trailer or not on the trailer. To segment the trailer features from the non-trailer features a number of different methods could be used. For instance, when driving forwards in a straight line, trailer features can be segmented from non-trailer features by looking for features that remain in the same position over time. Alternatively, the motion of background features can be modelled over time using the vehicle’s known motion. This could be extracted from CAN data regarding speed and steering. Features which do not fit the Epipolar constraint of the Essential Matrix could then be considered as trailer features.

[0052] On the images captured by the camera 3, multiple different features may be identifiable. In FIG. 2, features F1 and F2 are illustrated which are identified at different angular positions with respect to a fix point of the vehicle 1. So the upper pair of the first and second features F1, F2 (associated with the solid optical rays connecting the features F1 and F2 with the camera 3) are identified in a first image, the lower pair of the first and second features F1, F2 (associated with dashed optical rays connecting the features F1 and F2 with the camera 3) are identified in a second image at a different point of time. For determining the optical rays connecting the features F1 and F2 with the camera 3, calibration information of the camera 3 may be used to transform the location of features in image coordinates into optical rays. In other words, for associating camera position and feature positions, the location of features on the image is concatenated with a position of a fix point of the vehicle based on calibration information of the camera 3.

[0053] After determining the optical rays R between the fix point and the at least two features in first and second image, the pivot angle of first feature and second feature is determined. In FIG. 2, α1 illustrates the pivot angle of first feature F1 between the two captured images and α2 illustrates the pivot angle of second feature F2 between the images. Preferably, more than two features of the trailer are determined and tracked over multiple images. In addition, preferably, more than two images are captured at different points of time in order to enhance the result of yaw angle estimation.

[0054] After determining the pivot angles α1, α2, the yaw angle YA can be calculated based on the pivot angles α1, α2. The yaw angle YA can be developed in different ways:

[0055] According to a first embodiment, the yaw angle YA may be calculated as being the median of the developed pivot angles α1, α2. According to another embodiment, the yaw angle YA may be determined by calculating the arithmetical mean of developed pivot angles α1, α2. According to yet another embodiment, the yaw angle YA may be determined by using a stochastic approach. For instance, the variance of each features angle could be measured, and only features with a low variance could be used for deriving the median.

[0056] The yaw angle YA could be further refined by a Kalman filter or dynamic model based on the vehicles speed and steering information. The speed and steering could be derived from CAN data or using visual methods which process the image data, for instance.

[0057] One advantage of the using the median is that the method is extremely robust. In poor lighting conditions a median will continue to produce a reliable and consistent angle estimate even if there is only one feature being tracked. The median is also very robust to outliers, which may occur if the feature tracking is poor or the image is particularly cluttered.

[0058] It appeared that not all features visible on the captured images are equally suitable for calculating yaw angle YA. In order to reduce computational complexity and robustness, those features are selected and further used for determining yaw angle, which provide pivot angles quite close to the actual yaw angle. For feature selection, only those features may be tracked in future images which provided pivot angles α1, α2 in a certain window around the actual yaw angle. For example, the window may be defined by an upper and a lower boundary, the upper and lower boundary defining an angular window around the actual yaw angle. For example, the window may span over a distance of 2° to 10°, more particular between 3° and 5°. All features which led to pivot angles within the window in the last two or more yaw angle determination steps are further tracked in the next captured images.

[0059] In addition, in case that the calculated yaw angle YA is estimated too low in comparison to actual yaw angle YA, the calculated yaw angle YA can be scaled up for a certain portion or percentage in order to mitigate the underestimate.

[0060] FIG. 3 shows a block diagram illustrating the method steps of a method for determining the yaw angle YA of a trailer 2 with respect to the longitudinal axis LAV of a towing vehicle 1.

[0061] As a first step, a first and a second image of the trailer are captured (S10).

[0062] After image capturing, features of the trailer visible on the first and the second image are determined (S11).

[0063] After feature determination, a first and a second angle estimation is calculated based on determined the first and second features (S12, S13).

[0064] Finally, the yaw angle is calculated based on the first and second angle estimations (S14).

[0065] It should be noted that the description and drawings merely illustrate the principles of the proposed invention. Those skilled in the art will be able to implement various arrangements that, although not explicitly described or shown herein, embody the principles of the invention.

LIST OF REFERENCE NUMERALS

[0066] TABLE-US-00001 List of reference numerals 1 vehicle 2 trailer 3 camera 4 towball α1 first angle estimation α2 second angle estimation F1 first feature F2 second feature LAT longitudinal axis of trailer LAV longitudinal axis of vehicle R optical ray YA yaw angle