Automated hitching assist system
10150505 ยท 2018-12-11
Assignee
Inventors
- Brandon Herzog (Waterford, MI, US)
- Hao Sun (Auburn Hills, MI, US)
- Joyce Chen (West Bloomfield, MI, US)
- Ibro Muharemovic (Shelby Township, MI, US)
Cpc classification
B60R11/04
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/808
PERFORMING OPERATIONS; TRANSPORTING
B60D1/62
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/301
PERFORMING OPERATIONS; TRANSPORTING
B60W30/09
PERFORMING OPERATIONS; TRANSPORTING
B62D13/005
PERFORMING OPERATIONS; TRANSPORTING
G06V20/56
PHYSICS
B62D15/0295
PERFORMING OPERATIONS; TRANSPORTING
B60D1/36
PERFORMING OPERATIONS; TRANSPORTING
B60W2554/00
PERFORMING OPERATIONS; TRANSPORTING
B60W2420/403
PERFORMING OPERATIONS; TRANSPORTING
International classification
B62D13/06
PERFORMING OPERATIONS; TRANSPORTING
B60R1/00
PERFORMING OPERATIONS; TRANSPORTING
B60R11/04
PERFORMING OPERATIONS; TRANSPORTING
B60W30/09
PERFORMING OPERATIONS; TRANSPORTING
B62D15/02
PERFORMING OPERATIONS; TRANSPORTING
B62D13/00
PERFORMING OPERATIONS; TRANSPORTING
B60D1/36
PERFORMING OPERATIONS; TRANSPORTING
B60D1/62
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A hitch assist system for a vehicle comprises a camera mounted to view a reverse path of a vehicle, an input device connected for the hitch assist system, and a controller. The controller includes instructions for detecting a trailer proximate to a vehicle with the camera, determining a vehicle hitch ball location, determining a trailer hitch location, and calculating a vehicle path from an initial position to a final position. The vehicle hitch ball is laterally aligned with the trailer hitch in the final position. The controller also includes instructions for calculating the steering and braking maneuvers necessary to move the vehicle along the path to the final position and sending instructions to a vehicle steering system and a vehicle brake system to perform the calculated maneuvers.
Claims
1. A method of controlling a vehicle, the method comprising: initiating a trailer hitch assist system with an input device; detecting a trailer proximate to a vehicle with at least one sensor mounted to the vehicle; determining a vehicle hitch ball location; determining a trailer hitch location with a controller for a hitch assist system; calculating a vehicle path from an initial position to a final position with the controller; adjusting a hitch ball height with an adjustable suspension system of the vehicle before the final position, wherein the vehicle hitch ball is laterally aligned with the trailer hitch in the final position; calculating with the controller steering and braking maneuvers necessary to move the vehicle along the path to the final position; and sending instructions from the controller to a vehicle steering system and a vehicle brake system to perform the calculated steering and braking maneuvers.
2. The method as recited in claim 1, wherein determining a vehicle hitch ball location further comprises one of inputting to the controller with a position marking device and by performing image analysis with the controller on the image.
3. The method as recited in claim 1, further comprising: wherein the at least one sensor is a camera; detecting an object proximate to the vehicle path with one of the camera or another sensor for the vehicle; and sending instructions from the controller to perform a collision avoidance action.
4. The method as recited in claim 3, wherein detecting an object proximate to the vehicle path includes determining an offset of a front wheel path, from a rear wheel path based upon a steering angle of the vehicle of detecting any objects within that path, and sending instructions from the controller to perform at lease one collision avoidance action includes recalculating, by the controller, a new vehicle path with a limited steering angle to avoid the detected object.
5. The method of claim 4, wherein the at least one collision avoidance action is one of applying vehicle brakes of the vehicle brake system and recalculating a new vehicle path with the controller to avoid the detected object, then calculating the new steering and braking maneuvers necessary to move the vehicle along the new vehicle path and sending instructions from the controller to perform the new calculated maneuvers.
6. The method as recited in claim 1, wherein the input device is an independent wireless device.
7. The method as recited in claim 1, further comprising: instructing the brake system to stop the vehicle when the controller determines the vehicle is at an intermediate position; verifying relative height between the hitch ball and the trailer hitch with an operator input; and sending instructions to the steering systems and brake systems to continue performing the calculated steering and braking maneuvers to the final position.
8. A hitch assist system for a vehicle, the hitch assist system comprising: a camera mounted to view a reverse path of a vehicle; an input device connected for the hitch assist system; and a controller including instructions for: detecting a trailer proximate to a vehicle with the camera; determining a vehicle hitch ball location; determining a trailer hitch location; calculating a vehicle path from an initial position to a final position, wherein the vehicle hitch ball is laterally aligned with the trailer hitch in the final position; instructing a brake system of the vehicle to stop the vehicle when the vehicle is at an intermediate position between the initial position and the final position; verifying, at the intermediate position, a relative height between the hitch ball and the trailer hitch with an operator input; calculating steering and braking maneuvers necessary to move the vehicle along the path to the final position; and sending instructions to a vehicle steering system and the vehicle brake system to perform the calculated steering and braking maneuvers; and an air suspension system configured to adjust the hitch ball height based on the verified relative height at the intermediate position.
9. The hitch assist system as recited in claim 8, further comprising a position marking device, wherein the vehicle hitch ball location is input to the controller with the position marking device.
10. The hitch assist system as recited in claim 8, wherein the controller includes further instructions for: detecting an object proximate to the vehicle path with one of the camera or another sensor for the vehicle; and sending instructions from the controller to perform a collision avoidance action.
11. The hitch assist system as recited in claim 10, wherein detecting an object proximate to the vehicle path includes determining an offset of a front wheel path, from a rear wheel path based upon a steering angle of the vehicle of detecting any objects within that path and the controller sends instructions to perform at least one collision avoidance action includes the controller recalculating a new vehicle path with a limited steering angle to avoid the detected object.
12. The hitch assist system of claim 11, the controller includes further instructions for determining the at least one collision avoidance action is one of: applying the vehicle brakes with the vehicle brake system; and recalculating a new vehicle path with the controller to avoid the detected object, then calculating the new steering and braking maneuvers necessary to move the vehicle along the new vehicle path and sending instructions from the controller to perform the new calculated maneuvers.
13. The hitch assist system as recited in claim 8, wherein the input device is an independent wireless device.
14. The hitch assist system as recited in claim 8, wherein the controller includes further instructions for: sending instructions to the steering systems and brake systems to continue performing the calculated steering and braking maneuvers to the final position.
15. A method of controlling a vehicle, the method comprising: providing a controller configured to provide signals for controlling steerable wheels of the vehicle via a powered steering system operatively coupled to the steerable wheels; providing a driver input device in communication with the controller, the driver input device for receiving a directional input from a driver related to an intended direction of travel of the vehicle in reverse; providing a camera for viewing a rear travelling path of the vehicle, the camera configured to capture images of the rear travelling path; receiving, at the controller, the directional input from the driver comprising the intended direction of travel of the vehicle; analyzing, by the controller, the one or more captured images to detect a trailer proximate to the vehicle; determining, by the controller, a vehicle hitch ball location; determining, by the controller, a trailer hitch position based on the one or more analyzed captured images; calculating, by the controller, a vehicle path from an initial position to a final position based on the received directional input; implementing, by the controller, a command to the powered steering system to steer the wheels from the initial position to the final position; and implementing, by the controller, a command to an air suspension system to adjust a hitch ball height at an intermediate position between the initial position and the final position allowing the vehicle hitch ball to be laterally aligned with the trailer hitch in the final position.
16. The method of claim 15, further including: verifying a relative height between the hitch ball and the trailer hitch with an operator input; calculating the steering and braking maneuvers necessary to move the vehicle along the path to the final position; and sending instructions to a vehicle steering system and a vehicle brake system to perform the calculated steering and braking maneuvers.
17. The method of claim 16, wherein determining a vehicle hitch ball location further comprises one of inputting to the controller with a position marking device and by performing image analysis with the controller on the image.
18. The method of claim 15, wherein the input device is an independent wireless device.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present disclosure will become more fully understood from the detailed description and the accompanying drawings, wherein:
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) The following description is merely exemplary in nature and is in no way intended to limit the disclosure, its application, or uses. For purposes of clarity, the same reference numbers will be used in the drawings to identify similar elements.
(8) Referring to
(9) The hitch assist system 12 may be used along with other vehicle systems, such as a suspension adjustment system 14, and an electronic brake system (EBS) 16. The hitch assist system 12 may also be included with a trailer backing assist system, which can be used to maneuver the vehicle 10 and trailer 11 combination after the trailer 11 is secured to the vehicle 10. A controller 18 for the hitch assist system 12 can be common with other vehicle systems 14, 16 and the trailer backing assist system or may be independent.
(10) The hitch assist system 12 provides semi-autonomous and autonomous vehicle operation to move the vehicle 10 into the appropriate location to align the hitch ball 20 on the vehicle 10 with the hitch 21 of the trailer 11. When backing a vehicle 10 to a trailer 11 for hitching a vehicle operator typically needs another person to provide direction regarding the relative position between the vehicle 10 and trailer 11 and the movement needed to align the vehicle hitch ball 20 with the trailer hitch 21. The hitch assist system 12 allows a single operator to align the vehicle hitch ball 20 with the trailer hitch 21.
(11) An input device 22 for to inputting commands to the hitch assist system 12 is provided. The input device may be HMI located in the vehicle 10 or may be provided in a device 22 that is wirelessly connected to the controller 18 to control of the vehicle 10 remotely. Thus, in one embodiment the hitch assist system 12 can be operated while outside the vehicle 10 and proximate to the vehicle 10 and trailer 11.
(12) The hitch assist system 12 includes a camera 30 mounted to provide a view of a rear driving direction for the vehicle 10. The camera 30 may be a monocular camera, binocular camera, or another type of sensing device capable of providing a view of the rear travelling path of the vehicle 10. The camera 30 may be mounted in any location that provides a view of the rear driving path of the vehicle 10. The controller 18 may be connected to the camera 30 to analyze the image/data and identify objects 34, shown in
(13) In one embodiment, the hitch assist system 12 or another similar system 14 can determine a probability of collision when an object 34 is detected. If the probability of collision exceeds a predetermined threshold, the controller 18 indicates that at least one vehicle collision avoidance action is required. The required action can be in the form of a warning to the operator when an object is detected and/or the hitch assist system 12 or the other system 14 may be actuated to slow, stop, or steer the vehicle 10
(14) Referring to
(15) The hitch assist system 12 may calculate the path 44 (shown in
(16) To calculate the vehicle path 44 to the final position 42 the hitch assist system 12 must know the location of the vehicle hitch ball 20 and the trailer hitch 21. The controller 18 may use a coordinate system which is centered on the rear axle 46 of the vehicle 10. The vehicle hitch ball 20 may be a known distance from the rear axle 46. Alternatively, the controller 18 may calculate the location of the hitch ball 20 based on information from the camera 30 or sensors 36. Likewise, the location of the trailer hitch 21 may also be determined by the controller 18 based on information from the camera 30 and sensors 36. The position of the trailer hitch 21 can also be determined by marking the position with a position marking device 48. For example, the position marking device 48 may be a digital GPS or a keyfob for the vehicle 10. The position marking device 48 may be placed on the trailer hitch for the duration of moving from the initial position 40 to the final position 42, or the position marking device 48 may mark the trailer hitch 21 location at the outset of the maneuver and that marked location is used for the duration of the maneuver, e.g. the keyfob is placed back in the vehicle 10 after marking the trailer hitch 21 position and before the path following begins.
(17) Referring to
(18)
(19) A further embodiment, the controller 18 includes instructions for detecting objects 34 proximate to the vehicle 10 with at least one of the sensors 36, camera 30 and GPS system 38. The controller 18 algorithm performs a probabilistic analysis of sensor-reported objects including fixed objects and moving pedestrians, expected and/or possible motion of a detected pedestrian, and the planned vehicle path. The objects identified proximate the vehicle are classified. Classification can include identifying if the object is fixed or moving and if moving at what speed and direction. The information obtained regarding the proximate objects is utilized to generate a predictive model of possible locations of a moving object at some future time. The predictive model can account for movement in view of the type of object, such as whether the object is a pedestrian walking or riding a bike. Movement of the pedestrian may also be predicted based on other identifying characteristics, such as whether the pedestrian is an adult or child.
(20) The controller 18 executes an algorithm based on the predictive models of the vehicle path 40 and the object path 42. If a vehicle path and predicted pedestrian path (or a static object's position) intersects than a potential collision is indicated. Of all of the potential collisions that are detected, one will require intervention before the others, and that one will be acted upon.
(21) The algorithm implements the following loop: predict all potential collisions; determine how confident we are that each detected collision will occur; determine which detected collision will require intervention first; and calculate the optimal response for the most relevant collision, e.g. braking for moving objects and steering around stationary objects. As the collision confidence changes, due to e.g. vehicle movement, object movement as the car is moving, the desired vehicle 10 response may also be changed. The controller 18 continually generates updated predictive models based on movement of the object 34 and the vehicle 10 to enable recalculation of the confidence number over the course of the backing maneuver. As the collision confidence changes, due to e.g. vehicle movement, object movement as the car is moving, the desired vehicle response may also be changed. The controller 18 for the hitch assist system 12 determines the collision confidence, while a separate controller may determine the desired braking rate, steering rate, etc. Alternatively, the same controller 18 may perform two or more functions.
(22) Alternately, the operator can identify stationary objects 34 in a similar manner as selecting the trailer 11. The controller 18 can plot a path that avoids those objects 34. When any new or moving objects 34 are detected the hitch assist system 12 will stop the vehicle 10 motion until the object is removed. The hitch assist system 12 can then start moving again independently or when re-initiated by the user. Ultimately, the operator has the responsibility to ensure that there are no obstructions before requesting the automated hitching.
(23)
(24) Further, the hitch assist system 12 may stop the vehicle 10 at an intermediate position, when the vehicle 10 is a predetermined distance away from the final position 42, e.g. when the vehicle is within 0.5-1.5 meters away. The operator can be asked to verify that the height of the hitch ball 20 is correct as compared to the trailer hitch 21. The predetermined distance for the intermediate position should be selected to make this visual comparison relatively easy for the operator. The trailer hitch 21 can be adjusted if necessary or an adjustable suspension system 16 for the vehicle 10 can be used to adjust the height of the hitch ball 20 to the desired height. Once the hitch 20, 21 height is confirmed the hitch assist system 12 may finish following the path 40 to the final position 42 (shown in
(25)
(26) While the best modes for carrying out the invention have been described in detail the true scope of the disclosure should not be so limited, since those familiar with the art to which this invention relates will recognize various alternative designs and embodiments for practicing the invention within the scope of the appended claims.