TRAILER TRACKING COMMERCIAL VEHICLE AND AUTOMOTIVE SIDE VIEW MIRROR SYSTEM
20200346581 ยท 2020-11-05
Inventors
Cpc classification
B60R1/0612
PERFORMING OPERATIONS; TRANSPORTING
G06T7/246
PHYSICS
B60R1/12
PERFORMING OPERATIONS; TRANSPORTING
B60R2300/8026
PERFORMING OPERATIONS; TRANSPORTING
B60R2001/1253
PERFORMING OPERATIONS; TRANSPORTING
B60Y2200/148
PERFORMING OPERATIONS; TRANSPORTING
G06V20/56
PHYSICS
B60R1/07
PERFORMING OPERATIONS; TRANSPORTING
H04N13/239
ELECTRICITY
International classification
B60R1/07
PERFORMING OPERATIONS; TRANSPORTING
B60R1/12
PERFORMING OPERATIONS; TRANSPORTING
G06T7/246
PHYSICS
Abstract
A system for automotive trailer tracking side view mirrors where the side view mirrors are dynamically adjusted to follow and track a trailer, semi-trailer, or other towed load during turning, backing or other maneuvers. The driver is provided with an optimized view of the rear of the trailer without the need to manually adjust side view mirrors. As the vehicle and trailer turn and articulate, the side view mirror system automatically adjusts to turn, rotate, and follow the trailer. The system may provide imaging sensors, digital cameras, Lidar sensors, or other sensor modalities as input to an electronic control module. The control module is provided with image or sensor data regarding the location, angle or orientation of optical markers or targets installed on the trailer. Alternatively, the control module is provided with high resolution imaging or sensor data and applies machine vision and object recognition algorithm to identify the position of the trailer. The control modules provides a control signal output to the side view mirror motors and actuators, to dynamically adjust the side view mirrors, with a frequency response of less than 100 ms in order to provide the driver with a clear unobstructed view.
Claims
1. A system for dynamically positioning side view mirrors to provide the driver with an unobstructed view of a trailer during backing, turning and maneuvering around corners, comprising: a digital stereo camera with at least two imaging sensors; an optical marker affixed to the rear of the trailer; a trailer tracking side view mirror electronic control module; and a pair of extended side view mirrors with horizontal and vertical adjusting mirror motor actuators; wherein, the digital stereo camera imaging sensors provide and capture a defined field of view with overlapping coverage of the trailer and optical marker; wherein the electronic control module receives input from the digital stereo imaging sensors and generates location, angle, and position data regarding the trailer; and wherein the electronic control module provides output commands to dynamically position horizontal and vertical adjustment of the extended side view mirrors with the system mirror motor actuators.
2. The system of claim 1 for dynamically positioning side view mirrors, wherein the optical marker is a user installed object with a target face comprised of a highly visible optical pattern, retroreflective surface, or active light emitting design.
3. The system of claim 1 for dynamically positioning side view mirrors, wherein the electronic control module generates trailer location data with respect to the position, angle and rotation of the optical marker around a three dimensional coordinate system.
4. The system of claim 1 for dynamically positioning side view mirrors, wherein the imaging sensors provide an overlapping field of view of the optical marker to the electronic control module for triangulating the three dimensional position of the trailer.
5. The system of claim 1 for dynamically positioning side view mirrors, wherein the imaging sensors, electronic control module, and mirror motor actuators are integrated into a commercial or automotive vehicle bus network protocol for communication with other vehicle modules.
6. The system of claim 1 for dynamically positioning side view mirrors, wherein the trailer tracking electronic control module applies machine vision to identify and recognize the rear edge of the trailer or other load.
7. The system of claim 1 for dynamically positioning side view mirrors, wherein the system uses Lidar sensors to generate data regarding the trailer orientation, angle and position, and to automatically optimize side view mirror adjustment for the driver.
8. A commercial or automotive vehicle system for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system to provide the driver with a clear view of the trailer during backing and turning maneuvers, comprising: an integrated imaging sensor system for observing and tracking at least one more more optical targets or markers at the rear of the trailer; an electronic control module for receiving imaging sensor input, generating and processing trailer angle, position and location data, and providing control signal output to the side view mirror system; and a side view mirror system with mirror motors and actuators which are dynamically adjusted with control signal output from the electronic control module; wherein, the integrated imaging sensor system is comprised of two or more imaging sensors or digital cameras with overlapping fields of view which triangulate the three dimensional position of the trailer and optical targets or markers; and wherein, the system imaging sensors, electronic control module and side view mirror motors and actuators are integrated into a vehicle system communication network bus protocol.
9. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the optical targets or markers are user installed objects with a target face comprised of a highly visible optical pattern, retroreflective surface, or active light emitting design.
10. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the imaging sensors and electronic control module apply machine vision to identify and recognize the rear edge of the trailer or other load.
1. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the system uses Lidar sensors to generate data regarding the trailer orientation, angle and position, and to automatically optimize side view mirror adjustment for the driver.
12. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the mirror motor and actuator control signal output from the electronic control module is dynamically generated with a frequency response of less than 100 ms.
13. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the system integrates with extended side view mirror systems designed for towing and eliminating blind spots.
14. The system of claim 8 for dynamically tracking a cargo trailer angle and position and automatically adjusting a side view mirror system, wherein the system imaging sensors generate input into the control module to process, generate and store distance, position, rotation, angle and other location computations regarding multiple observable trailer surface features.
15. A system for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system to provide the driver with a clear and unobstructed view of the trailer during turning and backing maneuvers, comprising: a network of one or more imaging sensor devices; an electronic control module for receiving input from the network of imaging sensors; and a side view mirror system with computer controlled mirror motors and actuators; wherein, the network of imaging sensors observe the trailer and provide the electronic control module with high resolution images of trailer surface features; wherein the electronic control module processes the imaging sensor data and applies machine vision object recognition algorithms to detect the location, position, angle and orientation of trailer surface features; and wherein, the side view mirror motors and actuators are automatically adjusted to provide the driver with an optimized view in response to trailer surface feature position data.
16. The system of claim 15 for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system, wherein the system uses Lidar sensors to generate data regarding the trailer orientation, angle and position, and to automatically optimize side view mirror adjustment for the driver.
17. The system of claim 15 for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system, wherein the mirror motors and actuators are adjusted with a control signal output from the electronic control module which is dynamically generated with a frequency response of less than 100 ms.
18. The system of claim 15 for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system, wherein the system integrates with extended side view mirror systems designed for towing and eliminating blind spots.
19. The system of claim 15 for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system, wherein the system imaging sensors generate input into the control module to process, generate and store distance, position, rotation, angle and other location computations regarding multiple observable trailer surface features.
20. The system of claim 15 for dynamically tracking a commercial vehicle or automotive trailer and adjusting a side view mirror system, wherein the driver optimized view is determined by driver eye level position.
Description
DESCRIPTION OF THE DRAWINGS
[0007]
[0008]
[0009]
[0010]
[0011]
[0012]
[0013]
DETAILED DESCRIPTION
[0014] The presently described invention is preferably embodied in a commercial vehicle, commercial truck, semi-tractor trailer, automotive, automobile or light-duty truck side view mirror system which automatically follows, the trailer or load being towed, and adjusts position to provide the driver with an unobstructed view of the trailer during turning, reverse, and backing maneuvers. A preferred use case is during trailer backing around a ninety degree (90) angle corner, as typically the driver's view of the rear of the trailer becomes useless, or obstructed, after a certain point where the trailer or towed load moves out of view. In a preferred embodiment, the system provides a sensor based, automatically adjusting side view mirror system, where a sensor on the rear of the trailer is linked to the side view mirror; and as the driver turns and maneuvers the truck and trailer, the side view mirror follows and re-positions to provide the driver a clear view of the trailer while backing up.
[0015] In a preferred embodiment, the system provides at least one sensor mounted to the rear of the trailer to determine trailer angle, position, location and orientation. The sensor may be embodied in an optical target attached to the rear of the trailer. The optical target may be a user installed adhesive sticker, or magnetically affixed object, with a target face reflective surface, or highly visible optical pattern, or other object with a target face light reflective surface or highly visible optical pattern, or other user installed object with an optical target face with identifiable optical elements. In an alternative embodiment, the system may preferably use an optical marker installed on the the trailer to determine trailer position and tracking. The optical marker or target may be embodied in an object with a target face comprised of a high contrast, black and white colored, checkerboard pattern of optical elements, or alternatively optical elements of high contrast squares, triangles, circles, or other shapes and colors, or retroreflective material or surface. The optical marker or target may alternatively be embodied in an active type system, with a visible or non-visible light emitting design. The optical marker or target is observed by the system imaging camera in order to determine the orientation of the target face, with respect to rotation around a three dimensional coordinate system, of X, Y and Z axes. The orientation of the target face is therefore used to determine the relative pitch, yaw, and roll of the trailer with respect to the system imaging camera. The system uses the trailer orientation information and data to automatically adjust and reposition the side view mirrors to provide the driver with a clear view of the rear of the trailer.
[0016] In a preferred embodiment, the system uses imaging cameras or sensors with a defined observable area, visual field, or horizontal or vertical field of view, or solid angle or angle of view through which the system optical marker or target is observed. The system preferably uses image sensors to triangulate the three dimensional position of the trailer, and associated optical markers or targets, between two or more imaging sensors or cameras. The system imaging sensors or cameras preferably provide overlapping coverage of the optical markers or targets, which are affixed to the trailer, and generate tracking data of the location, angle and position of the markers and trailer relative to the truck or automobile. The optical imaging system may be embodied with one or more digital camera type imaging devices with a lens and camera configuration that provides a high resolution image of the optical marker or target.
[0017] In a preferred embodiment, the system is provided with an electronic control module, comprised of a central processing unit (CPU), motherboard, memory (RAM), non-volatile storage (EEPROM, or NAND flash memory), power supply, and general purpose input/output pins, universal serial bus (USB), or other serial connector and protocol for communication between the system cameras, imaging devices, sensors, and side view mirror adjustment servo motors, mirror motors or actuators. In a preferred embodiment, the system control module, imaging sensors, servo motors, mirror motors and actuators, are plugged into the central network of the vehicle and are able to communicate with other commercial vehicle or automotive vehicle system modules over the CAN bus (Controller Area Network), LIN (Local Interconnect Network), or other vehicle bus network protocol. In a preferred embodiment, the system electronic control module provides functions of sensor input, processing, storage, and output.
[0018] The system electronic control module receives input from the imaging sensors or cameras and generates, processes, and stores data regarding the location, position, orientation and angle of the trailer. The system electronic control module provides output regarding the adjustment, repositioning, and horizontal and vertical alignment of the side view mirror motors and actuators. In a preferred embodiment, during trailer backing or turning maneuvers, the system cameras or imaging sensors capture the location and rotational orientation of the optical targets or markers. The cameras and imaging sensors provide input into the system electronic control module regarding the optical target or marker position. The control module then preferably processes, generates and stores data regarding the location, angle, and orientation of the trailer. The position and adjustment of the side view mirror or mirror system is dynamically adjusted by the control module output in order to provide the driver with an unobstructed and clear view of the trailer. Preferably, the side view mirror control signal output is provided with a frequency response of less than one hundred milliseconds (100 ms), to input from the imaging sensors. Preferably, the system electronic control module provides the driver with unobstructed side view mirror positioning during trailer backing or turning around corners greater than the point at which the trailer or towed load moves out of view, and in preferred use cases of trailer backing or turning around ninety degree (90) corners, right angles, and other angles.
[0019] As backup cameras and rear view mirrors are typically obstructed by a trailer or towing load behind the vehicle, the presently described system, which utilizes the side view mirrors, is highly useful for trailer backing and reversing applications. In a preferred embodiment, the system may use wide, extended side view mirrors designed for towing, and providing the driver with the ability to see a greater distance behind (as compared with conventional mirrors), and to help eliminate blind spots. Preferably, the system integrates with extended side view mirror systems and any type of trailer or towing application. In a preferred use case, the system imaging sensors or digital cameras are able to apply machine vision to identify and recognize the rear edge of the trailer or towing load, without the need for the user to install additional optical targets. The system cameras or imaging sensors preferably provide input comprised of high resolution image or images of the position, angle and orientation of trailer or load being towed to the system electronic control module. The control module preferably applies computer vision, machine vision, and object recognition algorithms to processes, generate and store data regarding the position, angle and location of the trailer or load. The extended side view mirrors are dynamically adjusted by the system control module output commands and data to provide the driver with an unobstructed view of the trailer or load during reversing and backing maneuvers, and turning around corners.
[0020] In a preferred embodiment, the system provides a driver optimized view of the trailer during turning and backing maneuvers. The driver's eye level position is received from additional vehicle sensors or imaging devices which determine the location of the driver's eye level in the driver's seat. The system electronic control module is provided additional input regarding the location of the driver's eyes and applies further adjustment of the side view mirror motors and actuators in order to provide a driver optimized view in the side view mirrors.
[0021] In a preferred embodiment, the system uses Lidar sensors to emit laser light pulses in the direction of the trailer or towed load and record the back scattered or reflected pulses of light to determine orientation, angle and position. The Lidar sensor data is input into the system electronic control module to process, generate and store distance, position, rotation, angle, and other location measurements regarding the trailer or load being towed. The user may install optical targets or markers on the trailer or load in order to aid the system and Lidar detection of location measurements. Alternatively, the system may rely on computer vision, machine vision or object recognition algorithms in order to identify the trailer or load position. The system electronic control module preferably receives the Lidar sensor data as input, applies object recognition algorithms, generates and stores data regarding the trailer location, angle and orientation, and provides output commands to the system side view mirror motors and actuators. The system control module dynamically adjusts the side view mirror or mirror systems to provide the driver with an unobstructed and clear view of the trailer or towed load during backing, reversing, or maneuvering around corners, based upon input from the system Lidar sensors.
[0022] In a preferred embodiment, the system may employ either infrared sensors, ultrasonic sensors, multiple surround cameras or imaging devices, radar, or sonar to identify and locate the position of the rear of the trailer, semi-trailer, tractor-trailer or other towed load. The system may use optical targets or markers, or other sensors on the trailer or towed load to assist the system with resolving location and position data. Alternatively, the system may perform location and position processing and calculation, without any optical target, markers or sensors installed on the trailer. In this respect, the system electronic control module will perform trailer location and position calculations with machine vision, object recognition, or other unique sensor signal data pattern recognition algorithms. The system electronic control module preferably receives the infrared sensor, ultrasonic sensor, multiple surround cameras or imaging devices, radar, or sonar data as input, applies object recognition or pattern recognition algorithms, generates and stores data regarding the trailer location, angle and orientation, and provides output commands to the system side view mirror motors and actuators. The system control module dynamically adjusts the side view mirror or mirror systems to provide the driver with an unobstructed and clear view of the trailer or towed load during backing, reversing, or maneuvering around corners, based upon input from the system sensors or imaging devices.
[0023]
[0024]
[0025]
[0026]
[0027]
[0028]
[0029]
[0030] The above described system may be applied to commercial trucking, automotive or other vehicle applications in order to provide the driver with an optimized view of the trailer or load being towed, without the need to manually adjust side view mirrors. As deployed in any vehicle application, the side view mirrors are dynamically adjusted to follow and track a trailer, semi-trailer, or other load during turning, reversing, backing or other maneuvers. As the vehicle and trailer turn and articulate, the side view mirror system automatically adjusts to turn, rotate, and follow the trailer. In any vehicle application, the system may preferably provide imaging sensors as input into an electronic control module. The imaging sensor data describes the location, angle, or orientation of the trailer and allows the control module to provide signal output to the side view mirror motors and actuators to dynamically adjust, follow the trailer, and provide the driver with a clear unobstructed view.