FLOODWATER RISK ASSESSMENT SYSTEM FOR A VEHICLE
20250033658 ยท 2025-01-30
Inventors
Cpc classification
B60K2360/188
PERFORMING OPERATIONS; TRANSPORTING
B60W50/14
PERFORMING OPERATIONS; TRANSPORTING
B60K35/29
PERFORMING OPERATIONS; TRANSPORTING
G06V20/588
PHYSICS
B60K35/60
PERFORMING OPERATIONS; TRANSPORTING
B60K2360/1868
PERFORMING OPERATIONS; TRANSPORTING
B60W2555/20
PERFORMING OPERATIONS; TRANSPORTING
B60W2420/403
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60K35/28
PERFORMING OPERATIONS; TRANSPORTING
B60Q1/545
PERFORMING OPERATIONS; TRANSPORTING
International classification
B60W50/14
PERFORMING OPERATIONS; TRANSPORTING
B60K35/00
PERFORMING OPERATIONS; TRANSPORTING
B60Q1/50
PERFORMING OPERATIONS; TRANSPORTING
G06V20/56
PHYSICS
Abstract
A floodwater risk assessment system for a vehicle includes one or more cameras oriented to collect image data of floodwater located along a roadway the vehicle is traveling along, a time-of-flight sensor system that directs a laser beam towards a plurality of target points disposed along the floodwater one or more controllers in electronic communication with the one or more cameras and the time-of-flight sensor system. The one or more controllers execute instructions to determine a risk associated with crossing the floodwater at each of the plurality of target points located along the floodwater based on a flow speed of the floodwater and a floodwater depth. The one or more controllers generate a notification indicating the risk associated with crossing the floodwater at the plurality of target points located along the floodwater.
Claims
1. A floodwater risk assessment system for a vehicle, the floodwater risk assessment system comprising: one or more cameras oriented to collect image data of floodwater located along a roadway the vehicle is traveling along; a time-of-flight sensor system that directs a laser beam towards a plurality of target points disposed along the floodwater, wherein the time-of-flight sensor system receives polarized backscattered laser light as the laser beam reflects from an upper surface of the floodwater and depolarized backscattered laser light as the laser beam reflects from a floor of the floodwater; and one or more controllers in electronic communication with the one or more cameras and the time-of-flight sensor system, wherein the one or more controllers execute instructions to: estimate a flow speed of the floodwater at the plurality of target points by analyzing the image data collected by the one or more cameras based on one or more video-based motion estimation algorithms; calculate a floodwater depth at the plurality of target points based on a time-of-flight difference between a first point in time when the polarized backscattered laser light is received by the time-of-flight sensor system and a second point in time when the depolarized backscattered laser light is received by the time-of-flight sensor system; determine a risk associated with crossing the floodwater at each of the plurality of target points located along the floodwater based on the flow speed of the floodwater and the floodwater depth; and generate a notification indicating the risk associated with crossing the floodwater at the plurality of target points located along the floodwater.
2. The floodwater risk assessment system of claim 1, further comprising an augmented reality head-up display system in electronic communication with the one or more controllers, wherein the augmented reality head-up display includes a graphic projection device that generates images upon a windscreen of the vehicle.
3. The floodwater risk assessment system of claim 2, wherein the one or more controllers execute instructions to: instruct graphic projection device of the augmented reality head-up display system to generate a graphic upon the windscreen of the vehicle, wherein the graphic represents the notification indicating the risk associated with crossing the floodwater.
4. The floodwater risk assessment system of claim 3, wherein the graphic is a color-coded bar overlaid upon the floodwater.
5. The floodwater risk assessment system of claim 4, wherein the color-coded bar includes a plurality of individual sections that each correspond to one of the plurality of target points.
6. The floodwater risk assessment system of claim 5, wherein individual sections of the color-coded bar are assigned red to provide a warning indicating the risk of crossing is unacceptable at the corresponding target point.
7. The floodwater risk assessment system of claim 1, wherein the time-of-flight sensor system includes a pulsed illumination source and a fiber optic cable.
8. The floodwater risk assessment system of claim 7, wherein the pulsed illumination source generates a laser beam received by the fiber optic cable, wherein the laser beam exits a tip of the fiber optic cable.
9. The floodwater risk assessment system of claim 8, wherein the time-of-flight sensor system includes an actuation element that directs the laser beam emitted by the tip of the fiber optic cable towards one of the plurality of target points disposed along the floodwater.
10. The floodwater risk assessment system of claim 9, wherein the time-of-flight sensor system includes a first detector, a second detector, and a polarizing beam splitter, wherein the polarizing beam splitter separates the polarized backscattered laser light and the depolarized backscattered laser light, and the polarized backscattered laser light is received by the first detector and the depolarized backscattered laser light is received by the second detector.
11. The floodwater risk assessment system of claim 1, wherein the one or more controllers store one or more lookup tables that provide a combined depth and velocity value that represents a product of the flow speed of the floodwater and the floodwater depth.
12. The floodwater risk assessment system of claim 11, wherein the one or more controllers execute instructions to: compare a combined depth and velocity value corresponding to a specific one of the plurality of target points along the floodwater with a threshold vehicle instability value; and in response to determining the combined depth and velocity value is less than the threshold vehicle instability value, determine the risk of crossing the floodwater at a specific target point is acceptable, wherein the threshold vehicle instability value is a function of one or more vehicle parameters.
13. The floodwater risk assessment system of claim 12, wherein the threshold vehicle instability value is determined based on the following equation:
14. The floodwater risk assessment system of claim 1, further comprising an illumination device in electronic communication with the one or more controllers, wherein the illumination device projects a light beam onto a surface of the floodwater and the light beam is oriented parallel to a direction of travel of the vehicle.
15. The floodwater risk assessment system of claim 14, wherein the one or more controllers determine a presence of road damage located underneath the floodwater based on a plurality of images captured by the one or more cameras, wherein the plurality of images are representative of the light beam projected by the illumination device along the floodwater.
16. The floodwater risk assessment system of claim 15, wherein the one or more controllers determine the risk of crossing the floodwater at a specific target point is unacceptable in response to determining the presence of road damage at the specific target point.
17. A method for generating a notification by a floodwater risk assessment system for a vehicle, the method comprising: receiving, by one or more controllers, image data of floodwater located along a roadway the vehicle is traveling along collected by one or more cameras; estimating, by the one or more controllers, a flow speed of the floodwater at a plurality of target points located along the floodwater by analyzing the image data collected by the one or more cameras based on one or more video-based motion estimation algorithms; calculating a floodwater depth at the plurality of target points based on a time-of-flight difference between a first point in time when polarized backscattered laser light is received by a time-of-flight sensor system and a second point in time when depolarized backscattered laser light is received by the time-of-flight sensor system, wherein the time-of-flight sensor system directs a laser beam towards the plurality of target points disposed along the floodwater and receive the polarized backscattered laser light as the laser beam reflects from an upper surface of the floodwater and the depolarized backscattered laser light as the laser beam reflects from a floor of the floodwater; determining a risk associated with crossing the floodwater at each of the plurality of target points located along the floodwater based on the flow speed of the floodwater and the floodwater depth; and generating a notification indicating the risk associated with crossing the floodwater at the plurality of target points located along the floodwater.
18. A floodwater risk assessment system for a vehicle, the floodwater risk assessment system comprising: one or more cameras oriented to collect image data of floodwater located along a roadway the vehicle is traveling along; a time-of-flight sensor system that direct a laser beam towards a plurality of target points disposed along the floodwater, wherein the time-of-flight sensor system receives polarized backscattered laser light as the laser beam reflects from an upper surface of the floodwater and depolarized backscattered laser light as the laser beam reflects from a floor of the floodwater; an augmented reality head-up display system including a graphic projection device that generates images upon a windscreen of the vehicle; and one or more controllers in electronic communication with the one or more cameras, the time-of-flight sensor system, and the augmented reality head-up display, wherein the one or more controllers execute instructions to: estimate a flow speed of the floodwater at the plurality of target points by analyzing the image data collected by the one or more cameras based on one or more video-based motion estimation algorithms; calculate a floodwater depth at the plurality of target points based on a time-of-flight difference between a first point in time when the polarized backscattered laser light is received by the time-of-flight sensor system and a second point in time when the depolarized backscattered laser light is received by the time-of-flight sensor system; determine a risk associated with crossing the floodwater at each of the plurality of target points located along the floodwater based on the flow speed of the floodwater and the floodwater depth; and instruct the graphic projection device of the augmented reality head-up display system to generate a graphic upon the windscreen of the vehicle, wherein the graphic represents a notification indicating the risk associated with crossing the floodwater at the plurality of target points located along the floodwater.
19. The floodwater risk assessment system of claim 18, wherein the graphic is a color-coded bar overlaid upon the floodwater.
20. The floodwater risk assessment system of claim 19, wherein the color-coded bar includes a plurality of individual sections that each correspond to one of the plurality of target points.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
[0026]
[0027]
[0028]
[0029]
[0030]
[0031]
DETAILED DESCRIPTION
[0032] The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.
[0033] Referring to
[0034] The one or more cameras 22 are oriented to collect image data of an environment located in front of the vehicle 12. It is to be appreciated that the image data refers to both images and video representing the environment surrounding the vehicle 12. The time-of-flight sensor system 24 is oriented to face the front of the vehicle 12. Some examples of the time-of-flight sensor system 24 include, but are not limited to, LiDAR and single-photon avalanche diode (SPAD) sensors. The augmented reality head-up display system 26 includes a graphic projection device 34 configured to generate images upon a windscreen 36 of the vehicle 12. The graphic projection device 34 includes a projection device having an excitation light for projecting images upon the windscreen 36 of the vehicle 12. Some examples of the projection device include, but are not limited to, optical collimators, laser projectors, and digital light processing projectors (DLP). The illumination device 28 is any type of illumination device that projects a light beam onto a surface of the floodwater 40 (shown in
[0035] Referring to
[0036]
[0037] Continuing to refer to
[0038] Referring specifically to
[0039]
[0040] The light reflected from the upper surface of the floodwater 40 includes a different polarization state from the light reflected from the floor of the floodwater 40. Specifically, the polarized backscattered laser light and the depolarized backscattered laser light are both directed towards the imaging lens 76 of the time-of-flight sensor system 24. The imaging lens 76 directs the polarized backscattered laser light and the depolarized backscattered laser light towards an end 82 of the fiber optic cable 74 and is received by the polarizing beam splitter 70. The polarizing beam splitter 70 separates the polarized backscattered laser light and the depolarized backscattered laser light, where the polarized backscattered laser light is received by the first detector 66 and the depolarized backscattered laser light is received by the second detector 68. It is to be appreciated that the returning photons associated with the polarized backscattered laser light and the depolarized backscattered laser light are time flagged by the detectors 66, 68, and is used to calculate a time-of-flight difference as explained below.
[0041] Referring to
[0042] Referring to
[0043] Referring to
[0044] The one or more cameras 22 capture the plurality of images representative of the light beam projected by the illumination device 28 along the floodwater 40. The road damage module 54 of the one or more controllers 20 binarizes the plurality of images representative of the light beam captured by the one or more cameras 22 to create binary image data that includes a measured light beam. The measured light beam of the binary image data is compared with a reference light beam to determine a plurality of deformation values that quantify how much the measured light beam deviates from the reference light beam. The road damage module 54 of the one or more controllers 20 determines a plurality of deformation values that represent the deviation between the measured light beam and the reference light beam, where a severity of a deformation in the roadway surface is determined based on the plurality of deformation values.
[0045] The road damage module 54 then compares the severity of the deformation with a threshold deformation value, where the threshold deformation value represents road damage that would materially affect the depth of the floodwater 40. In response to determining the severity of the deformation is greater than the threshold deformation value, the road damage module 54 determines the presence of road damage underneath the floodwater 40.
[0046] Referring to
[0047] The risk assessment module 56 stores one or more lookup tables 86 in memory of the one or more controllers 20. The one or more lookup tables 86 provide a combined depth and velocity value that represents a product of the flow speed of the floodwater 40 and the floodwater depth that are measured at a specific one of the target points P. The risk assessment module 56 compares the combined depth and velocity value corresponding to a specific one of the plurality of target points P along the floodwater 40 (
[0048] The threshold vehicle instability value is indicative of the vehicle 12 losing overall stability. It is to be appreciated that the threshold vehicle instability value is a function of one or more vehicle parameters. The vehicle parameters refer to the size and the weight of the vehicle 12, and include measurements such as, for example, the height of the vehicle 12 and the wheelbase. It is to be appreciated that the overall stability refers to floating instability, sliding instability, and toppling instability of a vehicle. The threshold vehicle instability value varies based on the type of vehicle, where larger vehicles such as a van or truck have a higher threshold vehicle instability value when compared to smaller vehicles, such as a sedan. In one embodiment, the threshold vehicle instability value is determined based on the following equation:
where v represents the flow speed of the floodwater 40 at the threshold vehicle instability value, F.sub.r represents a restoring force at the axle of the vehicle 12, represents the density of water, C.sub.D represents the coefficient of drag of the vehicle 12 (which is 1.1 when the floodwater level is below the vehicle chassis and 1.15 when the floodwater level is above the vehicle chassis) A.sub.tyre represents an area of the tires of the vehicle 12 in contact with the ground, and D represents the floodwater depth.
[0049] Referring to
[0050]
[0051] In block 504, the flow speed module 50 of the one or more controllers 20 estimate the flow speed of the floodwater 40 at the plurality of target points P (
[0052] In block 506, the depth assessment module 52 of the one or more controllers 20 calculates the depth of the floodwater 40 at each target point P located along the roadway 42 (
[0053] In block 508, the road damage module 54 of the one or more controllers 20 determines the presence of road damage located underneath the floodwater 40 based on a plurality of images captured by the one or more cameras 22, where the plurality of images are representative of the light beam projected by the illumination device 28 along the floodwater 40. The method 500 may then proceed to block 510.
[0054] In block 510, the risk assessment module 56 of the one or more controllers 20 determine the risk of crossing the floodwater 40 at each of the plurality of target points P located along the floodwater 40, where the risk of crossing is based on the flow speed of the floodwater determined by the flow speed module 50, the floodwater depth determined by the depth assessment module 52, and the presence of road damage underneath the floodwater 40 determined by the road damage module 54.
[0055] Specifically, in decision block 510A the risk assessment module 56 of the one or more controllers 20 compares the combined depth and velocity value corresponding to a specific one of the plurality of target points P along the floodwater 40 (
[0056] In block 512, the notification module 58 of the one or more controllers 20 generates the notification 44 indicating the risk of crossing the floodwater 40 at the plurality of target points P located along the floodwater 40. As mentioned above, in one non-limiting embodiment the notification 44 as a graphic 38 generated by the augmented reality head-up display system 26. The method 500 may then terminate.
[0057] Referring to
[0058] The controllers may refer to, or be part of an electronic circuit, a combinational logic circuit, a field programmable gate array (FPGA), a processor (shared, dedicated, or group) that executes code, or a combination of some or all of the above, such as in a system-on-chip. Additionally, the controllers may be microprocessor-based such as a computer having at least one processor, memory (RAM and/or ROM), and associated input and output buses. The processor may operate under the control of an operating system that resides in memory. The operating system may manage computer resources so that computer program code embodied as one or more computer software applications, such as an application residing in memory, may have instructions executed by the processor. In an alternative embodiment, the processor may execute the application directly, in which case the operating system may be omitted.
[0059] The description of the present disclosure is merely exemplary in nature and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.