Detection of phase and timing of traffic signal lights and driver assistance method and systems

20220153273 · 2022-05-19

    Inventors

    Cpc classification

    International classification

    Abstract

    The invention relates to a method and systems for detection of phase and timing of traffic signal lights and notifying drivers and controlling vehicle subsystems with driver assistance information generated through processing phase and timing information with location, speed and heading of vehicles. Phase and timing information is detected through analyzing data received from sensors installed on the traffic signal lights. Processing the detected traffic signal light phase and timing information with location, heading and speed information of vehicles, drivers can be notified to regulate the speed of vehicles according to the situation of the traffic signal lights. Additionally, providing the communication of adaptive cruise control, start-stop and autonomous driving systems of vehicles with the traffic signal lights, vehicles can be controlled by these systems according to the situation of the traffic signal lights.

    Claims

    1. A method for detection of phase and timing of traffic signal lights to generate driver assistance information through processing with location, heading and speed of vehicles, the method comprising: receiving data from one or more sensors installed in a way to get a varied value when any of the phases of a traffic signal light is activated, recording and monitoring of received sensor data variations against time, determining moments of change of the values of the sensor data which is monitored against time and designating as phase change moments, calculating the time periods between determined moments of change of the values of the sensor data to determine phase durations

    2. The method of claim 1, wherein sensor installation is made to monitor only one phase or every individual phases of the traffic signal light separately.

    3. The method of claim 1, wherein installation of sensors is made integrated to the traffic signal light circuitry or separate from the traffic signal light circuitry depending on the type of the sensor.

    4. The method of claim 1, wherein sensor data is collected and processed in a remote server or in a data processing and broadcasting device situated at the intersection near the traffic signal lights.

    5. The method of claim 1, wherein location (i.e. latitude and longitude) and orientation (i.e. geographical positioning) information of the intersection where sensor data are received and speed limit information of the connecting roads to the intersection are designated in the server or data processing and broadcasting device.

    6. The method of claim 1, wherein driver assistance information is generated through transmitting traffic signal phase and timing information of the intersection that a vehicle is approaching which is determined according to the location and heading information of the vehicle, with the location and orientation information and speed limit information of the intersection where traffic signal lights are located to an on-board device in the vehicle and processing with the location, heading and speed information of the vehicle.

    7. The method of claim 1, wherein driver assistance information is generated through transmitting at least one of a location, heading and speed information of the vehicle to a remote server or data processing and broadcasting device situated at the intersection and processing with the traffic signal phase and timing information and location and orientation information of the intersection where traffic signal lights are located and then transmitting the driver assistance information to the on-board device in the vehicle.

    8. The method of claim 1, wherein driver assistance information is the phase and timing information of the related traffic signal of the intersection that a vehicle is approaching and/or the speed information which a vehicle must be driven to pass the intersection that the vehicle is approaching when related traffic signal is at a green phase.

    9. The method of claim 8, wherein when determining the speed information which a vehicle must be driven to pass the intersection that a vehicle is approaching when related traffic signal is at a green phase, the speed limit on the road the vehicle is travelling is taken into account.

    10. The method of claim 1, wherein determined driver assistance information is notified to the driver visually and/or audibly.

    11. The method of claim 1, wherein using the determined driver assistance information, at least one control input for an adaptive cruise control system of a vehicle is generated to get the speed of the vehicle regulated according to the phase and timing information of the traffic signal lights.

    12. The method of claim 1, wherein using the determined driver assistance information, at least one control input for a start-stop system of a vehicle is generated to get the engine of the vehicle regulated according to the phase and timing information of the traffic signals lights.

    13. The method of claim 1, wherein using the determined driver assistance information, at least one control input for an autonomous driving system of a vehicle is generated to get the vehicle regulated according to the phase and timing information of the traffic signal lights.

    14. A system for detection of phase and timing of traffic signal lights to generate driver assistance information through processing with location, heading and speed of vehicles, the system comprising: at least one sensor installed in a way to get a varied value when any of the phases of a traffic signal light is activated, comprising wireless communication technologies, broadcasting acquired data wirelessly, a gateway comprising wireless communication technologies, receiving the sensor data and transmitting to a central server, a central server comprising processor and memory, recording and monitoring the variations of the received sensor data against time, determining moments of change of the sensor data values, calculating the time periods between moments of change of the sensor data values with the software and algorithm it possesses, an on-board device associated with the vehicle and in communication with the central server comprising wireless communication technologies, screen, speaker, processor and memory, a GPS module associated with the on-board device determining location, heading and speed of the vehicle.

    15. The system of claim 14, wherein sensor is a light sensor.

    16. The system of claim 14, wherein sensor is a color sensor.

    17. The system of claim 14, wherein sensor is a voltage sensor.

    18. The system of claim 14, wherein sensor is a current sensor.

    19. The system of claim 14, wherein on-board device acts as a gateway with its possession of wireless communication technologies and software application configured to transmit the received sensor data to a central server.

    20. The system of claim 14, wherein on-board device is an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the central server, transmitting the location and heading information of the vehicle and receiving the traffic signal phase and timing information, location and orientation information of the intersection and speed limit information and configured to make necessary calculations to generate driver assistance information.

    21. The system of claim 14, wherein on-board device is an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the central server transmitting at least one of a location, heading and speed information of the vehicle and receiving driver assistance information from the central server.

    22. The system of claim 14, wherein on-board device is coupled to an adaptive cruise control system which regulates the speed of the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    23. The system of claim 14, wherein on-board device is coupled to a start-stop system which regulates the engine of the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    24. The system of claim 14, wherein on-board device is coupled to an autonomous driving system which regulates the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    25. A system for detection of phase and timing of traffic signal lights to generate driver assistance information through processing with location, heading and speed of vehicles, the system comprising: at least one sensor installed in a way to get a varied value when any of the phases of a traffic signal light is activated, comprising wireless communication technologies, broadcasting acquired data wirelessly, a data processing and broadcasting device comprising wireless communication technologies, processor and memory, receiving the sensor data, recording and monitoring the variations of the received sensor data against time, determining moments of change of the sensor data values, calculating the time periods between moments of change of the sensor data values with the software and algorithm it possesses and broadcasting the determined traffic signal light information with the location and orientation information and speed limit information of the intersection where traffic signals are located, an on-board device associated with the vehicle and in communication with the data processing and broadcasting device comprising wireless communication technologies, screen, speaker, processor and memory, a GPS module associated with the on-board device determining location, heading and speed of the vehicle.

    26. The system of claim 25, wherein sensor is a light sensor.

    27. The system of claim 25, wherein sensor is a color sensor.

    28. The system of claim 25, wherein sensor is a voltage sensor.

    29. The system of claim 25, wherein sensor is a current sensor.

    30. The system of claim 25, wherein on-board device is an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the data processing and broadcasting device, transmitting the location and heading information of the vehicle and receiving the traffic signal phase and timing information, location and orientation information of the intersection and speed limit information and configured to make necessary calculations to generate driver assistance information.

    31. The system of claim 25, wherein on-board device is an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the data processing and broadcasting device transmitting location, heading and speed information of the vehicle and receiving driver assistance information from the data processing and broadcasting device.

    32. The system of claim 25, wherein on-board device is coupled to an adaptive cruise control system which regulates the speed of the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    33. The system of claim 25, wherein on-board device is coupled to a start-stop system which regulates the engine of the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    34. The system of claim 25, wherein on-board device is coupled to an autonomous driving system which regulates the vehicle with the determined driver assistance information according to the phase and timing information of the traffic signal lights.

    Description

    BRIEF DESCRIPTION OF THE DRAWINGS

    [0045] FIG. 1, illustrates an exemplary embodiment of the present invention of a system and method of detection of traffic signal light phase and timing.

    [0046] FIG. 2, illustrates an exemplary embodiment of the present invention of a method and system of generation of driving assistance information.

    EXPLANATION OF REFERENCED PARTS

    [0047] 110. Traffic signal light-1

    [0048] 120. Sensor

    [0049] 130. Sensor data-1

    [0050] 140. Data processing and broadcasting device-1

    [0051] 150. Gateway

    [0052] 160. Internet connection

    [0053] 170. Central server-1

    [0054] 180. Graph showing sensor data recorded and monitored against time

    [0055] 190. Pattern

    [0056] 210. Vehicle

    [0057] 220. Traffic signal light-2

    [0058] 230. Central server-2

    [0059] 240. Data processing and broadcasting device-2

    [0060] 250. Compass degrees

    [0061] 260. Communication between on-board device and central server

    [0062] 270. Communication between on-board device and data processing and broadcasting device

    DESCRIPTION OF THE PREFERRED EMBODIMENTS

    [0063] In this detailed description, a few exemplary embodiments of the invention are explained via figures solely for the purposes of better understanding of the subject and not limitations of the invention to these examples. Each example is provided by way of explanation of the invention, not limitation of the invention. In fact, it will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope or spirit of the invention.

    [0064] The technology discussed herein makes reference to servers, gateways, software applications and other computer-based and electronic systems as well as actions taken and information sent to and from such systems. One of ordinary skill in the art will recognize that the inherent flexibility of computer-based systems allows for a great variety of possible configurations of components. For example, server processes discussed herein may be implemented using a single server or multiple servers working in combination. Applications may be implemented on a single system or distributed across multiple systems. Distributed components may operate sequentially or in parallel.

    [0065] The present disclosure also makes reference to the relay of communicated data over one or more communications networks. It should be appreciated that network communications can comprise sending and/or receiving information over one or more networks of various forms. For example, a network can comprise a local area network (LAN), wide area network (WAN), the Internet, cellular networks or other type(s) of networks. A network may comprise any number and/or combination of hard-wired, wireless or other communication links.

    [0066] As used herein, the term orientation of intersections where traffic signal lights present is intended to refer to geographical positioning of intersections. The term geographical positioning is intended to refer to the direction of every roadway such as north, south, east, west or any other direction in between of those coming together at an intersection which can be defined as the point of crossing of two or more roadways.

    [0067] As used herein, the term GPS is intended to refer to all global navigation satellite systems that have different names in different countries.

    [0068] As used herein, the term location of vehicles is intended to refer to coordinates comprising latitude and longitude values determined by GPS and the term heading is intended to refer to the directions formed by the changing coordinates of the vehicles in time, determined by GPS, resulting from the movements of the vehicles.

    [0069] As used herein, the term phase of traffic signal lights is intended to refer to any component of these lights in red, yellow and green colors. The term phase changing times is intended to refer to the moment of activation of any of these phases. The term phase duration is intended to refer to time intervals in which any of the phases stays activated. The term signal cycle time is intended to refer to the duration in which sequentially activating phases of traffic signal lights complete a circulation.

    [0070] Generally, the present disclosure is directed to systems and method of providing detection of phase and timing of traffic signal lights and notifying drivers and controlling vehicle subsystems with driver assistance information which is acquired by processing detected phase and timing information of traffic signal lights with location, speed and heading information of vehicles. In an exemplary embodiment of the present invention, data are received from one or more sensors which are installed in a way to get varied values when any of the phases of a traffic signal light is activated. Sensor installation can be made to monitor only one phase or every individual phases of the traffic signal light separately. Also, installation of sensors can be made integrated to the traffic signal light circuitry or separate from the traffic signal light circuitry depending on the type of the sensor. For example, a light sensor or a color sensor is installed at a position to sense the light intensity of a traffic signal light separate from the traffic signal light circuitry. As another implementation, a voltage sensor or a current sensor is installed integrated to the traffic signal light circuitry to monitor variations of voltage or current values at the circuit in which the sensor is installed.

    [0071] In an exemplary embodiment of the present invention, sensor data via a gateway can be collected and processed in a remote server. Alternatively, sensor data can be collected and processed in a data processing and broadcasting device situated at the intersection near the traffic signal lights. Processing of sensor data comprises recording and monitoring the variations of received sensor data against time. Moments of change of the values of the sensor data which is monitored against time are determined and designated as phase change moments. Cycle time information of the traffic signal is obtained by designating a signal phase to every duration of calculated time period between determined moments of change of the values of the sensor data. With this information, it is possible to get the knowledge of the phase and the remaining time to phase change of the traffic signal at any future time. All this determined information is compared with received sensor data continuously and revised in case of any disparity. Additionally, location and orientation information of the intersection where sensor data are received and speed limit information of the connecting roads to the intersection are specified in the server or data processing and broadcasting device.

    [0072] In an exemplary embodiment of the present invention, driver assistance information can be generated through transmitting traffic signal phase and timing information of the intersection that a vehicle is approaching which is determined according to the location and heading information of the vehicle, with the location and orientation information and speed limit information of the intersection where traffic signal lights are located to an on-board device in the vehicle and processing with the location, heading and speed information of the vehicle. According to this exemplary embodiment, on-board device can be an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the central server or data processing and broadcasting device, transmitting the location and heading information of the vehicle and receiving the traffic signal phase and timing information, location and orientation information of the intersection and speed limit information and configured to make necessary calculations to generate driver assistance information. Alternatively, driver assistance information can be generated through transmitting at least one of a location, heading and speed information of the vehicle to a remote server or data processing and broadcasting device situated at the intersection and processing with the traffic signal phase and timing information and location and orientation information of the intersection where traffic signal lights are located and then transmitting the driver assistance information to the on-board device in the vehicle. According to this exemplary embodiment, on-board device can be an electronic device like a smartphone comprising wireless communication technologies, GPS module, processor, memory, screen, speaker and software application configured to communicate with the remote server or data processing and broadcasting device transmitting location, heading and speed information of the vehicle and receiving driver assistance information from the remote server or data processing and broadcasting device.

    [0073] In a detail of the present invention, driver assistance information may be the phase and timing information of the related traffic signal of the intersection that a vehicle is approaching. This information includes notification of the driver visually and/or audibly about the phase and remaining time to phase change of the related traffic signal of the intersection that the vehicle is approaching which is determined according to the location and heading of the vehicle including the approach direction of the vehicle to the intersection. Alternatively, driver assistance information may be the speed information which a vehicle must be driven to pass the intersection that the vehicle is approaching when related traffic signal is at a green phase. This information includes notification of the driver visually and/or audibly about the speed information to pass the intersection when related traffic signal is at a green phase which is calculated according to the location, heading and speed of the vehicle including the approach direction to the intersection and the distance to the intersection. This information is revised continuously according to the location of the vehicle. The speed limit on the road the vehicle is traveling is taken into account when determining the speed information.

    [0074] In an exemplary embodiment of the present invention, on-board device can be coupled to an adaptive cruise control system of a vehicle and using the determined driver assistance information, at least one control input can be generated to get the speed of the vehicle regulated according to the phase and timing information of the traffic signals. Thus, adaptive cruise control system can automatically regulate the speed of the vehicle to pass the intersection that the vehicle is approaching when the related traffic signal is at a green phase.

    [0075] In an exemplary embodiment of the present invention, on-board device can be coupled to a start-stop system of a vehicle and using the determined driver assistance information, at least one control input can be generated to get the engine of the vehicle regulated according to the phase and timing information of the traffic signals. Thus, start-stop system recognizing that the vehicle stopped because of a traffic signal can make decisions to stop or not to stop the engine of the vehicle according to the phase and the remaining time to phase change. For example, in case the vehicle has stopped at a red light, the system can decide to stop or not to stop the engine according to the remaining time to green light or system can be adapted not to stop the engine in case the vehicle has stopped at green light for whatsoever reason. Additionally, the system can be adapted not to stop the engine in cases when the vehicle has stopped not because of traffic signals.

    [0076] In an exemplary embodiment of the present invention, on-board device can be coupled to an autonomous driving system of a vehicle and using the determined driving assistance information, at least one control input can be generated to get the vehicle regulated according to the phase and timing information of the traffic signals. Thus, communicating with the traffic signal lights, autonomous driving system can regulate the vehicle according to the phase and timing information of the traffic signal light that the vehicle is approaching.

    [0077] FIG. 1 illustrates an exemplary traffic signal light phase and timing detection system and method according to an exemplary embodiment of the present disclosure. In the system of detection of traffic signal light phase and timing information of FIG. 1, sensor data (130) received from a sensor (120) installed on red phase of a traffic signal light (110) are transmitted wirelessly to a data processing and broadcasting device (140). In an alternative exemplary embodiment of the present disclosure, sensor data (130) received from a sensor (120) installed on red phase of a traffic signal light (110) are transmitted via a gateway (150) through Internet connection (160) to a central server (170). Sensor data (130) can be transmitted to data processing and broadcasting device (140) or gateway (150) via

    [0078] Bluetooth, WiFi, cellular networks or other radio frequency communication networks or protocols or visible light communication technologies like LiFi or infrared communication technologies like UV.

    [0079] In the method of detection of traffic signal light phase and timing information of FIG. 1, the graph (180) which is formed by varying sensor data received continuously by data processing and broadcasting device (140) or central server (170) and recorded and monitored against time with the software and algorithm they possess is illustrated. At this graph (180), in which sensor data variations are recorded and monitored, “y” axis shows the sensor data (130) values and “x” axis shows the time. In this implementation of an exemplary embodiment, sensor data (130) received from a sensor (120) installed on the red phase is shown as value “a” on the graph (180) when the red phase is not activated. Sensor data (130) value at time “t1” when the red phase is activated is shown as “b” on the graph (180). Change in sensor data (130) value at time “t2” when the red phase is deactivated is shown as “a”. The moments of varying values of sensor data (130) which is continuously received are shown as “t3”, “t4” . . . at the continuation of the graph (180). A pattern (190) is formed via calculating the durations between moments of change of the sensor data (130) determined on the graph (180). At this pattern (190), the moments of sensor data (130) variations are adopted as phase change moments and a related signal phase is appointed for every distinct duration. For example, the duration “t2-t1”, which is the duration of sensor data (130) value “b” of activated red signal phase, is calculated to determine the duration while the red signal phase stays activated. The duration 1342″, which is the duration of sensor data (130) value “a” of deactivated red signal phase, is calculated to determine the duration while the yellow and green signal phases stay activated. With this determined information, it is possible to get the knowledge of phase and remaining time to phase chance of a traffic signal light (110) at any future time. All this determined information is compared with received sensor data (130) continuously and the pattern (190) is revised according to new situation in case of any disparity.

    [0080] FIG. 2 illustrates an exemplary embodiment of method and system of generating driver assistance information. According to the method and system of generating driver assistance information of FIG. 2, the intersection and related traffic signal light (220) that a vehicle (210) is approaching is determined, detecting and tracking the location and heading of the vehicle (210) via a GPS device (not shown) associated with the on-board device (not shown). The location and orientation information of the intersections are designated in the central server (230) or data processing and broadcasting device (240) to determine the intersection and the related traffic signal light (220) that the vehicle (210) will encounter. The orientation of the intersection and the heading of the vehicle (210) are determined according to compass grades (250). Thus, the orientation of the intersection illustrated in FIG. 2 is designated as “0”, “90”, “180” and “270”. The traffic signal lights at this intersection is designated according to the direction of the connecting roadways. For example, the traffic signal light (220) controlling the south-north oriented roadway is designated as “0” degrees. In the same way, the heading of the vehicle (210) illustrated in the exemplary embodiment of FIG. 2 traveling toward the north direction and tracked continuously via the GPS is designated as “0” and associated with the traffic signal light (220) designated as “0” degrees. The phase and timing information of the traffic signal light (220) associated with the vehicle (210) according to the traveling direction is transmitted (260, 270) to the on-board device in communication with the central server (230) or data processing and broadcasting device (240). The onboard device generates driving assistance information according to the location, heading and speed information of the vehicle (210) and phase and timing information of the traffic signal light (220). The driver assistance information can be the phase and timing information of the traffic signal light (220) and the speed information that the vehicle (210) must be driven to pass the intersection when the traffic signal light (220) is at a green phase. Alternatively, driver assistance information can be generated through transmitting (260, 270) at least one of a location, heading and speed information of the vehicle (210) to a remote server (230) or data processing and broadcasting device (240) and processing with the traffic signal phase and timing information and location and orientation information of the intersection where traffic signal light (220) is located and then transmitting (260, 270) the driver assistance information to the on-board device in the vehicle (210). The communication (260) between the on-board device and the central server (230) can be implemented through the Internet. The communication (270) between the on-board device and data processing and broadcasting device (240) can be implemented through Bluetooth, Wi-Fi, cellular networks, DSRC or other radio frequency communication networks or protocols or visible light communication technologies like Li-Fi or infrared communication technologies like UV.