System to generate an alert to wake a driver of a vehicle and a method thereof
11433916 · 2022-09-06
Inventors
- Mirza Faizan (Irving, TX, US)
- Adam Mhal (Plano, TX, US)
- Anish Bhattacharya (Frisco, TX, US)
- Ayra Iftikhar (Mckinney, TX, US)
- Manha Sadarulanam (Plano, TX, US)
- Tanish Prasad (Frisco, TX, US)
- Vivek Maranganti (Allen, TX, US)
- Abdullah Kabeer (Plano, TX, US)
- Mirza Rizwan (Patna, IN)
Cpc classification
B60W50/14
PERFORMING OPERATIONS; TRANSPORTING
G06F2203/011
PHYSICS
A61B5/0077
HUMAN NECESSITIES
G06V40/70
PHYSICS
G06V40/15
PHYSICS
B60Q5/00
PERFORMING OPERATIONS; TRANSPORTING
B60W2540/229
PERFORMING OPERATIONS; TRANSPORTING
B60Q1/503
PERFORMING OPERATIONS; TRANSPORTING
B60W40/08
PERFORMING OPERATIONS; TRANSPORTING
G06F3/015
PHYSICS
B60W2540/221
PERFORMING OPERATIONS; TRANSPORTING
B60K28/066
PERFORMING OPERATIONS; TRANSPORTING
G06V20/597
PHYSICS
A61B5/746
HUMAN NECESSITIES
International classification
H04N5/44
ELECTRICITY
B60W40/08
PERFORMING OPERATIONS; TRANSPORTING
B60W50/14
PERFORMING OPERATIONS; TRANSPORTING
G06V20/59
PHYSICS
Abstract
A system to generate an alert to wake a driver of a vehicle comprises at least one camera configured to sense EEG signals from the driver and a processing module, connected to the at least one camera, to process the EEG signals and to generate alarms.
Claims
1. A system to generate an alert to wake up a drowsy driver of a moving vehicle, said system comprises: at least one camera configured to detect driver's facial expressions; at least one Electroencephalograph (EEG), detector configured to detect EEG signals from the driver; at least one Artificial Intelligence (AI) camera configured to detect the driver's facial expressions and enhance the driver's facial expressions using artificial neural network; a processing module, connected to the at least one camera, at least one EEG detector and at least one AI camera; wherein the processing module is configured to process the EEG signals, wherein the at least one Camera and the at least one AI camera take pictures of driver's face and send the pictures to processing module to start comparison of driver's face with a database of pre-stored training pictures after receiving signal from EEG, and wherein the processing module is configured to compare the detections made by at least one camera and the at least one AI camera to confirm the drowsiness of the driver, wherein the system generates an alarm after receiving the confirmation of driver's drowsiness, wherein the alarms are produced inside the vehicle and/or outside the vehicle.
2. The system to generate the alert to wake up the driver of the vehicle as claimed in claim 1 further comprises a screen and a speaker attached outside the vehicle.
3. The system to generate the alert to wake up the driver of the vehicle as claimed in claim 2 wherein the screen and the speaker are connected to the processing module.
4. The system to generate the alert to wake the driver of the vehicle as claimed in claim 3 wherein the screen is configured to display a message and the speaker is configured to make a louder noise outside the vehicle in response to the alert generated by the processing module.
5. The system to generate the alert to wake the driver of the vehicle as claimed in claim 1 further comprises a speaker fixed inside the vehicle.
6. The system to generate the alert to wake up the driver of the vehicle as claimed in claim 5, wherein the speaker that fixed inside the vehicle is connected to the processing module.
7. The system to generate the alert to wake the driver of the vehicle as claimed in claim 6, wherein the speaker that fixed inside the vehicle is configured to generate loud sound to wake the driver in response to the alert generated by the processing module.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
(2)
(3)
(4)
(5)
(6) Persons skilled in the art will appreciate that elements in the figures are illustrated for simplicity and clarity and may not have been drawn to scale. For example, the dimensions of some of the elements in the figure may be exaggerated relative to other elements to help to improve understanding of various exemplary embodiments of the present disclosure. Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
DETAILED DESCRIPTION OF DRAWINGS
(7) For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skilled in the art to which this invention belongs. The system, methods, and examples provided herein are illustrative only and not intended to be limiting.
(8) Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
(9) It will be understood by those skilled in the art that the foregoing general description and the following detailed description are explanatory of the invention and are not intended to be restrictive thereof.
(10) Reference throughout this specification to “an aspect”, “another aspect” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrase “in an embodiment”, “in another embodiment” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
(11) The terms “comprise”, “comprising”, or any other variations thereof, are intended to cover a nonexclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or subsystems or elements or structures or components proceeded by “comprises . . . a” does not, without more constraints, preclude the existence of other devices or other sub-systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components.
(12) Reference is made herein to some “embodiments.” It should be understood that an embodiment is an example of a possible implementation of any features and/or elements presented in the attached claims. Some embodiments have been described for the purpose of illuminating one or more of the potential ways in which the specific features and/or elements of the attached claims fulfill the requirements of uniqueness, utility and non-obviousness.
(13) Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
(14)
(15) According to an embodiment of the invention, the camera (20) may be any device for recording visual images in the form of photographs, film, or video signals. In some embodiments, the camera (20) may include, but not limited to, a smart camera, AI enabled cameras, or an Electroencephalogram (EEG) enabled camera. In some embodiments, the camera (20) enabled with EEG sensors may be used to visually record all the physical activities of the driver and at the same time the EEG sensors record the brain activity. In some embodiments, the EEG sensors and the camera unit (20) may be installed separately and the camera unit (20) would work as an alternative confirmation to the readings of the EG sensors. In some embodiments, the camera (20) may be AI camera connected to a storage module. When the EEG sensors give any reading of the possibility of the driver's drowsiness, the AI camera (20) would check the physical activity with the previously stored images of the drivers to provide a confirmation to the driver's drowsiness.
(16) According to an embodiment of the present invention, the system (10) to generate an alert to wake up a driver of a vehicle (60) further comprises a speaker (30) fixed inside or outside the vehicle (60).
(17) According to an embodiment of the present invention, the system (10) to generate an alert to wake up a driver of a vehicle (60) further comprises a processing module. In some embodiments, the processing module is connected to the at least one camera, to process the EEG signals and to generate alarms. In some embodiments, the processing module may be connected separately with both the camera (20) and the EEG sensors. In some embodiments, the processing module is connected to the AI camera (20) and the EEG sensors. In some embodiments, the processing module receives all data, signals or information in the form of digital signals, electrical signals, or any other signals capable of transferring data among the camera (20), EEG sensors and the processing module. In some embodiments, the processing module maybe, but not limited to, a central processing unit, a sensor chip, a microprocessor or any other conventional device suitable for processing information received from the camera (20) and/or the EEG sensors. In some embodiments, the processing module may be kept either inside the vehicle or outside the vehicle at remote location, and the communication of signals from the camera (20), EEG sensors and the processing module is performed via remote connection or via network, like LAN, WAN, internet, Bluetooth, wired connection or any other suitable wireless connection.
(18)
(19) According to an embodiment of the present invention, the system (10) to generate an alert to wake up a driver of a vehicle (60) further comprises a speaker (30) fixed inside the vehicle (60). In some embodiments, the speaker (30) is connected to the processing module. The processing module sends a command or signal to the speakers to wake the driver. In response to the signal, the speaker (30) makes a loud sound. In some embodiments, the processing module may send a command or a signal to the vehicles integral electronic devices and the vehicle turns ON a light indicator in the vehicle. In some embodiments, the speaker (30) is configured to generate loud sound to wake the driver in response to the alert generated by the processing module.
(20)
(21)
(22) In some embodiments, the processing module will check if the screen (S3) is connected to the system.
(23) In some embodiments, if the screen is not connected, the processing module gives a signal to the speakers to produce louder alarms (S31). In the next step (S32), the processing module will again check if the driver is awake after the loud alarms. If the driver is not awake, then the signals will be sent to continue to wake the driver (S33). On the other hand, if the driver is awake, reset the signals (S34) or stop all alerts and inform the driver that the screen is not connected.
(24) In some embodiments, on the other hand, if the screen is connected, the processing module sends (S4) the signals to the screen to display a message to warn fellow vehicles. The processing module again sends (S5) signals to the camera and/or EEG sensors to check now if the driver is awake. If the driver is awake, the next step (S52) is to stop all alerts and rest the back screen. If the driver is not awake, continue (S51) to alert the driver.
(25) Moreover, the actions of any components in the block diagram need not be implemented in the order shown; nor do all of the acts necessarily need to be performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of embodiments is by no means limited by these specific examples. Numerous variations, whether explicitly given in the specification or not, such as differences in structure, dimension, and use of material, are possible. The scope of embodiments is at least as broad as given by the following claims.
(26) Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any component(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or component of any or all the claims.
(27) While specific language has been used to describe the present subject matter, any limitations arising on account thereto, are not intended. As would be apparent to a person in the art, various working modifications may be made to the method in order to implement the inventive concept as taught herein. The drawings and the foregoing description give examples of embodiments.