Mission Critical Neighborhood Safety & Security System using Artificial Intelligence, Sensors, Robotics & Telecommunication

Abstract

The present invention discloses an advanced process of dealing with emergency situations through an intelligent methodology. The proposed invention can be used by all people to get help and support in a very short time. The Mission Critical Neighborhood Safety and Security System is enabled by artificial intelligence, autonomous robots, mission critical telecom network, and sensors. This system aims to provide neighborhood safety and security service to residents by using autonomous robots that are deployed in each neighborhood. These robots work closely with the mission critical module mounted on light poles and detect anomalies like car accidents, kidnapping, fire, smoke, thefts, gunshots, street fights, etc. The mission critical device mounted on the light pole captures this information and sends this information along with notification to public safety agencies (police, paramedics, firefighters). The public safety agents can then communicate with the victims onsite as well as residents through these robots and thus safeguard neighborhoods. In addition to this, the mission critical device mounted on the light pole is also equipped with acoustic sensors, thermal sensors, high-definition cameras, and air quality monitoring sensors. This information is also relayed to the residents and the public safety agencies. In order to ensure higher reliability, this system uses a mission critical public safety grade telecom network as the primary source of Internet and a WiFi mesh system as a backup source of Internet. This system is powered by electricity available through the light pole as well as solar modules mounted on each of the light poles.

Claims

I: A Mission critical neighborhood safety and security system enabled by artificial intelligence, autonomous robots, mission critical telecom network, and sensors to alarm, transmit, and receive safety and security information on a daily basis for any neighborhood.

II: An artificially intelligent safety and security system where: according to claim II, includes the process of releasing robot on an autonomous neighborhood patrol; according to claim II, the robot will check for anomalies including but not limited to car accidents, speeding automobiles, gunshots, breaking of glass, sounds, street fights, fire, etc.; according to claim II, if there is no security anomaly detected, then the patrol will continue; according to claim II, if any threatening condition detected, the information will be sent to the nearest mission critical pole; according to claim II, the mission critical light pole will transmit information to the cloud-based server over mission critical network; according to claim II, the mission critical cloud server will broadcast notifications to nearest public safety agencies using geospatial mapping; according to claim II, where the agencies can then plan to take their actions and send alerts to residents of the area through mission critical software; according to claim II, once the mission is completed, the robots will be notified through software, and then the usual operation will be resumed, and, according to claim II, the mission critical robot recharges itself and then heads back to its usual patrolling process.

III: A system and procedure of safety and security system where Autonomous neighborhood safety robots will be used for: according to claim III, the Neighborhood Autonomous Safety Patrols to safeguard the neighborhoods; according to claim III, the Neighborhood Autonomous Safety Robots will use artificial intelligence (AI) module to detect neighborhood anomalies, including people carrying weapons, cars driving at higher speeds, loud sounds eliminated from either vehicles, homes, or streets; according to claim III, the Neighborhood Autonomous Safety Robots will periodically patrol the neighborhood and recharge themselves using the robot shelter located under the nearby electric pole and, according to claim III, the Neighborhood Autonomous Safety Robots will share safety information with the local public safety agency, and the robots will also provide situational awareness to the county/city officers.

IV: A system and procedure of safety and security system where (AI) artificial intelligence-enabled Light Poles will be deployed comprising: according to claim IV, where each light pole in the neighborhood will be equipped with a solar module, robot shelter, environmental sensors, network equipment, high-definition cameras, LiDAR, sound sensor, and an artificial intelligence (AI) module; according to claim IV, where Robot shelter will allow the robots to recharge at the end of each patrol according to claim IV, where Network equipment will house mission critical public safety grade 4G LTE modems that will allow the smart pole to transmit information back to the neighborhood safety portal; according to claim IV, where high-definition cameras will continuously analyze the street and sidewalk traffic for anomalies; according to claim IV, where the sound sensor will be used to detect anomalies such as car accidents, breaking of glass, gunshots, fireworks, illegal broadcasting of sound that can impact the safety and security realm of the neighborhood. LiDARs will be used to monitor the speed of the car. according to claim IV, A system and procedure of safety and security system where (AI) artificial intelligence-enabled Light Poles will provide High-Speed Detection (HSD) functionality and LiDAR feed will be used to detect the speed of each vehicle, and the artificial intelligence (AI) module will extract the license number, make, and model of the vehicle. according to claim IV, A system and procedure of safety and security system where (AI) artificial intelligence-enabled Light Poles will provide Sound Anomaly Detection functionality and sound waves will be analyzed using a neural network and will be classified as different types of anomalies such as gunshots, breaking of glass, accidents, people screaming for help, emergency, etc. This information, once captured, will be delivered to the local public safety agency over a reliable public safety mission critical 4G LTE network. according to claim IV. A system and procedure of safety and security system where the system will use a mission critical public safety 4G LTE network that operates in FCC band 14 to ensure all the data traffic traversing the system is served with the highest priority and reliability. according to claim IV, A system and procedure of safety and security system where (AI) artificial intelligence-enabled Light Poles will perform Active Environment Monitoring with an air quality monitoring sensor. according to claim IV, A system and procedure of safety and security system where (AI) artificial intelligence-enabled Light Poles will, in addition to public safety grade 4G LTE network, will also use a Mesh WiFi network as a backup source of the Internet to provide data transmission functionality. according to claim IV, A system and procedure of safety and security system where data in transit will be fully encrypted, making it difficult for hackers to modify the data. Data in transit will be encrypted using Transport Layer Security (TLS)/Secure Sockets Layer (SSL) protocol encryption with 256-bit keys, and data at rest will be encrypted using an on-chip encryption module. according to claim IV, A system and procedure of safety and security system where an associated software application will be used to update the residents regarding safety information through news, articles and statistics.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification and serve to further illustrate embodiments of concepts that include the claimed invention, and explain various principles and advantages of those embodiments.

[0026] FIG. 1 shows the process view of mission critical response system as per preferred embodiments of the invention.

[0027] FIG. 2 shows the mission critical networking components as per preferred embodiments of the invention.

[0028] FIG. 3 shows the mission critical safety device/light pole architecture as per preferred embodiments of the invention.

[0029] FIG. 4 shows the mission critical system components as per preferred embodiments of the invention.

[0030] FIG. 5 shows mission critical anomaly detection as per preferred embodiments of the invention.

[0031] FIG. 6 shows mission critical robot operation flow as per preferred embodiments of the invention.

[0032] FIG. 7 shows mission critical pedestrian safety scenario operation flow as per preferred embodiments of the invention.

[0033] The apparatus and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.

[0034] The apparatus and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.

DETAILED DESCRIPTION

[0035] Detailed descriptions of the preferred embodiment are provided herein. It is to be understood, however, that the present invention may be embodied in various forms. Therefore, specific details disclosed herein are not to be interpreted as limiting but rather as a basis for the claims and as a representative basis for teaching one skilled in the art to employ the present invention in virtually any appropriately detailed system, structure, or manner.

[0036] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well as the singular forms unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof.

[0037] The present invention is directed to an advanced system and method that uses Artificial intelligence-based object detection systems, robotics, LiDARs, and telecommunication data networks to provide mission critical public safety grade neighborhood safety and security service to residents and public safety agencies.

[0038] The mission critical safety and security system, as illustrated in FIG. 1, works under multiple components, including but not limited to Autonomous neighborhood safety and security robot, neighborhood safety and security devices equipped with a camera, computer enabled with artificial intelligence (AI), LiDAR and 4G router functionalities. It further includes the usage of street lights and poles to provide autonomous robot shelter and the installation of autonomous safety and security devices. The process will also include the role of local emergency services offices as critical support to make this system successful. The numbering on the drawing shows the following: [0039] 1.1—Neighborhood Safety & Security Device equipped with Camera, Artificial intelligence-enabled computer, LiDAR, 4G LTE telecom router [0040] 1.2—Autonomous Neighborhood Safety & Security Robot [0041] 1.3—Autonomous Robot Shelter [0042] 1.4—Street Light [0043] 1.5—Local Emergency Services Office

[0044] FIG. 2 depicts the mission critical networking components where mission critical neighborhood safety and security system robots will connect over a secure private WiFi connection with the nearby mission critical light pole. The information received from mission critical neighborhood safety and security robot will be processed by the mission critical light pole and will be transmitted to the mission critical cloud server via the mission critical public safety grade radio access network and the mission critical public safety grade evolved packet core network. The mission critical cloud server will provide mission critical command center dashboard for public safety agencies and for residents, as illustrated in FIG. 2.

[0045] The mission critical safety device/light pole architecture, as shown in FIG. 3, involves the LIDAR unit, mapping unit, solar module, artificial intelligence (AI) unit, mission critical 4G LTE telecom router, sound sensor and classifier, data security module, environmental unit, backup battery storage, and camera unit.

[0046] The mission critical system as shown in FIG. 4, involves mission critical light pole, mission critical neighborhood safety robots, air quality anomalies, sound anomalies, cloud server, database server, mission critical dashboard, public safety agencies, residents, and safety and security anomalies.

[0047] The mission critical anomaly detection system can detect different types of safety and security anomalies involves as shown in FIG. 5, including but not limited to car accidents, human injury, fire and smoke detection, sound anomaly classification, gas leakage, and air quality monitoring. In addition to this, the mission critical anomaly detection system on detecting injured pedestrians can trigger the telehealth service to provide real-time feeds of the pedestrian to the doctor and thus initiate an emergency response.

[0048] The mission critical operation, as shown in FIG. 6, will include the process of releasing the robot on an autonomous neighborhood patrol. The robot will check for anomalies, including but not limited to car accidents, speeding automobiles, gunshots, breaking of glass, sounds, street fights, fire, etc. If there is no security anomaly detected, then the patrol will continue. However, if any threatening condition is detected, the information will be sent to the nearest mission critical pole. The mission critical light pole will transmit this information to the cloud-based server over mission critical network. The mission critical cloud server will then broadcast notifications to the nearest public safety agencies using geospatial mapping. The agencies can then plan to take their actions and send alerts to residents of the area through mission critical software. Once the mission is completed, the robots will be notified through software, and then the usual operation will be resumed. The mission critical robot recharges itself and then heads backs to its standard patrolling process.

[0049] The FIG. 7 shows mission critical pedestrian safety scenario where incase of any incident related to pedestrian or car accident, the mission critical autonomous safety robot can send an alert to public safety agencies and initiate an emergency response. In addition to this, the public safety agencies can use the live feeds transmitted by the robot via the mission critical dashboard to provide telehealth service to the injured pedestrian. The numbering on the drawing shows the following: [0050] 7.1—Mission Critical Neighborhood Safety & Security Device [0051] 7.2—Mission Critical Light Pole [0052] 7.3—Autonomous Robot Shelter [0053] 7.4—Mission Critical Telehealth Service [0054] 7.5—Mission Critical Autonomous Neighborhood Safety Robot [0055] 7.6—Mission Critical Command Center Dashboard for Public Safety Agencies

[0056] The Autonomous neighborhood safety robots will be deployed in each neighborhood that raises safety/security concerns. These robots will patrol the neighborhoods at night using the sidewalk. These robots will be equipped with a sound sensor and artificial intelligence (AI) module. The artificial intelligence (AI) module will serve as the eye of the robot and will enable the robot to detect neighborhood safety anomalies. These anomalies include people carrying weapons, cars driving at higher speeds, loud sounds eliminated from either vehicles, homes, or streets. The sound module on the robot will further classify these sounds as broken glass, woodcutting, carjacking, gunshot, people, fighting, etc. As soon as an anomaly is detected by the robot, this information will be shared with the local public safety agency. Thus, the robots will provide situational awareness to the county/city officers. These robots will periodically patrol the neighborhood and recharge themselves using the robot shelter located under the nearby electric pole.

[0057] In an embodiment, the assembly presents a camera agnostic surveillance system coupled with artificial intelligence (AI) units, mapping, and LIDAR unit and other components to analyze on a real-time basis and can sends alerts for emergency events like criminal activities, physical abuse, sexual abuse, robbery/shoplifting, arson, flooding, drowning, fall detection, mental issues detection, etc. It provides the exact GPS coordinates in all locations. Furthermore, it requires no/minimal input by the user. The proposed methodology is affordable and proposed to be significantly less expensive than individual personal emergency response systems.

[0058] Each light pole, as per its further embodiment's is artificial intelligence (AI) enabled and will be equipped with a solar module, robot shelter, environmental sensors, network equipment, high-definition cameras, LiDAR, sound sensor, and artificial intelligence (AI) module. Robot shelter will allow the robots to recharge at the end of each patrol and thus enable perennial neighborhood safety and security patrols for the robots. A solar module will be used to ensure a backup source of power, i.e., the battery is continuously charged to provide a high degree of reliability. Network equipment will house 4G LTE (Fourth Generation Long-Term Evolution) modems that will allow the smart pole to transmit information back to the neighborhood safety portal. High-definition cameras will continuously analyze the street and sidewalk traffic for anomalies. Artificial Intelligence (AI) module will use these feeds generated by the camera and will leverage object detection frameworks like YOLOv5 to detect the specifics of an anomaly, i.e., car license plate, car model and color, suspect information, etc. The sound sensor will be used to detect anomalies such as car accidents, breaking of glass, gunshots, fireworks, illegal broadcasting of sound that can impact the safety and security realm of the neighborhood. LiDARs will be used to monitor the speed of the car.

[0059] High-definition cameras, as per its additional embodiments, will be deployed on the light pole will capture the incoming and outgoing traffic through a given lane. The LiDAR feed will be used to detect the speed of each vehicle, and the artificial intelligence (AI) module will extract the license number, make, and model of the vehicle. If, at any point the speed is higher than the safe speed listed for that neighborhood, the artificial intelligence (AI) module will capture the evidence and will share it with the public safety agency and the residents. The public safety agency can then use this information to take appropriate action against the corresponding driver and thus provide safety and security service in the neighborhood.

[0060] The smart poles, as per its further embodiments, will also house the sound sensor. The sound sensor will use a directional microphone to capture sound waves dissipating through each lane on the street. These sound waves will be analyzed using a neural network and will be classified as different types of anomalies such as gunshots, breaking of glass, accidents, people screaming for help, emergency, etc. This information, once captured, will be delivered to the local public safety agency over a reliable public safety mission critical 4G LTE network. While the paramedics are on their way, they can dispatch the robot deployed in this neighborhood to the appropriate spot using remote navigation capabilities and collect real-time information. They can also engage with the people on site through real-time video-chat service.

[0061] Furthermore, to ensure high reliability and availability, this system will use a mission critical public safety 4G LTE network that operates in FCC band 14. This will ensure all the data traffic traversing this system is served with the highest priority and reliability. Thus, in case of major public events like sports, protests, natural calamity, the data traffic of this system will be served with the highest priority (QoS) and over a dedicated long-term evolution access point name (LTE APN) profile. The Artificial Intelligence-enabled Light Poles functionality further includes Active Environment Monitoring. Each of these poles will be equipped with an air quality monitoring sensor. These sensors will continuously monitor the content of CO2, O2, Nitrogen, smoke, radioactive elements in the neighborhood. The information captured through this module will be displayed on a geographic map and will be provided to the local public safety agency and the residents over a software application. This information will allow the public safety agencies to ensure the residents are aware of the quality of the air, and it will also allow them to guide the residents through these adverse conditions.

[0062] The Artificial Intelligence-enabled Light Poles, in addition to the public safety grade 4G LTE network, this system will also use a Mesh WiFi network as a backup source of the Internet to provide data transmission functionality. If at any point the public safety grade 4G LTE network goes down, Mesh WiFi network deployed by local municipalities and Internet Service Providers (ISPs) can be used to provide data transmission functionality. Thus, this also improves the reliability and availability of this system, making it resilient to network outages.

[0063] The Artificial Intelligence-enabled Light Poles will also provide data encryption where the data at rest and the data in transit will be fully encrypted, making it difficult for hackers to modify the data. Data in transit will be encrypted using Transport Layer Security (TLS)/Secure Sockets Layer (SSL) encryption protocol with 256-bit keys. Data at rest will be encrypted using an on-chip encryption module.

[0064] As per its further embodiments, an associated software application will be made available to local public safety agencies and residents. Residents will use this software to receive safety and security information on a daily basis for their neighborhood. Statistics related to car accidents, gunshots, fights, speeding cars, air quality, crime will be made available to the residents.

[0065] While a specific embodiment has been shown and described, many variations are possible. With time, additional features may be employed. The particular shape or configuration of the platform or the interior configuration may be changed to suit the system or equipment with which it is used.

[0066] Having described the invention in detail, those skilled in the art will appreciate that modifications may be made to the invention without departing from its spirit. Therefore, it is not intended that the scope of the invention be limited to the specific embodiment illustrated and described. Rather, it is intended that the scope of this invention be determined by the appended claims and their equivalents.

[0067] The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, the inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.