SYSTEM, METHOD, AND APPARATUS TO MITIGATE AND OR PREVENT AUTONOMOUS VEHICLE MISUSE THROUGH THE USE OF SECURITY ENABLED SENSORS
20190248326 ยท 2019-08-15
Inventors
Cpc classification
B60R25/2018
PERFORMING OPERATIONS; TRANSPORTING
International classification
Abstract
Methods and systems for implementing autonomous vehicle security features. The present invention details an effective and secure methodology to implement the external management and control of autonomous vehicles by authorized personnel, usually law enforcement, through the use of intelligent sensors that can override an autonomous vehicle controller's functionality as necessary.
Claims
1. A Lawful Stop and Search (LSS) Override Controller for an autonomous vehicle, the controller comprising: a sensor system that detects at least one of ultrasonic waves and electromagnetic waves; a receiver coupled to the sensor system to receive a modulated signal from a LSS Illuminator acting as a network client or a LSS Manual Controller acting as a network client; a processor acting as a network server to respond to the modulated signal via a transmitter to establish a communications link with the LSS Illuminator or the LSS Manual Controller using a protocol that identifies a user of the LSS Illuminator or the LSS Manual Controller and authenticates authority of the user to directly control the autonomous vehicle via the LSS Illuminator or the LSS Manual Controller.
2. The LSS Override Controller of claim 1, wherein the communications link protocol between the LSS Override Controller and the LSS Illuminator or the LSS Manual Controller includes at least one of the following characteristics: message confidentiality, message integrity, end-point authentication, reliability, and perfect forward secrecy.
3. The LSS Override Controller of claim 1, wherein the processor receives from the LSS Illuminator or the LSS Manual Controller a digital certificate issued by a certificate authority to provide said identification and authentication, and wherein the processor supplies the LSS Illuminator or the LSS Manual Controller with a digital certificate issued by a certificate authority to identify and authenticate ownership of the autonomous vehicle.
4. The LSS Override Controller of claim 1, wherein the processor employs the protocol to send digitally signed messages to the LSS Illuminator or the LSS Manual Controller to provide non-repudiation of message receipt.
5. The LSS Override Controller of claim 1, wherein contingent upon said identification and authentication, the processor automatically acknowledges and complies with at least one of the following commands: EmergencyStop, Stop, Fence, Acknowledge, Identify, Manifest, PullOverPark, and ResumeOperation.
6. The LSS Override Controller of claim 1, wherein contingent upon receipt of one of the following commands: EmergencyStop, Stop, and PullOverPark, the LSS Override Controller will respond to only a first set of commands from a LSS Illuminator or a second set of commands from a LSS Manual Controller, wherein the first set of commands includes: Acknowledge, Identify, Manifest, and ResumeOperation; and wherein the second set of commands includes: PullForward, BackUp, TurnLeft, TurnRight, Stop, DownloadVehicleIdentification, UnlockLoadCompartment, ContactTerminal, and ResumeOperation.
7. The LSS Override Controller of claim 6, wherein contingent upon receipt of the ResumeOperation command the processor will return vehicle control to a default control system for the autonomous vehicle.
8. A lawful stop and search (LSS) Illuminator that comprises: a processor acting as a network client, the processor coupled to a transmitter to provide a directed beam of acoustic or electromagnetic energy to a LSS Override Controller of an autonomous vehicle, the directed beam including a modulated signal to establish a communications link with the LSS Override Controller acting as a server, the communications link using a protocol that identifies and authenticates authority of a user of the LSS Illuminator to direct the LSS Override Controller to take control of the autonomous vehicle from a default control system for the autonomous vehicle.
9. The LSS Illuminator of claim 8, further comprising: a receiver coupled to the processor, the receiver operating to detect, from the vehicle, responses that complete the communications link, the processor issuing one or more commands via the communications link, the one or more commands being from a command set that includes at least: EmergencyStop, Stop, Fence, Acknowledge, Identify, Manifest, PullOverPark.
10. The LSS Illuminator of claim 9, wherein the communications link protocol between LSS Illuminator and LSS Override Controller includes at least one of the following characteristics: message confidentiality, message integrity, end-point authentication, reliability, and perfect forward secrecy.
11. The LSS Illuminator of claim 8, wherein the protocol employs a digital certificate issued by a certificate authority to provide said authentication.
12. The LSS Illuminator of claim 8, wherein the processor employs the protocol to send digitally signed messages to the LSS Override Controller to provide non-repudiation of origin of the commands from the user of the LSS Illuminator directing operation of the autonomous vehicle.
13. The LSS Illuminator of claim 8, further comprising an external casing that renders the LSS Illuminator operable as a handheld device.
14. The LSS Illuminator of claim 8, wherein the transmitter is steerably mounted to a law enforcement vehicle.
15. The LSS Illuminator of claim 8, further comprising: a receiver to detect, from the vehicle, responses that complete the communications link, the processor issuing a Fence command via the communications link, the Fence command including coordinates that define at least one edge of a restricted area.
16. A lawful stop and search (LSS) Manual Controller that comprises: a processor acting as a network client, the processor coupled to a transmitter to provide a modulated signal to a LSS Override Controller of an autonomous vehicle, the modulated signal employing a protocol to establish a communications link with the LSS Override Controller acting as a network server, the processor using the protocol to identify and authenticate authority of a user of the LSS Manual Controller to direct the LSS Override Controller to take control of the autonomous vehicle from a default control system for the autonomous vehicle.
17. The LSS Manual Controller of claim 16, further comprising: a receiver coupled to the processor, the receiver operating to detect, from the LSS Override Controller, responses that complete the communications link, the processor issuing one or more commands via the communications link, the one or more commands being from a command set that includes at least: PullForward, BackUp, TurnLeft, TurnRight, Stop, DownloadVehicleIdentification, UnlockLoadCompartment, ContactTerminal, and ResumeOperation.
18. The LSS Manual Controller of claim 17, wherein the communications link protocol between LSS Controller and LSS Override Controller includes at least one of the following characteristics: message confidentiality, message integrity, end-point authentication, reliability, and perfect forward secrecy.
19. The LSS Manual Controller of claim 16, wherein the protocol employs a digital certificate issued by a certificate authority to provide said authentication.
20. The LSS Manual Controller of claim 16, wherein the processor employs the protocol to send digitally signed messages to the LSS Override Controller to provide non-repudiation of origin of the commands from the user of the LSS Manual Controller directing operation of the autonomous vehicle.
21. The LSS Manual Controller of claim 16, wherein the modulated signal between LSS Manual Controller and LSS Override Controller is conveyed by at least one of: direct wired connection, ultrasonic waves, and electromagnetic waves.
22. The LSS Manual Controller of claim 16, further comprising an external casing that renders the LSS Manual Controller operable as a handheld device.
23. A lawful stop and search (LSS) enforcement method that comprises: illuminating a LSS Override Sensor on an autonomous vehicle with a directed beam of acoustic or electromagnetic energy that includes a modulated signal; using responses from the LSS Override Controller to establish a communications link employing a protocol that authenticates authority of the LSS Override Controller to direct operation of the autonomous vehicle; and issuing at least one command for the LSS Override Controller to obey automatically to direct the operation of the autonomous vehicle.
24. The LSS enforcement method of claim 23, wherein the at least one command is selected from a command set that includes at least EmergencyStop, Stop, and ResumeOperation.
25. The LSS enforcement method of claim 23, wherein the protocol includes at least one of the following characteristics: message confidentiality, message integrity, end-point authentication, reliability, and perfect forward secrecy, and wherein the protocol identifies and authenticates authority of a user of an LSS Illuminator to direct the LSS Override Controller to take control of the autonomous vehicle from a default control system of the autonomous vehicle.
26. The LSS enforcement method of claim 23, wherein said illuminating includes steering a ultrasonic or electromagnetic beam from a handheld device or from an transmitter steerably mounted to a law enforcement vehicle.
27. The LSS enforcement method of claim 23, wherein said illuminating includes positioning a transmitter near an edge of a restricted area to exclude the autonomous vehicle, and wherein said at least one command is a Fence command that specifies coordinates to define said edge.
28. A lawful stop and search (LSS) compliance method that comprises: detecting a modulated signal from an LSS Manual Controller to a LSS Override Controller; responding to the modulated signal using a protocol that authenticates authority of the user of the LSS Manual Controller to direct the LSS Override Controller to take control of the autonomous vehicle from a default control system of the autonomous vehicle; and if said authority is authenticated, establishing a communications link to receive commands from the LSS Manual Controller.
29. The LSS compliance method of claim 28, wherein if said authority is authenticated, the method further comprises acknowledging and automatically complying with at least one of the following commands: Stop, Acknowledge, Identify, Manifest, ResumeOperation, PullForward, BackUp, TurnLeft, TurnRight, DownloadVehicleIdentification, UnlockLoadCompartment, and ContactTerminal.
30. The LSS compliance method of claim 28, wherein the communications link protocol includes at least one of the following characteristics: message confidentiality, message integrity, end-point authentication, reliability, and perfect forward secrecy, and wherein the protocol supplies the LSS Manual Controller with a digital certificate to authenticate ownership of the vehicle, and further employs a digital certificate from the LSS Manual Controller to authenticate authority of the controller to direct operation of the vehicle.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The novel features believed characteristic of the invention are set forth in the appended claims; however, the invention itself, as well as a preferred mode of use, further objectives and advantages thereof, will best be understood by reference to the following detailed description of an illustrative embodiment when read in conjunction with the accompanying drawings, wherein:
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
DETAILED DESCRIPTION OF THE INVENTION
[0054] With reference now to the figures, and in particular with reference to
[0055] With reference now to
[0056] With reference now to
[0057] With reference now to
[0058] With reference now to
[0059] Depicted in
[0060] Typical necessary commands (or their equivalent) that are envisioned are the emergency commands, EmergencyStop, Stop, and Fence, and the normal commands, Acknowledge, Identify, Manifest, PullOverPark, and ResumeOperation; once the AV is at a full stop, further actions can be initiated via other communication paths. The command EmergenctStop is issued only when imminent danger necessitates the AV must apply all means to halt motion; this may necessitate a separate control path be implemented, one that bypasses the AV's controller and operates directly on the motor feed and braking mechanisms. The command Stop is issued in situations that require immediate AV halt; however, normal safety rules remain in place except the AV does not need to clear traffic lanes. The command Fence is issued in fixed locations that require the AV recognize a restricted area that the AV may not enter, this command transmits the GPS coordinates of its location so the AV may reroute. The command Acknowledge requires the AV respond to a sensor query to verify the health of the LSS System. The command Identify requires the vehicle return AV identification data. The command Manifest requires the AV respond with the current vehicle manifest data. The command PullOverPark is intended for normal situations where vehicle inspection e.g., load inspection, vehicle weight, etc., or other lawful stop of the AV is required where the AV needs to be clear traffic lanes. The command ResumeOperation is intended to allow the AV continue its operation after interruption; however, no internal AV control may be applied until enabled by receipt of this command. Additionally, some commands could requires sub-commands for added functionality, the PullOverPark command could include sub-commands to indicate why the AV was pulled over, e.g., MobileScale, LoadInspection, EquipmentViolation, or others as required. Those of ordinary skill in the art will appreciate that design requirements, regulatory requirements, field experience, etc., may require commands be added, modified, and/or removed.
[0061] With reference now to
[0062] The transmit chain is comprised of Oscillator 501 which generates the carrier frequency, the Modulator 503 which modulates the carrier, Amplifier 505 which amplifies the signal, the Transmitter 507 which emits the modulated beam 530 intended for the LSS Sensor. The receive chain is comprised of the Receiver 515 which receives the modulated beam 532 from the LSS Sensor, Signal Conditioner and Amplifier 513 which synchronizes to the incoming signal and amplifies to the proper level, and Demodulator 511 which recovers the information content from the modulated carrier wave and sends for processing. The processing chain is comprised of Processor 509, and the RAM/NVRAM 517. The Processor 509 performs all processing tasks including generating transmit signals, interpreting receive signals, user input/output functions, and interfacing to dispatch; it interfaces to RAM/NVRAM 517 where program and data are stored, interfaces to USB Interface 521 which provides means to load necessary system data, reads User Input 519, drives Status Indicators 523, and drives the Dispatch Interface 525 which insures all device (LSS Illuminator) usage is externally monitored to preserve usage records. Optionally, for electronic fence applications, a GPS Receiver 527 and GPS Antenna 529 can be integrated. It is recommended high-accuracy GPS be implemented.
[0063] With reference now to
[0064] The transmit chain is comprised of Oscillator 601 which generates the carrier frequency, the Modulator 603 which modulates the carrier, Amplifier 605 which amplifies the signal, the Transmitter 607 which emits the modulated signal 630 to the LSS AV Override System, either via wired or wireless means. The receive chain is comprised of the Receiver 615 which receives the modulated signal 632 from the LSS AV Override System, again, either via wired or wireless means, Signal Conditioner and Amplifier 613 which synchronizes to the incoming signal and amplifies to the proper level, and Demodulator 611 which recovers the information content from the modulated carrier wave and sends for processing. The processing chain is comprised of Processor 609, and the RAM/NVRAM 617. The Processor 609 performs all processing tasks including generating transmit signals, interpreting receive signals, user input/output functions, and interfacing to dispatch; it interfaces to RAM/NVRAM 617 where program and data are stored, interfaces to USB Interface 621 which provides means to load necessary system data, reads User Input 619, and drives Status Indicators 623. When LSS Manual Controller 600 is activated it initiates a TLSv1.2 handshake with mutual authentication; immediately after the handshake is completed, the LSS Manual Controller 600 transmits command(s) and waits on a response from the LSS AV Override System. When the command(s) are acknowledged, the LSS Manual Controller 600 issues a TLSv1.2 shutdown command to terminate the link; this ends the TLS session. Those of ordinary skill in the art will appreciate that protocols other than TLSv1.2 may be used to achieve the necessary link security.
[0065] Typical necessary commands (or their equivalent) that are envisioned are the proportional commands, PullForward, BackUp, TurnLeft, and TurnRight and fixed commands, Stop, DownloadVehicleIdentification, UnlockLoadCompartment, ContactTerminal, and ResumeOperation; proportional commands carry rate information and are used to move the vehicle locally at low rates of speed. The The command Stop is issued in situations that require immediate AV halt. The command DownloadVehicleIdentification is intended for situations where vehicle inspection requires the vehicle produce documentation such as: identification (the motor carrier's name or trade name and the motor carrier's Department of Transportation (DOT) registration number, manifest, proof of insurance, maintenance records, accident records, licenses, permits, planned route and actual route, etc.; this information is downloaded to the controller's USB drive for review and storage. The command UnlockLoadCompartment is used to perform vehicle load inspections. The command ContactTerminal is intended to notify the vehicle's owner/operator that additional assistance is required. The command ResumeOperation is intended to allow the AV continue its operation after interruption; however, no internal AV control may be applied until enabled by receipt of this command. Those of ordinary skill in the art will appreciate that design requirements, regulatory requirements, field experience, etc., may require commands be added, modified, and/or removed.
[0066] With reference now to
[0067] The transmit chain is comprised of Oscillator 701 which generates the carrier frequency, the Modulator 703 which modulates the carrier, Amplifier 705 which amplifies the signal, the Transmitter 707 which emits the modulated beam 730 intended for the LSS Illuminator. The receive chain is comprised of the Receiver 715 which receives the modulated beam 732 from the LSS Illuminator, Signal Conditioner and Amplifier 713 which synchronizes to the incoming signal and amplifies to the proper level, and Demodulator 711 which recovers the information content from the modulated carrier wave and sends for processing, The processing chain is comprised of Processor 709, and the RAM/NVRAM 717. The Processor 709 performs all processing tasks including generating transmit signals, interpreting receive signals, user input/output functions, and interfacing to dispatch; it interfaces to RAM/NVRAM 717 where program and data are stored, interfaces to USB Interface 721 which provides means to load necessary system data, reads User Input 719, drives Status Indicators 723, and drives the Dispatch Interface 725 which insures all device (LSS Illuminator) usage is externally monitored to preserve usage records, interfaces to the External Control Interface 727 which allows the AV be controlled by an external device, and interfaces to the AV Computer Interface 729 which sends override commands to the AV control system computer, or to a separate control implemented to bypasses the AV's controller and operates directly on the motor feed and braking mechanisms via the Emergency Override Interface 728.
[0068] A high-accuracy GPS Receiver 720 and GPS Antenna 724 provide accurate LSS location data that is independent of the AV control system. LSS location data is used in conjunction with Fence commands received from LSS electronic fence installations. As the vehicle approaches a restricted area marked with the LSS fence, the AV controller may be notified to avoid the restricted area. In the case the LSS AV Override System detects actual AV intrusion into a LSS electronic fenced area, the vehicle is reliably stopped by bypassing the AV's controller via the Emergency Override Interface 728, operating directly on the motor feed and braking mechanisms. Once the AV has been stopped using the Emergency Override Interface 728, it can only be restarted by law enforcement. LSS AV Override System location data can also be sent to the AV control system to increase its reliability. To reduce misuse and increase route reliability, the Native AV Controller can transmit the route map to the LSS AV Override System via the AV Computer Interface 729 where the route is continuously checked by the LSS Override System. Small route deviations can be transmit back to the AV controller for correction resulting in higher route reliability, whereas large route deviations will result in activation of the Emergency Override Interface and subsequent AV stop. Those of ordinary skill in the art will appreciate that the LSS AV Override System and all interfaces to the AV must have sufficient physical and logical protection to prevent misuse and/or tampering; therefore, manufacturers should consider FIPS 140-2 Level 4 certification or its equivalent.
[0069] With reference now to
[0070] With reference now to
[0071] With reference now to
[0072] With reference now to
[0073] With reference now to
[0074] The descriptions of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiment was chosen and described in order to best explain the principles of the invention, the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
Definitions:
[0075]
TABLE-US-00001 AV Autonomous Vehicle, for the purposes of this invention, refers to SAE specification J3016, Level 2 and higher vehicle. Federal Information Publicly announced standards developed by Processing the United States federal government for use in Standards computer systems by non-military government agencies and government contractors. FIPS See Federal Information Processing Standards Global Navigation The standard generic term for satellite navigation Satellite System systems that provide autonomous geo-spatial positioning with global coverage. Global Positioning The US Government's implementation of GNSS System GNSS See Global Navigation Satellite System GPS See Global Positioning System IAS See Intrusion Analysis Software Lawful Stop and Refers to a situation where law enforcement may Search legally request a vehicle to pull over and search (inspect) the vehicle LSS See Lawful Stop and Search LIDAR An acronym for Light Detection and Ranging, which is a remote sensing method that uses pulsed laser light to perform range measurements; it is and for control and navigation for autonomous vehicles. National Institute of A United States government non-regulatory federal Standards and agency Department of Commerce; its mission is to Technology promote US. innovation and industrial competitiveness by advancing measurement science, standards, and technology in ways that enhance economic security and improve our quality of life. NIST See National Institute of Standards and Technology SAE Society of Automotive Engineers V2I Vehicle to Infrastructure V2V Vehicle to Vehicle V2X V2I and V2V