SYSTEM FOR RECORDING AND REAL-TIME TRANSMISSION OF IN-FLIGHT OF AIRCRAFT COCKPIT TO GROUND SERVICES

Abstract

A system, method and device for monitoring an aircraft, including activity taking place within an aircraft and conditions of the aircraft, where one or more a percepting component such as a camera, microphone, or other sensor, is situated at a location within the aircraft from which information may be ascertained. Preferably the component is disguised within the surfaces or instrumentation of the aircraft. The percepting component is connected with a communication mechanism to transmit communications from the system resident within the aircraft to a grounds portion of the system through a communication link, such as a satellite communication link. The system may process the information corresponding with the aircraft condition or activity and generate alerts when a trigger is met or exceeded. The system components on the aircraft may monitor conditions and activity without using or interfering with the aircraft instrumentation, the system using only the aircraft power.

Claims

1. A method for real-time monitoring an aircraft comprising: (a) providing a flight recorder system, wherein said flight recorder system is separate from the aircraft's own avionics, and includes at least one percepting component comprising one or more sensors for sensing a condition; and situating the percepting component at a location on or within the aircraft from which information may be ascertained; (b) ascertaining a condition of the aircraft with the at least one percepting component; (c) transmitting and/or receiving communications over a communications network with a communication mechanism connected with said percepting component; and (d) operating a control mechanism connected with said percepting component to receive information from the percepting component and to communicate the information via the communication mechanism; (e) wherein said at least one or more sensors comprises a barometric pressure sensor, an accelerometer sensor, and an altitude sensor, and wherein said one or more sensors are independent from the aircraft's avionics and guidance components; (f) detecting an emergency condition experienced by the aircraft with said sensors; (g) issuing an alert via a speaker situated within the aircraft cockpit, when the system detects an emergency condition; (h) providing an indication of when the aircraft is taking off and climbing out, or landing using a combination of said accelerometer, said altitude sensor and said barometric pressure sensor, and programming the system to only record, or only to record and transmit, during those periods when said aircraft is taking off and climbing out, or landing.

2. The method of claim 1, wherein the percepting component comprises one or more of a camera, microphone and speaker.

3. The method of claim 2, wherein the percepting component comprises at least a plurality of cameras.

4. The method of claim 3, providing a remotely situated ground operations portion, the method further comprising monitoring a condition of the aircraft with the remotely situated ground operations portion, and receiving transmissions with the remotely situated ground operations that include at least an indication of when the aircraft is taking off and climbing out, or landing, said indication being provided by said accelerometer sensor, said attitude sensor and said barometric pressure sensor.

5. The method of claim 4, wherein said percepting component is provided on the aircraft and comprises an aircraft portion of said system, said aircraft portion including a communication mechanism having a satellite radio transceiver and an antenna for radiating signals for communicating via satellite communications link with said ground operations portion; wherein said ground operations portion comprises a receiving component configured to receive communications transmitted from the communication mechanism of the aircraft portion; the method further comprising receiving communications with the receiving component of the ground operations portion, and communicating between said aircraft portion communicates and said ground operations portion via said satellite communication link.

6. The method of claim 5, wherein the ground operations portion includes a computer with a processing component and software configured with instructions to instruct the processing component to analyze the information communicated from the aircraft portion by comparing the information to one or more threshold or predetermined values; processing with the ground operations portion computer an analysis of the information communicated from the aircraft portion by comparing the information to one or more threshold or predetermined values; generating a response when a threshold value or predetermined value is detected; communicating said response to said aircraft cockpit through one or more components of the aircraft portion of the system; wherein said response is communicated via said ground operations portion satellite transceiver through a satellite link to said aircraft portion transceiver through said aircraft portion antenna; wherein the control mechanism comprises one or more of a computing component or control circuitry means; wherein said response is communicated to said computing component or control circuitry means; wherein said computing component or control circuitry means of said aircraft portion is configured to process said response received from said ground operations portion and issue an alert via one or more components of said aircraft portion; processing said response received from said ground operations portion and issuing an alert via one or more components of said aircraft portion; wherein said ground operations portion comprises an artificial intelligence system, and wherein the method includes detecting conditions of the aircraft from the communications providing information obtained by the percepting component of the aircraft portion of the system, wherein said conditions include unusual conditions detected by said accelerometer sensor and said attitude sensor of said system.

7. The method of claim 6, wherein communication of the unusual conditions are communicated to the aircraft cockpit via said ground operations portion satellite transceiver through said satellite link and to said aircraft portion transceiver through said aircraft portion antenna.

8. The method of claim 7, wherein the aircraft portion of said system includes a speaker provided in the cockpit, and wherein communicating the unusual conditions comprises an audible communication through said speaker.

9. The method of claim 7, wherein the aircraft being monitored has a cockpit and an instrument panel in said cockpit, and wherein the system includes one or more cameras situated in said cockpit, the method including recording the instrument panel of the aircraft with at least one of said one or more cameras positioned to record the instrument panel of the aircraft.

10. The method of claim 8, wherein the aircraft being monitored has a cockpit and an instrument panel in said cockpit, and wherein the system includes one or more cameras situated in said cockpit, the method including recording the instrument panel of the aircraft with at least one of said one or more cameras positioned to record the instrument panel of the aircraft.

11. The method of claim 1, wherein the aircraft being monitored has a cockpit and an instrument panel in said cockpit, and wherein the system includes one or more cameras situated in said cockpit, the method including recording the instrument panel of the aircraft with at least one of said one or more cameras positioned to record the instrument panel of the aircraft.

12. The method of claim 10, including designating a threshold value or threshold change in a value for one or more conditions sensed by said one or more sensors, and monitoring and processing information from the sensors to determine whether a threshold value or change in value has been met, and wherein when the threshold value or change in value has been met, actuating the camera to record images.

13. The method of claim 8, wherein said communications take place via satellite communications between said ground operations portion and said aircraft, and delivering a message from the ground operations portion to the aircraft through the cockpit speaker.

14. The method of claim 13, including determining with said system via said sensors that are independent of said aircraft avionics, when an aircraft is in a detected or declared emergency situation, and implementing an artificial intelligence function of the system to provide advisement to the pilots via the speaker in the aircraft through the satellite link.

15. The method of claim 13, including determining with said system via said sensors that are independent of said aircraft avionics, when an aircraft is in a detected or declared emergency situation, and implementing a function of the system wherein a human selectively employs the satellite link and the speaker in the aircraft to provide advisement to the pilots.

16. The method of claim 5, wherein the aircraft being monitored has a cockpit and an instrument panel in said cockpit, and wherein the system includes one or more cameras situated in said cockpit, and wherein said one or more cameras includes a capture element that is installed within an aircraft cockpit component, and wherein the capture element is disguised to integrate with the cockpit component.

17. The method of claim 6, wherein the aircraft being monitored has a cockpit and an instrument panel in said cockpit, and wherein the system includes one or more cameras situated in said cockpit, and wherein said one or more cameras includes a capture element that is installed within an aircraft cockpit component, and wherein the capture element is disguised to integrate with the cockpit component.

18. The method of claim 9, wherein said one or more cameras includes a capture element that is installed within an aircraft cockpit component, and wherein the capture element is disguised to integrate with the cockpit component.

19. The method of claim 5, wherein the ground operations portion operates computer software and a) processes the information and stores the information received from the aircraft portion; b) identifies a subscriber; c) associates the subscriber with an access provision; and d) provides access to aircraft information to the subscriber based on the subscriber access provision.

20. The method of claim 19, wherein the subscriber designates an aircraft, or category in which one or more aircrafts are classified; and wherein the method includes generating alerts, including a subscriber alert, and communicating the subscriber alert to a subscriber of a designated aircraft or category to which one or more aircrafts are classified, based on a trigger generated from the processing of information communicated from the aircraft portion.

Description

BRIEF DESCRIPTION OF THE DRAWING FIGURES

[0014] FIG. 1 is a schematic illustration depicting an exemplary embodiment of the system, according to the invention, showing a device for imaging and associated components for managing information.

[0015] FIG. 2A is a perspective view of the cockpit, showing two pilots seated therein, as viewed from the rear of the cockpit looking forward.

[0016] FIG. 2B is a perspective view of the cockpit depicted in FIG. 1, showing a pilot seated therein.

DETAILED DESCRIPTION OF THE INVENTION

[0017] The fundamental invention is disclosed in FIG. 1, and further described herein, along with descriptions of options which may be amended to the elements of the invention without limitation or departing from the scope. For the purposes of this disclosure, the invention is called the real-time flight recorder system (RFRS).

[0018] First, referring to FIG. 1, an exemplary embodiment of a system according to the invention is illustrated. The RFRS, in the embodiment depicted, is shown including a camera 102 which typically has a wide angle lens 101A, with a microphone and speaker 101B. The microphone speaker 101B and camera 102 may be contained within a single housing as indicated in FIG. 1, or, according to alternate embodiments, may be separately mounted. Preferably, the camera, speaker and microphone are mounted in the cockpit 101 in a location which does not interfere with the operation of the aircraft, but which nevertheless provides a view of the cockpit 101 and pilots, as shown for example, without limitation, in FIGS. 2A and 2B, where cockpits 201 and 101 are depicted, respectively. For example, as depicted in FIGS. 2A and 2B, the camera ascertains an image of the cockpit view where a number of the aircraft's instruments, which are operative during flight, are imaged and recorded. The image may be transmitted to the ground portion 120 during flight (or after the flight), to provide information about the aircraft's condition during its flight. The information may comprise real time information. According to some alternative embodiments, the information obtained from components (e.g., from cameras and sensors) may be processed by the aircraft portion 100 of the RFRS, and processed data obtained from the image or sensor information may be transmitted from the aircraft portion 100 to the ground portion 120. The component 115 may be configured with software or other artificial intelligence to identify or detect conditions of the aircraft (based on the camera and/or other sensors) and provide alerts when the condition meets or exceeds a threshold. In addition, the single camera 102 indicated in FIG. 1 may in fact be two or more cameras in order to provide complete coverage of a cockpit, without departing from the scope of the invention disclosed herein. In addition, as well known to those practiced in the art, the cameras and microphone and speaker may be of the miniature type, so that their location may be made to be hidden or innocuous or disguised to appear part of other instruments or switches, and therefore not readily recognizable by a hijacker or other unauthorized entrant to the cockpit. The camera 102 and microphone are set to record images and audio in the cockpit 101, primarily during emergencies, but may be set to record at any time, including for the complete duration of a flight, or for training purposes. The recording devices are connected to a system 100 which resides in the aircraft, but other than a power connection (where the system is configured or installed to receive power from the aircraft), is otherwise in no way connected to any other aircraft systems, and is therefore easy to install in aircraft which are already in operation and/or without affecting the aircraft's airworthiness certificate.

[0019] In addition to the camera 102 and microphone and speaker 101B, the aircraft portion 100 of the RFRS includes means to automatically record and/or transmit images, sound bites or full video when certain sounds or images are noticed by the system. Listening circuitry may be provided. For example, the listening circuitry may process inputs from the camera 102, microphone, or other detecting component (such as, for example, a sensor, which may be included as part of the camera 102, or which may be separately provided an associated with the system components). The optional recording function 102 and recording trigger function 104 and optional continuous full video and audio 105 are compressed, formatted and encrypted 106 in preparation for optional transmission to the ground portion of the RFRS 120 via link 108 to a satellite radio transceiver 109 with suitable antenna 110. According to some embodiments, the ground portion 120 may be configured to include a satellite transceiver 114 for transmitting and receiving communications through a satellite (such as, for example, the satellite link represented by the satellite 112 and links 111,113 depicted in FIG. 1). The aircraft portion of the system 100 may also include sensors separate from those of the aircraft, including optionally a barometric pressure sensor and accelerometer sensor and an attitude sensor (not shown). The aircraft portion 100 of the RFRS is shown containing a supervisory computer or control circuitry means 107. According to some embodiments of the invention, all of the functional elements of the aircraft portion 100 of the RFRS may be contained within a single computer or programmable circuit means, as opposed to being separable functions, without departing from the scope. According to other embodiments, the functional elements may be provided in one or more separate arrangements, for example, where the camera 102 and/or other sensors that collect or provide information, are provided separately from the operation circuitry or processing components, and transmission components.

[0020] According to some embodiments, the system components may be provided together in a housing. Embodiments may be configured where one or more components, such as, for example, a camera lens, sensor, or microphone, may be located separate from the housing and disguised among the cockpit instruments, switches, panels and/or other interior components. The component or components which are not situated within the housing preferably are connected to the housing or one or more other components within the housing. This may be done through a suitable connection, which may be wired or wireless (where the transmission would not interfere with aircraft instrumentation).

[0021] In operation, various sensors may operate individually or in concert to register conditions to the supervisory means which cause the images and audio or video and audio to be recorded and optionally immediately transmitted, or saved for later transmission. The trigger points or combinations can be set prior to installation by a program, prior to a single flight by a program, or on a real-time basis by a program, and that program can be optionally updated locally or via the radio link from another location. For example, a recording can be started if the RFRS detects a certain indicator light on the instrument panel, or detects the audio of a warning from the instruments, or detects unusual sounds. The audio can also be set to trigger a recording if it detects a certain word or sequence said by the pilot, such as “mayday” or “help” or a sequence of numbers known only to the pilots but not to unauthorized persons, and in this way the recording and transmission system may be triggered by the pilot during emergencies with minimal additional workload.

[0022] In addition, the RFRS portion 100 on the aircraft may be set to continuously record at all times when in flight, or when power to the aircraft is applied, and sufficient memory can be put in place inside the RFRS aircraft portion 100 to store an entire flight's worth of audio and video. For example, recording of low motion rank video for 12 hours with low loss compression may take as little as 8 gigabytes of memory, which is easily provided for with modern flash or other nonvolatile memory in the aircraft RFRS 100. This video may be optionally linked to the ground portion of the RFRS 120 via the satellite link, represented by a satellite 112 and links 111,113, at anytime or dumped in reverse time order (that is, the most recent first) upon a signaling of a possible emergency. In this manner transmission may be controlled to prioritize the events leading up to the emergency condition being firstly transmitted to the ground portion of the RFRS 120.

[0023] Optionally, the accelerometer and attitude and cabin barometric pressure sensors may be combined to indicate when the aircraft is taking off and climbing out, or landing, which is when emergencies and incidents occur most often, and the system programmed to only record, or only record and transmit, or only transmit during those periods.

[0024] Many combinations of sensor readings, thresholds, including sounds and images, may be combined in a program on the supervisory means of the RFRS in the aircraft 100, which can be conceived by those practiced in the art of aircraft emergencies and systems, without departing from the scope.

[0025] When audio and video from the RFRS aircraft portion 100 is received by the ground portion 120 via the satellite link (see e.g., satellite 112 and links 111,113), it can be stored and optionally analyzed immediately by either an automated artificial intelligence system contained within a component 115 (which, for example, may be a computer connected to receive information from the aircraft portion 100 of the RFRS via the satellite transceiver 114), or by a human trained to assist pilots in emergencies (not shown). If an aircraft is in a detected or declared emergency situation, the artificial intelligence function or the human may employ the satellite link and the speaker in the aircraft in order to provide advisement to the pilots, when appropriate.

[0026] In addition, the RFRS may provide for distribution of video and audio from an aircraft to authorities, or flight operations departments of airlines, or any other particular entity or machine which has a need to receive such information, or any combination thereof.

[0027] For example, had this RFRS system been in place on Air France 447 over the middle of the Atlantic, the aircraft portion sensors could have detected an attitude and acceleration of the aircraft which were unusual and commenced immediately sending video and audio of the cockpit conditions to Air France flight operations in Paris via the satellite link. The flight operations personnel in Paris, being more objective because they were not present in the cockpit, could have easily seen the multiple instrument panel indicators suggesting that the aircraft was in a stall condition, and could have observed that the pilots were taking the wrong approach to bring the aircraft out of stall, and could have communicated over the satellite link directly into the aircraft flight deck without requiring relay through multiple ground controllers and unknown ground-to-aircraft communications conditions, and possibly saved the aircraft. Even if the attempts to save the aircraft and passengers was ultimately unsuccessful, at the very least the flight operations personnel would have immediate knowledge of the reasons the aircraft went down, instead of having to wait nearly two years for the flight recorders to be found.

[0028] Embodiments of the invention also include aircraft that are configured with the camera 102 and/or components of the system for detecting activity within the aircraft (individuals within the cockpit cabin or other space, smoke, and the like), and of the aircraft (movements of the aircraft, which for example may include altitude, speed, and other detectable movements). The system preferably is deployed in the aircraft separate from other instrumentation of the aircraft itself. The camera 102, microphone, speaker, or other component of the system (including other sensors), may be provided separate from other components of the aircraft, such as the aircraft instrumentation that measure what the system sensors also may measure. The system may be implemented in the aircraft by connecting the system power to a power source of the aircraft, such as, for example, a generator, battery, power terminal or other source. The system may receive power directly from the aircraft power source, or system may be configured with its own power source, such as a rechargeable battery, or a combination of these, where the aircraft power source charges the system battery. However, according to preferred embodiments, the system ascertains information (e.g., such as activity within the aircraft cabin or cockpit, operating conditions, such as, altitude, speed, and others), which is sensed by the system components, and not the aircraft instrumentation. Although the aircraft is configured with instrumentation and sensors that may provide indications on the instrument panel in the cockpit, the RFRS system components are separate from the aircraft instrumentation, and the RFRS system ascertains information using these separately provisioned system components to communicate the information to a location remote from the operating aircraft. The aircraft preferably is configured, as illustrated in FIG. 1, to carry the system transceiver 109 and an antenna 110 which are configured with the communications mechanism of the system and sensors (such as the camera 102), to provide the information to a ground portion 120 of the system through a satellite communications link (see e.g., 112 and 111,113). The aircraft may be configured so that the system components that are employed to sense activity are located in different positions within panels of aircrafts, in order to make it more difficult for a wrongdoer to potentially disable the component. For example, a camera lens may be placed and disguised within a particular instrument panel, light, knob, or switch in one aircraft, and in a different location in another aircraft. According to some preferred embodiments, the system components are installed on the aircraft when it is being constructed. According to some other embodiments, the system is installed in an already constructed aircraft.

[0029] The system, method and devices also provide a service that a subscriber may receive. Embodiments of the invention are designed to provide a subscriber system for receiving the ascertained information, where the information for one or more aircraft may be managed among one or more subscribers. For example, the service may be implemented with the system, and information may be communicated to reside in a subscriber account. For example, a portion of the system may comprise one or more computing components, data repositories, or other storage means, which receives the information communicated from the aircraft portion of the system. For example, images from the camera 102 taken periodically (or streaming, or both periodic and streaming when activity or other triggering condition is present or detected) may be transmitted to the remotely situated ground portion of the system. The ground portion may be configured to capture the data from transmissions received from the aircraft portion, and process that information. According to some embodiments, the system is configured as a subscriber system, and subscribers may subscribe to receive access to the information provided by the system, even as the aircraft is in flight. The subscriber side of the system preferably resides in a ground portion of the system which subscribers (who are authorized) may access. The information may be subscribed to, and, the subscriber system may also include an alerting system that is configured to provide notifications to a subscriber. For example, according to one implementation, subscriber notification parameters may be preset (by a subscriber preference or otherwise) to provide an alert to a subscriber upon the subscriber account receiving information from the system of an aircraft that indicates a triggering event has occurred or been detected. A subscriber may subscribe to one or more subscription components, such as aircrafts, carriers, regions, or other distinction, so that the subscriber receives information relevant to particular aircrafts of interest to that subscriber. The subscriber may be provided with approvals and authorizations prior to the subscriber being permitted to access the information. Subscriber communications also may be encrypted. Other subscription requirements may be an account, a contact, a payment system for the subscriber to purchase or maintain a subscription. Among those who may be potential subscribers include for example an aviation authority or agency of a government, law enforcement, military, or other regulatory body or group. The subscriber system may be configured on a computing component, which may comprise a computer with a processor, and a storage component maintained on or in association with the computing component, so that information may be stored and retrieved from the storage component. The storage component may be a hard drive, flash memory, a drive of the computer, a remotely linked drive or other suitable data storage element. The subscriber system computer, for example, may be configured with software containing instructions to process the information from the aircraft portion of the system. The subscriber system computer, for example, may be configured to store and distribute the aircraft information obtained from the aircraft system portion, such as, for example, recordings, to appropriate flight operations people, trainers, authorities, and the like. These organizations or individuals may be subscribers. Subscribers also may be provided with different access levels, so that some subscribers may have access to different information than other subscribers (based on company affiliation, subscriber employment, rank or position level within an organization, and the like). The subscription may be set up as a service, provided and invoiced monthly, annually, or other remuneration method.

[0030] These and other advantages may be obtained through the use of the inventive system, methods and devices disclosed herein. While the invention has been described with reference to specific embodiments, the description is illustrative and is not to be construed as limiting the scope of the invention. For example, the percepting components may comprise or more cameras, and multiple sensors, and may be provided in different locations of the aircraft. The configuration may provide redundancy of sensors or alternate locations for viewpoint locations, and the like. Various modifications and changes may occur to those skilled in the art without departing from the spirit and scope of the invention described herein and as set forth in the appended claims.