System and method for inspecting and validating flight procedure

Abstract

The present invention relates to a system and method for inspecting and validating a flight procedure used in the field of civil aviation. The system comprises an image capturing apparatus, a storage device, a playing device, a recorder such as QAR, a data processing module and a synchronization module; the method for inspecting and validating a flight procedure applied in the system includes the following steps: collecting actual visual videos and flight parameters, generating simulation visual videos, generating over-limit alarms, processing data, generating complex simulation visual videos, generating flight trajectory and flight procedure protection area pictures, and synchronizing and playing the videos. With the application of the system and the method, the defects of the prior art can be overcome, artificial sensory factors are more avoided, the general condition of an aircraft itself at each time point during the execution of the flight procedure are accurately reflected, and objective and accurate references are provided for designers and approvers of the flight procedure.

Claims

1. A system for inspecting and validating a flight procedure, comprising an image capturing apparatus, a storage device, a playing device, and a recorder, characterized in that the system is further provided with a data processing module for processing flight data extracted by the recorder and a synchronization module for synchronizing video files temporally; the image capturing apparatus is equipped on an aircraft, and is connected with the storage device; the recorder is connected with the data processing module; the storage device and the data processing module are connected independently with the synchronization module, the synchronization module being connected with the playing device; wherein the system further comprises a first display screen for displaying images of actual flight paths collected by the image capturing apparatus, a second display screen and a third display screen for displaying images of simulation flight paths generated from the flight data recorded by the recorder, and a fourth display screen for displaying two-dimensional pictures of images of the simulation flight paths; the playing device is independently connected with the first display screen, the second display screen, the third display screen, and the fourth display screen; wherein the first display screen, the second display screen, the third display screen and the fourth display screen are four display screens disposed on the same wall.

2. The system for inspecting and validating a flight procedure of claim 1, characterized in that the third display screen displays complex flight simulation videos processed and generated by a software, and the fourth display screen displays simulation videos of 3D images processed and generated by another software.

3. The system for inspecting and validating a flight procedure of claim 2, characterized in that the software is Xplane.

4. The system for inspecting and validating a flight procedure of claim 2, characterized in that the another software is Google Earth.

5. A method for validating a flight procedure applied in the system of claim 1, comprising the step of collecting actual visual videos and flight parameters, the step of generating simulation visual videos, the step of generating over-limit alarms, the step of processing data, the step of generating complex simulation visual videos, the step of generating flight trajectory and flight procedure protection area pictures, the step of synchronizing the actual visual videos, the simulation visual videos, and the complex simulation visual videos, and the step of playing the actual visual videos, the simulation visual videos, and the complex simulation visual videos; in the step of collecting actual visual videos and flight parameters, actual flight is carried out at an actual location according to a pre-designed flight procedure; during the flight, the image capturing apparatus in the system stores captured actual visual videos into the storage device, and meanwhile, the recorder records various flight parameters; in the step of generating simulation visual videos, the data processing module in the system extracts the flight parameters recorded in the recorder, decoding processing software of the recorder makes simulation videos of actual flights of an aircraft, and actual flight parameters are embedded in the simulation videos, so that the flight parameters are visible in the video; in the step of generating over-limit alarms, the data processing module in the system extracts the flight parameters recorded in the recorder, the actual flight parameters are compared with standard parameters preset in the flight procedure, alarms are generated by the flight parameter alarm function of the decoding processing software of the recorder, and the alarms are embedded into the simulation videos, so that the alarms are visible in the simulation visual videos; in the data processing step, the data processing module generates, by the decoding processing software of the recorder, video source data packets used for making composite flight simulation videos and image source data packets used for processing and generating 3D images by software Google Earth or other software; in the step of generating composite simulation visual videos, the data processing module in the system extracts the video source data packets, and composite simulation visual videos with view angles adjustable are generated by simulation flight software; in the step of generating flight trajectory and flight procedure protection area pictures, the data processing module in the system extracts the image source data packets, 3D image files with actual flight trajectories are generated by software Google Earth or other software, and protection areas set in a flight procedure are marked in the 3D images to generate pictures containing the actual flight trajectories and the flight procedure protection areas; in the synchronization step, the synchronization module synchronizes the actual visual videos, the simulation visual videos and the composite simulation visual videos temporally, and selects the flight trajectory and the flight procedure protection area pictures output by the software Google Earth or other software in the time period corresponding to that of the actual visual videos, the simulation visual videos and the composite simulation visual videos; in the playing step, the actual visual videos, the simulation visual videos, the composite simulation visual videos and the simulation visual pictures temporally synchronized by a multi-path video player software are simultaneously played.

6. The method of claim 5, characterized in that the video source data packets generated by the data processing module in the step of processing data are data packets used for making a 3D dynamic video by Xplane software or other software.

7. The method of claim 5, characterized in that a time system used in the step of synchronizing the actual visual videos, the simulation visual videos, and the complex simulation visual videos is a GPS time system, and the synchronization module extracts GPS time and local time parameters in the actual visual videos, the simulation visual videos, and the complex simulation visual videos, and starting points of the actual visual videos, the simulation visual videos, and the complex simulation visual videos or the images are adjusted according to the parameters to realize the synchronization of the actual visual videos, the simulation visual videos, and the complex simulation visual videos or the images.

8. The system for inspecting and validating a flight procedure of claim 1, characterized in that the recorder is a Quick Access Recorder.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is a schematic view of the system of the invention;

(2) FIG. 2 is a flow diagram of the method of the invention; and

(3) FIG. 3 is an schematic diagram of the effect of the invention.

DETAILED DESCRIPTION OF THE INVENTION

Embodiment 1

(4) As shown in FIG. 1, the flight procedure inspecting and validating system used in the embodiment comprises an image capturing apparatus, a storage device, a playing device, and a QAR (quick access recorder) and is further provided with a data processing module for processing flight data extracted by the QAR and a synchronization module for synchronizing video files in time; the image capturing apparatus is arranged on the aircraft, and connected with an acquisition and storage device; the QAR is connected with the data processing module; the acquisition and storage device and the data processing module are respectively connected with the synchronization module, and the synchronization module is connected with the playing device. Due to limitations and regulations of industries, only the image capturing apparatus and QAR in the system are arranged on the aircraft, other devices and modules are not directly arranged on the aircraft and are connected with the aircraft by adopting mobile storage devices or wireless network.

(5) More specifically, the flight procedure inspecting and validating system of the embodiment, comprises the image capturing apparatus, the image acquisition and storage device, the playing device, a data processing server in which the data processing module and the synchronized playing module are stored, and the QAR, and further comprises a first display screen for displaying actual flight path images captured by the image capturing apparatus, a second display screen and a third display screen which are used for displaying simulation flight path images generated from flight data recorded by the aircraft recorder, and a fourth display screen for displaying two-dimensional pictures of the simulation flight path images. The image capturing apparatus is arranged on the aircraft and is connected with the image acquisition and storage device, the image acquisition and storage device and the QAR are respectively connected with the data processing server which is connected with the displaying device, and the displaying device is respectively connected with the first display screen, the second display screen, the third display screen and the fourth display screen.

(6) Further, the third display screen displays the composite flight simulation videos generated by processing through Xplane software, and the fourth display screen displays the simulation videos of 3D images generated by processing through software Google Earth.

(7) Further, the first display screen, the second display screen, the third display screen and the fourth display screen are arranged on the same wall.

(8) The video capturing apparatus used in the embodiment is a professional camera which may be installed in the front of a cockpit of an aircraft or installed at other appropriate positions for the purpose of collecting images, identical with a driver's sightline and capable of recording flight environment; the storage device is a mobile storage device, such as a hard disk drive; the QAR, namely a quick access recorder, is an on-board device, used for monitoring and recording huge amounts of flight parameters and data, having a generally 128 MB recording capacity, capable of recording continuously for up to 600 hours, and capable of collecting hundreds of data at the same time, including most of flight quality parameters of the aircraft, an air operator, by the aid of the QAR, may simulate and restore a flight process, find, in the flight process, conditions of the aircraft and problems in terms of crew operation, engine operating conditions, aircraft performance and the like in time, run analysis and searching on causes of abnormalities, master safety trends, and take corresponding measures, thereby eliminating potential accidents such as flaws in the flight procedure and ensuring flight safety; at present, most of civil aircrafts are fitted with this monitoring apparatus.

(9) the data processing module functions in generating videos mainly through a combination of three programs, namely, a QAR decoding program, a flight simulation program and a virtual globe program Google Earth. The QAR decoding program used in the embodiment is Aerobytes FDM (version 3.2) by Aerobytes, this program is capable of generating flight simulation videos with quantitative indicators, generating flight parameter over-limit warnings, generating data packets of 3D images processed and generated by the software Google Earth, generating data packets of composite flight simulation videos processed by software such as Xplane, and generating icon files with respect to flight data; the flight simulation program is a simulation flight procedure Xplane made by the game developer Austin Meyer and used for real and virtual flight training, and this program is capable of producing simulation scenes and multi-view simulation flight animations according to given data; the Google Earth virtual globe program is virtual globe software developed by Google, this software is capable of arranging satellite photos, aerial photos and GIS (geographic information system) on a three-dimensional model of earth, uses pictures of public areas, permitted aerial photographic pictures, pictures by the satellite KeyHole and town photos taken by many other satellites and even provide pictures that Google Maps are in the absence of, and this software has a data importing function, a flight route planning function and a global positioning function.

(10) The synchronization module functions in synchronizing four images through a synchronizing program, the actual visual videos collected by the video capturing apparatus have local time parameters with an accuracy of second, the simulation visual videos and composite simulation visual videos generated by the data processing module have GPS time parameters with an accuracy of second, and the synchronizing program extracts the time parameters which the three types of videos bear and acquires excerpts of the three types of videos according to selected starting and ending time; picture source data packets which the QAR decoding software outputs to the software Google Earth are data of GPS time parameters with an accuracy of second, and the software Google Earth may be used to acquire excerpts of pictures of aircraft flight paths according to the selected starting and ending time; the synchronizing program synchronizes the starting and ending times of the four types of images.

(11) The playing device plays the four types of images simultaneously on a display through multi-channel video playing software.

Embodiment 2

(12) In conjunction with FIGS. 2 and 3, a method for validating a flight procedure applied in the system for inspecting and validating a flight procedure of embodiment 1; the content disclosed in embodiment 1 should also be regarded as the content disclosed in this embodiment; the method comprises the step of collecting actual visual videos and flight parameters, the step of generating simulation visual videos, the step of generating over-limit alarms, the step of processing data, the step of generating complex simulation visual videos, the step of generating flight trajectory and flight procedure protection area pictures, the step of synchronizing the videos and the step of playing the videos; wherein:

(13) the step of collecting an actual visual video and flight parameters is a step of collecting the actual visual video 1 in FIG. 3, in this step, an actual flight is performed in an actual location according to the pre-designed flight procedure; during the flight, the image capturing apparatus in the system stores the captured actual visual video into the storage device, and simultaneously QAR records various flight parameters.

(14) The step of generating simulation visual videos is a step of generating the simulation visual video 2 in FIG. 3; in this step, the data processing module in the system extracts the flight parameters recorded in the data recorder such as QAR, a simulation video of flight of the aircraft are made by software such as QAR decoding processing software, and the actual flight parameters and the flight parameters in the flight procedure are embedded in the simulation video, such that the two kinds of flight parameters are visible in the videos at the same time; this step is a step of using QAR decoding processing software Aerobytes FDM to make a basic flight video, but the image quality of the video made is modest, and cannot fully reflect the environmental factors, but can clearly reflect the flight altitudes and poses and the like of the aircraft itself. Wherein the function of making the aircraft flight simulation video having flight parameters by the QAR decoding processing software Aerobytes FDM according to the data recorded by QAR belongs to the prior art.

(15) The step of generating over-limit alarms is a step of generating the over-limit alarm in the simulation visual video 2 in FIG. 3; in this step, the data processing module in the system extracts the flight parameters recorded in the QAR, an alarm is generated with the flight parameter alarm function of the QAR decoding processing software, and the alarm is embedded in the simulation video, so that the alarm is visible in the video. Wherein the function of generating over-limit alarms by the QAR decoding processing software Aerobytes FDM according to the data recorded by QAR and the preset alarm tolerance belongs to the prior art.

(16) In the data processing step, the data processing module generates, via QAR decoding processing software, video source data packets used for making composite flight simulation videos and image source data packets used for processing and generating 3D images by software Google Earth; this step is a process of using QAR decoding processing software Aerobytes FDM to process data, the processed data packages are data sources required for generating videos in the next step. Wherein the function of generating data source packets matched with the software such as Xplane, Google Earth and the like by the QAR decoding processing software Aerobytes FDM belongs to the prior art.

(17) The step of generating the simulation visual videos is a step of generating the simulation visual video 3 in FIG. 3; in this step, the data processing module in the system extracts the video source data packets and generates view-adjustable composite simulation videos by a simulation flight software; this step is a process of using Xplane software to produce high-quality, multi-view flight animations, this video can reflect comprehensive situations of the flight more clearly, details about the aircraft itself, state of the surrounding buildings and topographical conditions and the like are included in the image.

(18) The step of generating flight trajectory and flight procedure protection area pictures is a step of generating the flight trajectory and flight procedure protection area picture 4 of FIG. 3; in this step, the data processing module in the system extracts an image source data packet, and generates a 3D map picture with the flight path of the aircraft through the data importing function of software Google Earth; the software Google Earth has the function of planning the flight route, and a protection area of the flight procedure can be drawn on the picture through the function of planning the flight route. In the picture, besides the map information, the protection area of the flight procedure and the flight path of the aircraft are also included, the output flight trajectory and the flight procedure protection area picture in fact are the description for the movement process of the aircraft in the flight procedure protection area in the map.

(19) In the synchronization step, an actual visual video 1, a simulation visual video 2 and a complex simulation visual video 3 are temporally synchronized by the synchronization module, and the flight trajectory and flight procedure protection area picture 4 output by the software Google Earth and with the time period corresponding to that of the abovementioned videos is selected.

(20) In the step of playing videos, the actual visual video 1, the simulation visual video 2, the complex simulation visual video 3, and the flight trajectory and flight procedure protection area picture 4 synchronous in the time are simultaneously played through multiple paths of video playing software.

(21) In the above steps, the video source data packets generated by the data processing module in the data processing step are data packets for making 3D dynamic videos through Xplane software.

(22) In the above steps, the time system in the synchronization step is a GPS time system, and the synchronization module extracts GPS time and local time parameters in the videos, and adjusts the starting points of the videos or the images according to the parameters so as to realize the synchronization of the videos or the images.

(23) The method can also be described in another manner the method includes a data processing step, a step of generating flight trajectory and flight procedure protection area pictures, a synchronization step and a playing step; in the parameter collecting step (equivalent to the step of collecting actual visual videos and flight parameters and the step of generating over-limit alarms), actual flight is carried out in an actual location according to the pre-designed flight procedure; during the flight, the image capturing device in the system stores the captured actual vision into the image collection and storage device, and meanwhile, a flight data access recorder records the various flight parameters, wherein the flight procedure comprises a pre-warning height value of the aircraft from a ground object;

(24) in the step of generating simulation visual videos, the various flight parameters recorded by the flight data access recorder are generated into three-dimensional simulation video for the flight of the aircraft;

(25) in the step of generating complex video images, the actual visual video in the image collection and storage device is extracted, the three-dimensional simulation video during the flight of the aircraft is extracted, and the capturing recording time and the flight data recording time are generated into images of the actual visual video and the simulation video of the flight of the aircraft synchronous in time by taking the navigation satellite time as the reference;

(26) in the step of generating flight trajectory pictures: the three-dimensional simulation video of the flight of the aircraft is extracted according to the synchronization starting point and the flight parameters, and the two-dimensional flight path picture with the flight path of the aircraft and the position of the aircraft is generated;

(27) in the play and verification step, the actual visual video, the three-dimensional simulation video and the two-dimensional flight path picture temporally synchronous are simultaneously played on three display pictures, and an alarm will be given if the flight height value exceeds the pre-warning height value.

(28) Wherein, the step of generating flight trajectory pictures and the play and verification step are equivalent to the data processing step, the step of generating flight trajectory and flight procedure protection area pictures, the synchronization step and the playing step;

(29) The step of generating three-dimensional simulation videos of flights of the aircraft includes: generating the flight simulation videos with quantized indicator, generating the video data packets which can be treated by software Google Earth and generating 3D image, generating the video data packets which can be treated by Xplane software and generating complex flight simulation.

(30) Wherein, the navigational satellite time is a GPS time system.

(31) Wherein, the various flight parameters comprise flying height, operating parameters, and weather parameters.

(32) Wherein, the actual flight path image is the actual environmental image observed by the pilot.