Aircraft cockpit view enhancing system and method

Abstract

An aircraft cockpit view enhancement system and method. The aircraft cockpit view enhancement system has: front-position, left-position and right-position camera devices. The front-position camera device is arranged between a driver's eye position point and an aircraft windshield pillar, with a photographing angle directly facing the aircraft windshield pillar, and the left-position and right-position camera devices are respectively arranged at a left side and a right side of the aircraft windshield pillar, with photographing angles respectively pointing to the right side and the left side deviated from the aircraft windshield pillar. An image processing device for performing image synthesis and image registration on a front-position image, a left-position image and a right-position image photographed by the front-position camera device, the left-position camera device and the right-position camera device, to obtain an image of a region shielded by the aircraft windshield pillar.

Claims

1. An aircraft cockpit view enhancement system, comprising: a front-position camera device, a left-position camera device and a right-position camera device, wherein the front-position camera device is arranged inside the cockpit between a driver's eye position point and an aircraft windshield pillar, with a photographing angle of the front-position camera device directly facing the aircraft windshield pillar, and the left-position camera device and the right-position camera devices are respectively arranged inside the cockpit at a left side and a right side of the aircraft windshield pillar, with photographing angles of the left-position camera device and the right-position camera device respectively pointing to the right side and the left side deviated from the aircraft windshield pillar; an image processing device, the image processing device being connected to the front-position camera device, the left-position camera device and the right-position camera device to perform image synthesis and image registration on a front-position image, a left-position image and a right-position image photographed by the front-position camera device, the left-position camera device and the right-position camera device, so as to obtain an image of a region shielded by the aircraft windshield pillar; and a display device, the display device being connected to the image processing device to display the obtained image of the region shielded by the aircraft windshield pillar; wherein the image processing device comprises an image synthesis module, an edge detection module and an image registration module, wherein the image synthesis module is used for performing image synthesis on the left-position image and the right-position image so as to obtain a synthesized image with a greater angle of view, the edge detection module is used for performing edge detection on the front-position image so as to obtain a boundary of the region shielded by the aircraft windshield pillar, and the image registration module is used for performing image registration on the obtained synthesized image and front-position image, and extracting an image of the region shielded by the aircraft windshield pillar according to the obtained boundary; wherein the image processing device further comprises an image cutting module, the image cutting module being used for adjustably cutting the image of the region shielded by the aircraft windshield pillar according to an actual visual effect; wherein the image processing device further comprises an image transformation module, the image transformation module being used for performing image transformation processing on the image of the region shielded by the aircraft windshield pillar according to the shape of the aircraft windshield pillar, such that the image of the region shielded by the aircraft windshield pillar which has been subjected to the image transformation processing is suited to the shape of the aircraft windshield pillar.

2. The aircraft cockpit view enhancement system of claim 1, wherein the display device is a flexible thin film display device, and the flexible thin film display device is attached to an inner side of the aircraft windshield pillar.

3. An aircraft cockpit view enhancement method, comprising: photographing, by a front-position camera device, a left-position camera device and a right-position camera device respectively, a front-position image, a left-position image and a right-position image, wherein the front-position camera device is arranged inside the cockpit between a driver's eye position point and an aircraft windshield pillar, with a photographing angle of the front-position camera device directly facing the aircraft windshield pillar, and the left-position camera device and the right-position camera device are respectively arranged inside the cockpit at a left side and a right side of the aircraft windshield pillar, with photographing angles of the left-position camera device and the right-position camera device respectively pointing to the right side and the left side deviated from the aircraft windshield pillar; performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar; and displaying, by a display device, the obtained image of the region shielded by the aircraft windshield pillar; wherein performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar comprises: performing image synthesis on the left-position image and the right-position image to obtain a synthesized image with a greater angle of view; performing edge detection on the front-position image to obtain a boundary of the region shielded by the aircraft windshield pillar; and performing image registration on the obtained synthesized image and front-position image, and extracting the image of the region shielded by the aircraft windshield pillar according to the obtained boundary; wherein performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar further comprises: adjustably cutting the image of the region shielded by the aircraft windshield pillar according to an actual visual effect; wherein performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar further comprises: performing image transformation processing on the image of the region shielded by the aircraft windshield pillar according to the shape of the aircraft windshield pillar, such that the image of the region shielded by the aircraft windshield pillar which has been subjected to the image transformation processing is suited to the shape of the aircraft windshield pillar.

4. The aircraft cockpit view enhancement method of claim 3, wherein the display device is a flexible thin film display device, and the flexible thin film display device is attached to an inner side of the aircraft windshield pillar.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is a schematic diagram of the composition of an aircraft cockpit view enhancement system of an embodiment of the present invention.

(2) FIG. 2 is a principle diagram of an aircraft cockpit view enhancement system of an embodiment of the present invention.

(3) FIG. 3 is an image processing flow chart of an aircraft cockpit view enhancement system of an embodiment of the present invention.

(4) FIG. 4 is a schematic diagram of an aircraft cockpit of an embodiment of the present invention.

DETAILED DESCRIPTION

(5) The present invention is further described below in conjunction with specific embodiments and drawings. In the following description, more details are explained for the ease of fully understanding the present invention. However, it is obvious for the present invention to be implemented by a plurality of other manner different from this description, and those skilled in the art may make similar generalization and deduction according to practical application conditions without departing from the intention of the present invention. Therefore, the scope of protection of the present invention should not be limited by the contents of the specific embodiments.

(6) FIG. 1 is a schematic diagram of the composition of an aircraft cockpit view enhancement system of an embodiment of the present invention. As shown in FIG. 1, according to an embodiment of the present invention, an aircraft cockpit view enhancement system comprises:

(7) a front-position camera device, a left-position camera device and a right-position camera device, wherein the front-position camera device is arranged between a driver's eye position point and an aircraft windshield pillar, with a photographing angle of the front-position camera device directly facing the aircraft windshield pillar, and the left-position camera device and the right-position camera device are respectively arranged at a left side and a right side of the aircraft windshield pillar, with photographing angles of the left-position camera device and the right-position camera device respectively pointing to the right side and the left side deviated from the aircraft windshield pillar;

(8) an image processing device, the image processing device being connected to the front-position camera device, the left-position camera device and the right-position camera device to perform image synthesis and image registration on a front-position image, a left-position image and a right-position image photographed by the front-position camera device, the left-position camera device and the right-position camera device, so as to obtain an image of a region shielded by the aircraft windshield pillar; and

(9) a display device, the display device being connected to the image processing device to display the obtained image of the region shielded by the aircraft windshield pillar.

(10) Preferably, the image processing device comprises an image synthesis module, an edge detection module and an image registration module, wherein the image synthesis module is used for performing image synthesis on the left-position image and the right-position image, so as to obtain a synthesized image with a greater angle of view. An algorithm used for implementing the function of the module may be a least square method based on grey scale values or other algorithms having the same function. The edge detection module is used for performing edge detection on the front-position image so as to obtain a boundary of the region shielded by the aircraft windshield pillar. An algorithm used for implementing the function of the module may be a canny multi-stage edge detection algorithm or other algorithms having the same function. The image registration module is used for performing image registration on the synthesized image and the front-position image, and extracting the image of the region shielded by the aircraft windshield pillar according to the obtained boundary. An algorithm used for implementing the function of the module may be a sequential similarity detection algorithm (SSDA algorithm) based on grey scale values or other algorithms having the same function.

(11) Preferably, the image processing device further comprises an image cutting module, the image cutting module being used for adjustably cutting the image of the region shielded by the aircraft windshield pillar according to an actual visual effect. An algorithm used for implementing the function of the module may be a Cyrus-Beck polygon window linear cutting algorithm or other algorithms having the same function.

(12) Preferably, the image processing device further comprises an image transformation module, the image transformation module being used for performing image transformation processing on the image of the region shielded by the aircraft windshield pillar according to the shape of the aircraft windshield pillar, such that the image of the region shielded by the aircraft windshield pillar which has been subjected to the image transformation processing is suited to the shape of the aircraft windshield pillar. An algorithm used for implementing the function of the module may be a linear least moving square based image transformation algorithm or other algorithms having the same function.

(13) Preferably, the display device is a flexible thin film display device, and the flexible thin film display device is attached to an inner side of the aircraft windshield pillar.

(14) FIG. 2 is a principle diagram of an aircraft cockpit view enhancement system of an embodiment of the present invention. FIG. 3 is an image processing flow chart of an aircraft cockpit view enhancement system of an embodiment of the present invention. FIG. 4 is a schematic diagram of an aircraft cockpit of an embodiment of the present invention.

(15) The image processing principle of the aircraft cockpit view enhancement system is described below in conjunction with FIGS. 2-4:

(16) (1) image synthesis is performed on a left-position image photographed by a left-position camera device LC and a right-position image photographed by a right-position camera device RC to obtain a synthesized image with a greater angle of view;

(17) (2) it can be seen from FIG. 2 that, comparing a front-position image photographed by a front-position camera device CC with an image seen from an eye position point E, a shielded region in the front-position image is larger, and thus edge detection is performed on the front-position image to obtain a boundary of the region shielded by a windshield pillar;

(18) (3) image registration are performed on the obtained synthesized image and front-position image, and an image of the region shielded by the windshield pillar is extracted according to the obtained boundary;

(19) (4) preferably, the image of the region shielded by the windshield pillar extracted in the last step is further cut, and the size of the cut boundary may be adjusted by a pilot via an adjustment rotary knob according to an actual visual effect; and

(20) (5) preferably, image transformation processing is performed on the image of the region shielded by the windshield pillar according to the shape of the windshield pillar to obtain an image of the region shielded by of the windshield pillar which conforms to a real visual effect so as to be finally displayed on the display device.

(21) As shown in FIG. 3, according to an embodiment of the present invention, an aircraft cockpit view enhancement method comprises:

(22) photographing, by a front-position camera device, a left-position camera device and a right-position camera device respectively, a front-position image, a left-position image and a right-position image, wherein the front-position camera device is arranged between a driver's eye position point and an aircraft windshield pillar, with a photographing angle of the front-position camera device directly facing the aircraft windshield pillar, and the left-position camera device and the right-position camera device are respectively arranged at a left side and a right side of the aircraft windshield pillar, with photographing angles of the left-position camera device and the right-position camera device respectively pointing to the right side and the left side deviated from the aircraft windshield pillar;

(23) performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar; and

(24) displaying, by a display device, the obtained image of the region shielded by the aircraft windshield pillar.

(25) Preferably, performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar comprises: performing image synthesis on the left-position image and the right-position image to obtain a synthesized image with a greater angle of view; performing edge detection on the front-position image to obtain a boundary of a region shielded by the aircraft windshield pillar; and performing image registration on the obtained synthesized image and front-position image, and extracting the image of the region shielded by the aircraft windshield pillar according to the obtained boundary.

(26) Preferably, performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar further comprises: adjustably cutting the image of the region shielded by the aircraft windshield pillar according to an actual visual effect.

(27) Preferably, performing, by an image processing device, image synthesis and image registration on the front-position image, the left-position image and the right-position image to obtain an image of a region shielded by the aircraft windshield pillar further comprises: performing image transformation processing on the image of the region shielded by the aircraft windshield pillar according to the shape of the aircraft windshield pillar, such that the image of the region shielded by the aircraft windshield pillar which has been subjected to the image transformation processing is suited to the shape of the aircraft windshield pillar.

(28) As shown in FIG. 4, when the system is practically installed in the cockpit, preferably, the left-position camera device LC and the right-position camera device RC are respectively disposed at two sides of the windshield pillar, and the photographing angles thereof respectively point to one side deviated from the windshield pillar; the front-position camera device CC is installed between an eye position point E and the axis of the windshield pillar, and the photographing angle directly faces the windshield pillar; the three camera devices are respectively fixed on a cockpit wall plate via brackets; a flexible thin film display device is attached to a flat surface of the windshield pillar; an image processing device is installed inside a cockpit panel, and the left-position camera device LC, the right-position camera device RC and the front-position camera device CC and the flexible thin film display device are connected to the image processing device via cables; and appropriate positions are chosen to dispose a power supply switch and an adjustment rotary knob to respectively implement a system switch function and a display range adjustment function (i.e. an adjustable image cutting function).

(29) The specific implementations of the present invention are described above. However, it would be understood by those skilled in the art that the above specific implementations do not constitute the limitations on the present invention, and those skilled in the art may make multiple modifications on the basis of the above disclosure without going beyond the scope of the present invention.