System for locating the position of the end of the boom, the mouth of the refuelling vessel and the tanker
11414207 · 2022-08-16
Assignee
Inventors
Cpc classification
B64D39/06
PERFORMING OPERATIONS; TRANSPORTING
International classification
B64D39/06
PERFORMING OPERATIONS; TRANSPORTING
G05D1/10
PHYSICS
Abstract
A system for locating the end of a boom and that of a refueling vessel in a mid-flight refueling operation from a tanker that includes means for locating the position of the inlet mouth of the fuel that is inside the vessel of the receiving plane that comprise at least one vision subsystem arranged on the tanker. Also included are means for locating the position of the boom tip comprising light emitters, placed on the boom tip, along with the vision subsystem arranged on the tanker, and processing means constructed to use the images obtained from the locating means to allow their positions and inclinations to be exactly determined with respect to a common coordinate system.
Claims
1. A system of locating a boom (15) tip and a receiving vessel during a mid-flight refueling operation that conveys fuel from a tanker to a receiving plane, comprising: a tanker (40) equipped with the boom (15) that includes a boom tip; the receiving vessel with a vessel device (5) and fuel inlet mouth, the receiving vessel being attachable to a receiving plane, the vessel device being made from a material chosen from the group consisting of steel, titanium, Teflon® or Kevlar®, and the vessel device being constructed with a semi-hollow band that includes at least four transparent zones made from a material chosen from the group consisting of graphene or aluminum oxide, and each zone having a light-emitting element embedded therein; means for locating a position of the fuel inlet mouth that includes plural light emitters; at least one vision subsystem arranged on the tanker, and including at least two cameras (26); means for locating a position of the boom tip, including plural light emitters placed on the boom tip, and constructed to operate in cooperation with the vision subsystem; and processing means configured to determine, through images obtained from the means for locating the position of the fuel inlet mouth and the means for locating the position of the boom tip, to determine the positions of the fuel inlet mouth and the boom tip with respect to a common coordinate system.
2. The system according to claim 1, wherein a sensor that receives and detects light from another device is contained in one of the transparent zones.
3. The system according to claim 1, wherein the means for locating the position of the fuel inlet mouth includes a Time of Flight camera (42) located in the tanker (40), and constructed with lighting means and a sensor that measures the time it takes for an emitted light takes to return from the receiving vessel, the means for locating the position of the fuel inlet mouth further including a processing system constructed to determine the position of the fuel inlet mouth by recognizing the position of the receiving vessel or by making a comparison of measurements from the Time of Flight camera and a 3D model of the receiving vessel.
4. The system according to claim 1, wherein the means for locating the position of the fuel inlet mouth includes a laser emitter (43) placed on the tanker (40) and including a lens chosen from the group consisting of a diffractive optical elements lens and a diffraction lens that generates a known pattern of light, located on the surface of the receiving plane, and further comprising a processing system which is configured for determining the correspondence between points of a matrix and the same points in an image obtained by the cameras by means of telemetry to obtain distances from the receiving plane and, using the distances, for performing an image recognition or a comparison of the points in the image obtained by the cameras and a 3D model of the receiving plane to obtain information corresponding to the location of the fuel inlet mouth.
5. The system according to claim 1, wherein the means for locating (41) the position of the boom tip includes a boom device with a box that is attached to the boom (15) or to an extendable bar (13) of the boom, the box containing at least three light emitters, each emitting a narrow range of wavelengths, each including a diffuser (23), and each powered by respective drivers (37) that are connected to a power source through a control electronics unit and wherein the boom device is controlled remotely and constructed to generate light patterns from a frame frequency of the cameras.
6. The system according to claim 5, wherein the light emitter of the boom (15) device and vessel device (5) are capable of emitting light and the at least two cameras (26) of the vision subsystem are constructed to be sensitive to the wavelength emitted by the boom (15) device and vessel device (5), the at least two cameras (26) are located in a rigid support to fix a location for the at least two cameras, the at least two cameras each include an optical band pass filter, a focus lens located behind the filter and electronics for processing and extracting both the image and information relative to the coordinates (x, y) of each point of light emitted by each light emitter of the boom (15) device and vessel device (5).
7. The system according to claim 1 wherein the light emitters (2) are the terminal ends of an optical fiber that transports light from the emitters.
8. The system according to claim 1, wherein the vision subsystem has controllable and variable focusing cameras.
9. The system according to claim 1, wherein the vision subsystem includes controllable and variable Iris cameras.
10. The system according to claim 1, wherein at least the vision subsystem includes controllable and variable zoom cameras.
11. The system according to claim 1, wherein the means for locating the position of the boom tip is integrated into the boom (15).
12. The system according to claim 1, wherein the means for location the position of the fuel inlet mouth is integrated into the receiving vessel.
13. A system of locating a boom (15) tip and a receiving vessel during a mid-flight refueling operation that conveys fuel from a tanker to a receiving plane, comprising: a tanker (40) equipped with a boom (15) having a boom tip; a receiving vessel (9) attachable to a receiving plane and having a fuel inlet mouth (8) for receiving fuel located inside the receiving vessel; three locating devices (41), a first one being located on the receiving vessel, a second one being located under the tanker and a third one being located on the boom tip, wherein each locating device (41) is constructed with: at least three light emitters (38), each having a diffuser and a driver (37) for powering the driver; a microcontroller (36) for the at least three light emitters; at least two high-speed vision cameras (26), each having a frame rate greater than 30 fps) and each having a respective lens (25) and a narrow bandpass optical filter (24) tuned to light that is emitted by another locating device, and each of the cameras including high-speed, field-programmable gate arrays to determine in real time the coordinates of the points of light emitted by the other locating device; and a light sensor (35) having a lens and being capable of detecting light from another locating device (41) when the other locating device (41) is nearby; electronic equipment (33,36,39) including a communication bus, the electronic equipment being constructed to process and save coordinates provided by the at least two cameras to obtain the relative coordinates of each emitter with respect to one of the cameras.
14. A system of refueling a receiving plane from a tanker, where the receiving plane includes a receiving vessel, plural cameras that each include optical filters and an image processor, and light emitters, and the tanker (40) includes a boom (15) and boom tip with plural light emitters, comprising: visualizing the tanker from the receiving vessel using the cameras to detect patterns of light emitted by the light emitters that follow the frame frequency of the cameras; determining a position of the tanker (40) from the visualizing step; and positioning the receiving plane adjacent the tanker (40) by the visualizing and determining, thereby to allow the refueling.
15. The system of claim 14, wherein the boom includes a boom tip with associated high-speed video cameras that operate at a frame frequency and constructed to sense, record and encode ambient sound, and the visualizing and determining steps further comprise the steps of: making and recording a video with the high-speed video cameras that includes successive frames showing corresponding images; blinking the light emitters to produce light patterns with a predetermined cadence by following two modes of operation; the first mode operating at a frequency that corresponds to the frame frequency of the cameras and the second mode operating at a frequency of 48 KHz; determining a position of the fuel inlet mouth with respect to the tanker by: eliminating from the video all frame images that are not related to the light emitters; subtracting successive frames of the video by an image processor to obtain differences between corresponding images of successive frames; determining which light patterns are relevant by correlating differences between a pattern code associated with the blinking of the light emitters; and calculating coordinates of the light emitters using information detected by the cameras through simple mathematics that allow it to be included in electronics and recalculated in real time; simultaneously repeating the blinking for the light emitters on the boom tip to produce light patterns that correspond to the position of the receiving plane and to human voice information; determining the position of the light emitters on the boom tip using a tanker coordinate system; determining the position of the boom tip with respect to the tanker; and determining the relative positions of, and vectors orthogonal to the surfaces of, the boom tip and the fuel inlet mouth.
16. The system of claim 15, wherein the eliminating includes using optical filters.
Description
EXPLANATION OF THE FIGURES
(1) To supplement the description being given and with the aim of promoting a better understanding of the characteristics of the invention, in accordance with a preferred example of a practical embodiment of the same, a set of drawings are provided as an integral part of the description in which, for merely illustrative purposes, the following has been represented:
(2) In
(3) In
(4) In
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15) In
(16)
(17) In
(18) In
PREFERRED EMBODIMENT OF THE INVENTION
(19) In view of the Figures, a preferred embodiment of the proposed invention is described below.
(20)
(21)
(22)
(23)
(24) In
(25)
(26) In
(27)
(28)
(29)
(30)
(31)
(32)
(33)
(34)
(35)
(36)
(37) The coordinate information of both cameras is transferred to a Processing System (33) where finally the X, Y, Z coordinates of each light emitter is obtained with respect to a coordinate axis whose origin has been taken at the centre of the sensor of the left camera for greater ease, notwithstanding the use of any other.
(38)
(39) In
(40)
(41) Detailed Functioning of the System:
(42) In the case that the vessel (
(43) Even before reaching that placement in the refueling position, the lights placed on the device (
(44) Once the light from the emitters of the vessel device are received as coordinates in the Vision Subsystem cameras, the coordinates of these emitters will be calculated using simple mathematics which allows it to be included in the electronics and recalculated in the image time frame (
(45) Thereby, using the coordinates of the lights, the location of the vessel mouth (
(46) At the same time, the lights placed on the boom, near the nozzle (
(47) Initially, we had the position of the tanker from the receiver and now we have the relative position of the vessel mouth and of the boom outlet tip, with both referring to the same tanker reference axes. Through control laws that either govern or aid the movement of both the boom and the receiver plane itself, a semi-automatic or even automatic guidance can be implemented to improve the operation. When the connection is made, both sets of coordinates must match and it will be time to make the adjustments considered appropriate, as in other implementations of this invention, the calculation of the vessel mouth position may not be as obvious as that corresponding to the preferred implementation of this, since the light emitters could be distributed along the surface of the receiver. This could have other advantages. During this moment of actual contact, the information on the position of the lights is exactly that desired for the contact and the fact that it can be stored is very interesting; something that this invention accomplishes thanks to the communication established between the receiving plane's vessel device and the tanker's Vision Subsystem. The receiver uses the light from its emitters as a carrier to send encrypted digital information to the Vision Subsystem. At the same time, the Boom device can send information, not only to the Vision Subsystem, but also to the vessel device where the light sensor placed in it will close the communication loop between both aircraft. The receiving aircraft may store the situation information from the contact and other relevant auxiliary information that may be of interest to the tanker in relation to it.
(48) Once the position is stored, and during a future connection between tanker and the same receiver, the latter will be able to tell the tanker what position the vessel should be in for the exact connection to take place. In addition to that exchange of location information, this channel can be used for spoken communications, thus avoiding any radio signal that could be detected more easily than an optical signal.
(49) Another important functionality of the invention is the possibility of performing a duplex voice communication between receiver and tanker. That is, between the Vessel Device and the Boom Device. Both have two ways to turn on their respective light emitters. One to send the position and another to send and receive a signal of tens of kHz, enough to carry a voice signal. And this can occur in both directions, provided both devices are equipped with the respective light sensors.
(50) Therefore, the stages that take place for the correct functioning of the System include: Visualization from the Vessel Device cameras of the lights placed in the tank that flash, generating patterns following the frame frequency of these cameras. Determination of the position of the tank with respect to the Vessel Device cameras, in order to facilitate the approach of the receiving aircraft. Positioning of the receiving plane with respect to the tank to allow refueling. In this position the receiver can be seen by the tanker cameras. Blinking of the lights arranged on the Receiving Device with a certain cadence that has two modes of operation; the first being a blinking with a fixed frequency, which coincides with the frame frequency of the cameras with which it performs a pattern emission; and the second being a different frequency of about 48 KHz as the preferred value and which allows encoded voice information to be sent to the Boom Device. Determination of the position of the vessel mouth with respect to the tanker: Elimination in the cameras of the frame image of the light not related to the device by means of the optical filters that the cameras have. Subtraction of the images from the successive frames of the video by an image processor to obtain the differences between one image and the next one and thus be able to show with greater clarity the points that vary from one frame to the next. Correlation of the differences with the pattern code used for the blinking of the lights to determine the lights that are relevant. Calculation of the coordinates of these emitters through simple mathematics that allow it to be included in the electronics and recalculated in real time. While the previous operations take place, the lights placed on the boom close to the nozzle will be made to flash in a similar way and with a similar management to the previous one for the Vessel Device. In doing this, they will also be able to emit information not only on the position but also voice information. Determination of the position of the boom lights with respect to the same tanker coordinates system. Determine exactly the coordinates of the end of the nozzle with respect to the tanker. Determination of the relative positions between both significant points: Boom tip and vessel mouth as well as the vectors orthogonal to their surfaces.
Calibration: Determination of the Relative Position of Contact and Storage Thereof
(51) During the moment of contact between the boom nozzle and the vessel, the set of cameras (which will be placed preferably on the bottom of the tail cone of the tanker, although they could also be placed on the bottom of its main body, the Belly Fairing, or distributed along this and on more parts of the plane), the set of lights of the device that is the object of this invention will be able to be seen from the shortest possible distance (which is the moment of contact), mainly the vessel device placed on the surface of the plane receiver. Said device may have the form presented here as the preferred implementation but could also be distributed in several pieces arranged on the surface of the receiver. This device could even be replaced by a system that obtains the position of the vessel by alternative methods. The first task of this invention is to obtain the position of the point that is in the mouth of the vessel together with a vector perpendicular thereto. In such a way that, from the information gathered by the Vision Subsystem on the position of light emitters or alternative methods and elements, these six parameters must be obtained. Therefore, the moment of contact is a safe time in which we will truly know the relative position between the information obtained from the Vessel Device, in any of its implementations, and the vessel mouth and its orthogonal vector. At that moment the cameras will be able to determine with the maximum accuracy where the nozzle should be placed with respect to the set of lights or other elements, and from this determine with the same precision the location of the vessel with respect to them. This information is fundamental and will allow the calibration of the entire System. This is why, during this moment of contact, the information on the location in which the vessel is found is completely accurate and must pass from the tanker to the receiving aircraft which will store it in order to provide it to other tankers.
(52) Receiving Location Information
(53) At the time of contact, as already mentioned, the distance between the tip of the boom and the vessel of the receiving plane is particularly favourable.
(54) In the device object of this invention that is placed next to said vessel there is at least one light receiving sensor that will receive the information that will be sent from the nozzle of the boom in the form of light in a preferred implementation. In this way, the receiver can receive the information obtained in the tanker at the time of contact and store it, in order for it to be sent by its active element or elements during a future point of contact, when another tanker so requests. In addition, the same tanker can store this information for future points of contact, since it can be kept in a small database for all those recipients with whom contact has been made. Not only can the contact data be stored, but the vessel can also transmit other fuel data, etc. to the tanker, which will be stored in the database.
(55) Having sufficiently described the nature of the present invention, as well as the manner of putting it into practice, it is noted that it may be implemented in other embodiments that differ in detail from that indicated by way of example, and to which it will also reach the protection sought, provided that it does not alter, change or modify its fundamental principle.