Haptic augmented reality device for facilitating actions on a flying boom

Abstract

Haptic augmented reality device for facilitating the actions to control a boom in full flight, allowing the boom to be controlled with a single hand, without the need for any training in what the manoeuvres refer to. In addition, the system not only provides information concerning how the operation is being performed, but also provides assistance, indicating to the boomer when a particular movement is completely prohibited (making the movement impossible) or is not recommendable (making it necessary to apply more force to perform the movement).

Claims

1. Boom control device for in-flight refuelling operations by a boom, with touch control and reception, based on haptic augmented reality technology comprising: a boom model or prototype (1); controller and actuator (2) including a transmission arm (3) for actuation of the boom model (1); the controller and actuator (2) comprising: a first double set of motors (4) to allow performance of a horizontal movement of the boom model (1); a second double set of motors (5) to allow a pitch movement and being rotatable with respect to an axis orthogonal to the axis of rotation of the first set of motors; a counterweight to balance the forces of both sets of motors; and first electronic controller (7) to actuate and control the motors (4) and (5); the boom model (2) having a form similar to the actual boom that is intended to be handled and comprising: second electronic controller (8) to control the elements that form part of the boom model; a vibrator (9) housed inside the boom model (8); a series of buttons (10), (11) and (12); an acceleration sensor (13); and a magnet (14); LEDs (15); and Whereby a single hand is used to control the boom.

2. Ergonomic and support unit of the control device of the boom for in-flight refuelling operations by a boom, with touch control and reception, based on haptic augmented reality technology, defined in claim 1, comprising: a casing (16) housing the controller and actuator (2) of the haptic device and wherefrom the boom model (1) emerges; an armrest (17) positioned underneath the casing (16) and joined to the casing (16) by vertical bars (18) definint a free space wherethrough to pass and rest an arm whilst the hand holds the boom model (1); and a base (18) disposed underneath the armrest (17) and equipped with a position calibrator (20) and an automatic connector (19).

3. Actuation and control system of an in-flight refuelling unit by a boom, integrating therein the control device of the boom, with touch control and reception, based on haptic augmented reality technology, defined in claim 1, comprising: An information subsystem comprising: Database with 3D models of all elements necessary in a refuelling operation; and Expert system including information on the operation; A Perception subsystem comprising: a redundant system for visually capturing information relating to the operation; a sensor system for capturing information from the environment of interest for the operation; An Analysis subsystem for creating a 3D model of the operation stage in real time; A smart refuelling system, wherein from the result of the analysis performed by the analysis subsystem, and using the information of the expert system in refuelling operations, the smart refuelling system determines and updates in real time: recommended sequence of movements to be executed to successfully perform the information; set of movements to prevent; set of movements to hinder; A subsystem comprising the control device of the boom, with touch control and reception, based on haptic augmented reality technology, defined in claim 1; A feedback subsystem for producing in the haptic remote control subsystem actions reflecting both the effect of the environment and the regulatory and recommended strategies for performing the operation.

4. The system according to claim 3, wherein the the redundant system combines several types of visual information including: Image capturing with structured lighting: a sequence of images captured with a set of cameras at a predetermined rate of frames per second; Image capturing with cameras with time of flight (ToF) sensors; and Information from cameras from the standard instrumentation of reloading aircraft to allow the connection of the cameras found as standard in the aircrafts, suitable for the initial phase of the reloading operation, when the aircraft to be refuelled is more than 15 metres away to provide additional redundancy to the system.

5. The system according to claim 4, comprising: Boom-haptic subsystem feedback including a set of sensors in the actual boom to capture the forces that the actual boom is subjected to and turns the forces into actions on the control motors of the haptic subsystem; and Smart refuelling system-haptic subsystem feedback for determining in real time the set of movements to favour and hinder and to what degree and translates the set into a series of actions on the control motors of the haptic subsystem.

Description

EXPLANATION OF THE FIGURES

(1) To complement the description being made and in order to aid towards a better understanding of the characteristics of the invention, in accordance with a preferred example of practical embodiment thereof, a set of drawings is attached as an integral part of said description wherein, with illustrative and non-limiting character, the following has been represented.

(2) In FIG. 1, we can observe a representation of the haptic augmented reality device object of the application.

(3) In FIG. 2, we can observe the control device wherein the haptic augmented reality device is integrated.

PREFERRED EMBODIMENT OF THE INVENTION

(4) A preferred embodiment of the invention proposed is described below in light of the figures.

(5) In FIG. 1, we can observe that the haptic device comprises: a boom model or prototype (1) control and actuation means (2), wherefrom a transmission arm (3) emerges for actuation of the boom model (1).

(6) Where the control and actuation means (2) comprises: a first double set of motors (4), which allow executing a horizontal movement of the boom model (1). A second double set of motors (5), which allow a pitch movement, and which rotate with respect to an axis orthogonal to the axis of rotation of the first set of motors. A counterweight to balance the forces of both sets of motors. First electronic means (7) for actuation and control of the motors (4) and (5).

(7) The boom model (2) has a form similar to the actual boom that is intended to be handled and which comprises: second electronic means (8), which controls the elements that form part of the boom model a vibrator (9) housed inside the boom model (8) a first button (10), a second button (11) and a third button (12), an acceleration sensor (13), and a magnet (14). LEDs (15).

(8) All of these allowing control over the boom with a single hand.

(9) FIG. 2 shows the control device (21) wherein the haptic device shown in FIG. 1 is integrated, and comprising: a casing (16), wherein is housed the actuation and control means (2) of the haptic device and wherefrom the boom model (1) emerges. An armrest (17) positioned underneath the casing (16) and joined to it by means of vertical bars (18), leaving a free space wherethrough to pass and rest an arm whilst the hand holds the boom model (1). A base (18) disposed underneath the armrest (17) and which is equipped with a position calibrator (20) and an automatic connector (19).

(10) Having sufficiently described the nature of the present invention, as well as the manner of putting it into practice, it is stated that within is essential nature, it can be put into practice in other forms of embodiment that differ in details from those indicated by way of example, and whereto protection claimed will equally cover, provided that its main principle is not altered, changed or modified.