Apparatus and method to improve a situational awareness of a pilot or driver

Abstract

An apparatus to improve a situational awareness of a pilot or driver controlling a vehicle using a control appliance. The control appliance includes a display for depicting surroundings of the vehicle, and the vehicle includes a missile warner and a sensor for fine tracking (FTS) configured to provide high-resolution images for a tracking of an approaching missile detected by the missile warner. The apparatus also includes a control unit, configured to couple a directable line-of-sight of the FTS with the display, and to employ the high-resolution images of the FTS to improve the depiction of the surroundings of the vehicle on the display.

Claims

1. An apparatus to improve a situational awareness of a pilot or driver controlling a vehicle using a control appliance comprising a display for depicting surroundings of the vehicle, wherein the vehicle comprises a missile warner and a sensor for fine tracking (FTS), wherein the FTS is configured to provide high-resolution images for a tracking of an approaching missile detected by the missile warner, the apparatus comprising: a control unit configured to couple a directable line-of-sight of the FTS with the display, and to employ the high-resolution images of the FTS to improve the depiction of the surroundings of the vehicle on the display and to direct the line-of-sight of the FTS between times when the FTS is employed in a counter-measure against an approaching missile.

2. The apparatus of claim 1, wherein the control unit is coupled to the control appliance such that the driver or pilot can indicate a desired line-of-sight of the FTS.

3. The apparatus of claim 1, wherein the control unit is configured to track a line-of-sight of the driver or pilot, and to align the line-of-sight of the FTS with the line-of-sight of the driver or pilot.

4. A system for imaging surroundings of a vehicle, comprising: a missile warner; a sensor for fine tracking (FTS) associated with the missile warner and configured to provide high-resolution images for tracking of approaching missiles detected by the missile warner; a control appliance comprising a display for depicting surroundings of the vehicle; and a control unit configured to couple a directable line-of-sight of the FTS with the display, and to employ the high-resolution images of the FTS to improve the depiction of the surroundings of the vehicle on the display and to direct the line-of-sight of the FTS between times when the FTS is employed in a counter-measure against an approaching missile.

5. The system of claim 4, wherein the missile warner comprises one or more infrared sensors configured to produce sensor data for depicting a surround view of the vehicle, and the system further comprising: a Directional Infrared Counter Measure (DIRCM) appliance, which includes the FTS, wherein the line-of-sight of the FTS is directable and the FTS includes a further infrared sensor, wherein the DIRCM appliance is configured to initiate, using the high-resolution images of the FTS, counter-measures to protect the vehicle against flying objects.

6. The system of claim 5, wherein the DIRCM appliance is configured to perform a more precise classification of the flying objects based on the high-resolution images provided by the FTS.

7. The system of claim 5, wherein the DIRCM appliance is configured, during a counter-measure against a flying object, to identify launch coordinates where the flying object was launched, and wherein the FTS, after being employed for the counter-measure operation by the DIRCM appliance, is configured to automatically direct its line-of-sight at the identified launch coordinates.

8. The system of claim 4, wherein the missile warner comprises one or more sensors operating in the infrared or visible spectrum, wherein the sensors are configured to produce sensor data for depicting a surround view of the vehicle, and the system further comprising: a directional visible counter-measures appliance, which includes the FTS, wherein the line-of-sight of the FTS is directable and the FTS includes a further sensor operating in the visible part of the spectrum, wherein the directional visible counter-measures appliance is configured to initiate, using the high-resolution images of the FTS, counter-measures to protect the vehicle against flying objects.

9. The system of claim 8, wherein the directional visible counter-measures appliance is configured to perform a more precise classification of the flying objects based on the high-resolution images provided by the FTS.

10. The system of claim 8, wherein the directed visible counter-measures appliance is configured, during a counter-measure against a flying object, to identify launch coordinates where the flying object was launched, and wherein the FTS, after being employed for the counter-measure operation by the directed visible counter-measures appliance, is configured to automatically direct its line-of-sight at the identified launch coordinates.

11. The system of claim 4, wherein the control unit is configured to direct the line-of-sight of the FTS between when a Directional Infrared Counter Measure (DIRCM) appliance operates the FTS or times when a directional visible counter-measure appliance operates the FTS.

12. The system of claim 4, wherein the display is: a helmet-mounted display, a multi-function display, or a head-up display.

13. A method for improving a situational awareness of a pilot or driver of a vehicle, the vehicle comprising a display for depicting surroundings of the vehicle, a missile warner, and a sensor for fine tracking (FTS), wherein the FTS is configured to provide high-resolution images for a tracking of approaching missiles detected by the missile warner, the method comprising: coupling a directable line-of-sight of the FTS with the display; and employing the high-resolution images of the FTS to improve the depiction of surroundings of the vehicle on the display by directing the line-of-sight of the FTS between times when the FTS is employed in a counter-measure against an approaching missile.

14. The method of claim 13, further comprising: identifying, during a counter-measure against a flying object, launch coordinates where the flying object was launched; and automatically directing the line-of-sight of the FTS, after being employed for the counter-measure, at the identified launch coordinates.

15. A non-transitory computer program product comprising software code for improving a situational awareness of a pilot or driver of a vehicle, the vehicle comprising a display for depicting surroundings of the vehicle, a missile warner, and a sensor for fine tracking (FTS), wherein the FTS is configured to provide high-resolution images for a tracking of approaching missiles detected by the missile warner, wherein execution of the software code by a data processing system, causes the data processing system to: couple a directable line-of-sight of the FTS with the display; and employ the high-resolution images of the FTS to improve the depiction of surroundings of the vehicle on the display by directing the line-of-sight of the FTS between times when the FTS is employed in a counter-measure against an approaching missile.

16. The non-transitory computer program product of claim 15, wherein execution of the software code by a data processing system, causes the data processing system to: identify, during a counter-measure against a flying object, launch coordinates where the flying object was launched; and automatically direct the line-of-sight of the FTS, after being employed for the counter-measure, at the identified launch coordinates.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) Various embodiments of the present invention will be described in the following by way of examples only, and with respect to the accompanying drawings, in which:

(2) FIG. 1 shows a system comprising a missile warner, DIRCM with FTS, control appliance, and an apparatus for employing the FTS data in the control appliance.

(3) FIG. 2 shows a method for improving a situational awareness of a driver or pilot.

DETAILED DESCRIPTION

(4) Various examples will now be described more fully with reference to the accompanying drawings in which some examples are illustrated.

(5) Accordingly, while examples are capable of various modifications and alternative forms, the illustrative examples in the figures will herein be described in detail. It should be understood, however, that there is no intent to limit examples to the particular forms disclosed, but on the contrary, examples are to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure. Like reference numbers refer to like or similar elements throughout the description of the figures.

(6) The terminology used herein is for the purpose of describing illustrative examples only and is not intended to be limiting. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes” and/or “including,” when used herein, specify the presence of stated features, steps, operations, elements and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components and/or groups thereof.

(7) Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which examples belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

(8) FIG. 1 shows an apparatus to improve a situational awareness of a pilot or driver controlling a vehicle by means of a control appliance 200, the control appliance 200 comprising a display 210 for depicting surroundings of the vehicle, and the vehicle comprising a missile warner 300 and a sensor for fine tracking (FTS) 410. The FTS 410 is configured to provide high-resolution images 211 for a tracking of approaching missiles detected by the missile warner 300. The apparatus comprises a control unit 100 configured to couple a directable line-of-sight of the FTS 410 with the display 210, and to employ the high-resolution images of the FTS 410 to improve the depiction of the surroundings of the vehicle on the display 210.

(9) In this embodiment, the missile warner 300 exemplarily comprises a wide-angle sensor 310, which operates in the infrared range and whose field of view is understood to cover a large solid angle of the sphere surrounding the vehicle, at a correspondingly low angular resolution. A typical missile warner 310 requires four to six such wide-angle sensors 310 in order to cover the full sphere around the vehicle. The missile warner 300 is furthermore depicted with a classifier 320, which holds the control devices configured to detect, locate and identify flying objects in the data collected by the wide-angle sensor 310, to a precision constrained by the low angular resolution of the wide-angle sensor 310. The classifier 320 is adapted to detect a flying object and to issue an alarm signal, upon which counter-measures are initiated, which may be performed automatically or under a control of the pilot or driver. The classifier 320 is furthermore configured to transmit data collected about the flying object to other systems, as e.g., to counter-measure devices, or to the driver or pilot.

(10) The data of the wide-angle sensor 310 is furthermore transmitted to a display 210 in the control appliance 200 of the vehicle, where it is processed and used as a source for panoramic night vision 212. Due to the low resolution of the wide-angle sensors, this image is not sufficient for reconnaissance purposes. Larger objects—e.g., landmarks like mountains, or structures like buildings—are distinguishable, and the low-resolution image 212 of the surroundings can be beneficial for an orientation of the pilot or driver regarding the position of the vehicle in the landscape, or for cases of heavy weather or environmental conditions like e.g., whiteouts or brownouts.

(11) One of the counter-measures coupled to the missile warner consists of a Directional Infrared Counter Measure (DIRCM) appliance 400, which comprises the FTS 410 together with an exemplary infrared laser device 420. Alternatively, or in addition to the DIRCM appliance 400, the counter-measures, and in particular the FTS 410, could also operate in the visible range of the electromagnetic spectrum. The following description will focus on infrared counter-measures, but this should not be construed to limit the counter-measures to infrared wavelengths.

(12) The DIRCM appliance 400 reacts to an alert of the missile warner 300, and directs an infrared laser beam e.g., at a homing head of a heat-seeking missile, with the aim of confusing the orientation of the missile such that it misses its target. To this effect, the laser beam is itself highly collimated—e.g., to less than a degree in angular divergence—and therefore needs to be directed at the flying object in a very precise way. In order to achieve this precise alignment, the DIRCM appliance 400 operates the FTS 410 as one of its parts. The FTS 410—which in this embodiment may e.g., collect data in the infrared part of the spectrum, as does the wide-angle sensor 310—covers only a very small solid angle, but achieves a high-resolution, and can therefore also distinguish objects more precisely and/or at a greater distance than the wide-angle sensor 310 of the missile warner 300. A DIRCM control unit 430 is depicted which couples the FTS 410 and the laser 420, and directs both of them at the flying object for example by using a gimbaled system.

(13) Conventionally, the FTS 410 is not employed by systems other than the DIRCM appliance. The DIRCM appliance 400 operates the laser 420 and the FTS 410 only in reaction to a prior warning signal of the missile warner 300. The FTS 410, however, is typically configured to constantly collect data. The apparatus, comprising the control unit 100 and connections to other components of the vehicle, is configured to exploit this data in order to improve the low-resolution image 212 which is provided, in this embodiment, by the wide-angle sensors 310 of the missile warner 300. In the present embodiment, this improvement consists of a high-resolution image 211 in a small area of the display corresponding to the direction of the FTS 410. A pointing device—as here e.g., a joystick 220—is part of the control appliance 200, and adapted to direct the FTS 410 as desired by the pilot or driver. As counter-measures (e.g., in the case of missiles) are highly time-sensitive operations, which can surpass the reaction capacity of the driver or pilot, the operation of the DIRCM appliance 400 triggered by the alarm of the missile warner 300 should have priority over the input of the driver on the direction of the FTS 410. For this reason, the control unit 100 and/or the DIRCM appliance 400 can be configured to prioritize DIRCM commands to the FTS 410 if the DIRCM is operational.

(14) FIG. 2 shows the steps of a method for improving a situational awareness of a pilot or driver of a vehicle according to the present invention. The vehicle comprises a display 210 for depicting a surround of the vehicle, a missile warner 300, and an FTS 410. The FTS 410 is configured to provide high-resolution images for tracking of missiles detected by the missile warner 300. The method comprises a step S10 of coupling a directable line-of-sight of the FTS 410 with the display 210, followed by a step S20 of employing the high-resolution images of the FTS 410 in order to improve the depiction of surroundings of the vehicle on the display 210.

(15) The description and drawings merely illustrate the principles of the disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure and are included within its scope.

(16) Furthermore, while each embodiment may stand on its own as a separate example, it is to be noted that in other embodiments the defined features can be combined differently, i.e. a particular feature descripted in one embodiment may also be realized in other embodiments. Such combinations are covered by the disclosure herein unless it is stated that a specific combination is not intended.

(17) Although the invention has been illustrated and described in detail by way of preferred embodiments, the invention is not limited by the examples disclosed, and other variations can be derived from these by the person skilled in the art without leaving the scope of the invention. It is therefore clear that there is a plurality of possible variations. It is also clear that embodiments stated by way of example are only really examples that are not to be seen as limiting the scope, application possibilities or configuration of the invention in any way. In fact, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete manner, wherein, with the knowledge of the disclosed inventive concept, the person skilled in the art is able to undertake various changes, for example, with regard to the wavelength ranges of the sensors, functioning or arrangement of individual elements stated in an exemplary embodiment without leaving the scope of the invention, which is defined by the claims and their legal equivalents, such as further explanations in the description.

LIST OF REFERENCE SIGNS

(18) 100 control unit 200 control appliance 210 display 211 high-resolution surroundings 212 low-resolution surroundings 220 control column 300 missile warner 310 wide-angle sensor 320 classifier 400 Directional Infrared or Visible Counter Measures appliance 410 Fine Tracking Sensor 420 Laser 430 DIRCM control