Methods and systems for directing remote aerial refueling operations

Patent metadata

Field	Value
Publication number	US-9150310-B1
Application number	US-87964610-A
Country	US
Kind code	B1
Filing date	Sep 10, 2010
Priority date	Sep 10, 2010
Publication date	Oct 6, 2015
Grant date	Oct 6, 2015

Abstract

A method for aerial refueling situational awareness is described. The method includes providing, to a display, a video image of the refueling environment, and providing at least one video overlay onto the video image, the at least one video overlay indicative of a positional relationship between an aircraft to be refueled and a tanker aircraft, the at least one video overlay including at least one guidance cue to assist in the alignment and coupling of the aerial refueling boom with the receiving aircraft receptacle.

First claim

What is claimed is:

1. A method for aerial refueling situational awareness,
said method comprising:
providing, to a display, a video image of an aircraft in a refueling environment;
automatically identifying, by a processor, a type of aircraft when an aircraft to be refueled enters the refueling environment;
providing at least one video overlay over the video image of the aircraft based on the identification of the type of aircraft, the at least one video overlay indicative of a positional relationship between the aircraft to be refueled and a tanker aircraft, the at least one video overlay including at least one guidance cue configured to assist in aligning an aerial refueling boom coupled to the tanker aircraft with respect to a receptacle coupled to the aircraft to be refueled such that the aerial refueling boom is coupleable to the receptacle, wherein the at least one guidance cue comprises a first receptacle video overlay indicating a position of the refueling receptacle on the at least one video overlay based on the identification of the aircraft, and wherein the at least one guidance cue comprises a second receptacle video overlay indicating a position of the refueling receptacle on the video image of the aircraft; and
determining, by the processor, at least one of a number of fuel pumps and a fuel flow rate to be used by the aerial refueling boom based at least in part on the type of aircraft to be refueled.

2. The method according to claim 1 wherein providing a video overlay comprises:
detecting a position of the aircraft to be refueled; and
providing a detection video overlay on the display indicating a relative position of the aircraft to be refueled with respect to the refueling environment.

3. The method according to claim 2 wherein providing a video overlay further comprises:
removing the detection video overlay upon identifying the type of aircraft to be refueled; and
providing an identification video overlay on the display indicating the type of aircraft and a relative position of the aircraft with respect to the refueling environment.

4. The method according to claim 1 wherein providing a video overlay comprises:
detecting that the position of the aircraft to be refueled is within a defined refueling area;
providing a reticule overlay on the display indicating an impact point of the refueling boom; and
adjusting a position of the reticule overlay based on boom operator maneuvering of the boom.

5. The method according to claim 4 further comprising changing a color of at least one of the first and second receptacle overlay and the reticule overlay when the boom operator maneuvers an intersection of the reticule overlay to be within the first and second receptacle overlays, indicating the boom is aligned with the refueling receptacle.

6. The method according to claim 1 further comprising:
monitoring at least one of a closure rate and a distance between the aircraft to be refueled and the tanker aircraft; and
changing at least one feature of the at least one video overlay indicative of the positional relationship when at least one of the closure rate exceeds a predefined rate and the distance between the aircraft to be refueled and the boom of the tanker aircraft becomes less than a predefined distance.

7. The method according to claim 1 further comprising providing at least one indicator for viewing on the display by the refueling boom operator, the indicator illustrating an amount of mechanical stress in a physical engagement between the boom and the aircraft to be refueled as providing by at least one strain sensor attached to the boom.

8. The method according to claim 7 wherein providing at least one indicator comprises providing indicators indicating the amount of mechanical stress in both azimuth and elevation.

9. An aerial refueling situational awareness system comprising:
a camera operable to provide a video image of an aircraft in a refueling area, the refueling area including a distal end of a refueling boom therein;
a vision processing system communicatively coupled to said camera; and
an operator display communicatively coupled to said vision processing system, said operator display configured to present images of the refueling environment to a boom operator, said vision processing system programmed to:
automatically identify a type of aircraft when an aircraft to be refueled enters the refueling environment;
generate at least one video overlay over the video image of the aircraft provided by the camera such that the at least one video overlay at least substantially surrounds the video image of the aircraft, wherein the at least one video overlay is based on the identification of the type of aircraft, the at least one video overlay configured to provide situational awareness to the boom operator viewing the refueling area on said operator display and indicate a relationship between the aircraft to be refueled and a tanker aircraft, the at least one video overlay including at least one guidance cue configured to assist in aligning an aerial refueling boom coupled to the tanker aircraft with respect to a receptacle coupled to the aircraft to be refueled such that the aerial refueling boom is coupleable to the receptacle, wherein the at least one video overlay is based on a position of the refueling boom as sensed by the camera and relayed to the vision processing system; and
determine at least one of a number of fuel pumps and a fuel flow rate to be used by the aerial refueling boom based at least in part on the type of aircraft to be refueled.

10. The aerial refueling system of claim 9 , said vision processing system programmed to:
recognize that an aircraft is approaching the refueling area based on image data received from said camera; and
cause a detection overlay to be displayed on said operator display indicating that an aircraft is approaching the refueling area, wherein the detection overlay is displayed prior to the aircraft entering the refueling area.

11. The aerial refueling system of claim 9 further comprising a library of aircraft image data, said vision processing system programmed to:
identify an aircraft approaching the refueling area based on a comparison of the image data of the aircraft received from said camera and stored aircraft image data within said library; and
cause an identification overlay to be displayed on said operator display indicating identification of the approaching aircraft, wherein the identification overlay is displayed subsequent to the aircraft entering the refueling area.

12. The aerial refueling system of claim 11 wherein the video overlay comprises an outline of the approaching, identified aircraft, said vision processing system is programmed to adjust a size and a detail associated with said overlay as the aircraft gets closer to the refueling area.

13. The aerial refueling system of claim 11 wherein, said vision processing system is programmed to cause a first receptacle overlay to be displayed by said operator display, said first receptacle overlay indicative of a position of the refueling receptacle on the video overlay based on the identification of the approaching aircraft.

14. The aerial refueling system of claim 11 , said vision processing system programmed to:
recognize that an aircraft is within the refueling area based on image data received from said camera;
cause a second receptacle overlay to be displayed on said operator display highlighting a position of the refueling receptacle on the video image of the aircraft to be refueled; and
cause a reticule overlay to be displayed on said operator display indicating an imp

Assignees

• Bray James F
• Cobleigh Kenneth A
• Boeing Co

Inventors

• Bray James F
• Cobleigh Kenneth A

Classifications

• B64D39/00 Primary

  Refuelling during flight · CPC title