Dynamic Symbology Overlay for Aerial Refueling Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video displays used in aerial refueling systems obscure the operator's view of the receiver aircraft, potentially leading to unsafe situations during the refueling process due to the overlay of essential information.

Innovation Solution

A system that overlays graphic display symbology onto the image of the aerial refueling operation, providing position, status, and warning information in a way that minimizes interference with the operator's view of the receiver aircraft, using stereoscopic cameras and a controller to dynamically position the symbology over the boom components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If visual overlays are displayed at fixed locations in the displayed images, then essential information is provided to the operator, but the operator's view of the receiver aircraft is obscured

Engineering Contradiction:
Improveinformation visibilityVSAvoidview obstruction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The visual overlays are dynamically repositioned based on the real-time location of the aerial refueling device in the displayed image. The controller monitors the device position and automatically adjusts the overlay location to appear on or near the device, ensuring information visibility while minimizing obstruction of the receiver aircraft view.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The overlay information is localized to specific regions of the displayed image corresponding to the aerial refueling device's position. Instead of using fixed global locations, the symbology is placed locally near the relevant equipment, providing context-specific information without blocking the overall scene.

Inventive Principle:
Principle #3Local quality

2Device complexity

If conventional video displays are used with fixed overlay locations, then the display system is simple, but dangerous situations may be obscured increasing the risk of damage

Engineering Contradiction:
Improvedisplay system complexityVSAvoidaerial refueling safety
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system implements a feedback loop where the controller continuously monitors the position of the aerial refueling device and uses this information to dynamically adjust the overlay display locations. This closed-loop approach ensures that critical information is always visible near the relevant equipment while maintaining situational awareness, thereby improving safety without excessive complexity.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If visual overlays are positioned to attract operator attention, then warning indicators are effective, but essential areas of the scene may be obscured

Engineering Contradiction:
Improvewarning effectivenessVSAvoidscene obstruction
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

Warning indicators and other visual overlays are dynamically positioned to appear on or near the aerial refueling device in the displayed image. This dynamic positioning ensures that warnings attract the operator's attention to the relevant area while the device itself serves as a natural reference point, reducing the need to place overlays in fixed locations that might obscure critical scene elements.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP2300321B1System and method for displaying aerial refueling symbology
Publication Date: 2015.05.20 THE BOEING CO
  • EP2300321B1 patent drawingFigure 1A~1B
  • EP2300321B1 patent drawingFigure 1C~1D
  • EP2300321B1 patent drawingFigure 2A

AI summary

In accordance with one or more embodiments, systems and methods for in-flight fuel delivery include an aerial refueling device (120) adapted to provide fuel to a receiver aircraft (110a), an optical component (140, 141) adapted to capture images of the aerial refueling device (120) and the receiver aircraft (110a), an operator input component (150) adapted to interface with an operator and capture control signals as input from the operator, and a display component (153) adapted to display images. A controller (130) is adapted to receive the captured images and the captured control signals, process the control signals by generating graphic display symbology (210), process the images by generating a combined image having the generated graphic display symbology (210) superimposed on the images, and display the combined image on the display component (153) for viewing by the operator. The controller (130) is adapted to superimpose the graphic display symbology (210) on a portion of the images obscured by the aerial refueling device (120).