Camera Calibration for Automated Air-to-Air Refueling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current air-to-air refueling systems face challenges in accurately calibrating the camera-to-boom relationship, leading to position errors during the automated refueling process, which affects the precision of fuel transfer between the tanker and receiver aircraft.

Innovation Solution

A camera calibration system using a processor and 3D model of the refueling boom, which receives boom position data and real-time image data to iteratively calculate an optimized boom-to-camera relationship, minimizing the difference between the real and projected images of the refueling boom, thereby improving calibration accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional camera calibration methods are used, then the calibration process is simple, but the position accuracy of the boom-to-camera relationship deteriorates

Engineering Contradiction:
Improveboom-to-camera position accuracyVSAvoidcalibration system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical calibration methods with a computational image processing approach. The system uses camera images of the boom, extracts boom position information from these images, and calculates the boom-to-camera relationship through image processing algorithms rather than mechanical measurement tools, thereby improving position accuracy while managing system complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces the boom itself as an intermediary reference object. By capturing images of the boom and extracting its position information from these images, the system uses the boom as a mediator to establish the spatial relationship between the camera and the boom, improving measurement precision without requiring complex external calibration equipment

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If manual calibration methods are used, then the system is easier to operate, but the refueling precision deteriorates

Engineering Contradiction:
Improvefuel transfer precisionVSAvoidcalibration operation ease
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system performs self-calibration by automatically capturing images of the boom, processing these images to extract position information, and calculating the optimal boom-to-camera relationship without requiring manual intervention. This automated process improves fuel transfer precision while reducing operational complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from captured images to continuously refine the boom-to-camera relationship. By processing real-time or near-real-time images and adjusting the calibration parameters based on the extracted boom position information, the system achieves high precision fuel transfer while maintaining ease of operation through automated closed-loop calibration

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12087017B2Camera calibration optimization using image segmentation and boom resolvers for automated air-to-air refueling
Publication Date: 2024.09.10 THE BOEING CO
  • US12087017B2 patent drawing
  • US12087017B2 patent drawing
  • US12087017B2 patent drawing

AI summary

A system for calibrating a camera for use aboard a fuel-supplying aircraft (“tanker”) for an automated air-to-air refueling (“A3R”) process in which the tanker offloads aviation fuel to a fuel-receiving aircraft (“receiver”) includes an electronic control unit having a processor and a non-transitory computer-readable storage medium on which is recorded instructions for calibrating the camera. Executing the instructions causes the processor to perform a corresponding method, i.e., to receive boom position data indicative a true position of the boom in free space, and real-time image data from the camera. The instructions also cause the processor to use the boom position data and a 3D model of the boom to project a digital representation of the boom into the image space. The processor then minimizes a difference between the projected and real images of the boom to thereby calibrate the camera.