Single-Camera Refueling Boom Pose Detection Using 3D Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing aerial refueling systems rely heavily on human operators or expensive stereoscopic vision setups, which are costly and inefficient, and lack effective automated solutions for accurately determining the pose of the refueling boom in real-time.
Innovation Solution
A computer vision system using a single camera and machine learning algorithms to generate a segmentation mask of the refueling boom, compare it to a 3D model, and adjust based on constraints to determine its pose, incorporating temporal filtering and proximity sensors for improved accuracy and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera with computer vision techniques is used, then device complexity and cost are reduced, but measurement precision of the refueling boom pose is insufficient compared to stereoscopic vision
Solution Approach 1:
The patent segments the refueling boom into multiple rigid body components (e.g., booms, stabilizers, counterweights) with defined joint relationships. This segmentation allows the system to model complex movements by composing transformations of individual segments, enabling accurate pose estimation from single-camera 2D images while reducing the need for complex stereoscopic vision systems.
Solution Approach 2:
The patent transforms the 3D pose estimation problem into a 2D image analysis problem by projecting the segmented boom model onto the camera's image plane. By working in 2D image coordinates and using constraints from the known 3D segment relationships, the system achieves accurate pose measurement with a single camera, effectively using dimensionality change to resolve the precision-complexity contradiction.
2Productivity
If automated pose detection algorithms are implemented, then productivity and operational efficiency are improved, but computational load increases
Solution Approach 1:
The patent performs preliminary segmentation of the refueling boom into rigid body components with pre-defined joint constraints and spatial relationships before the actual pose detection process. This preliminary structuring allows the optimization algorithm to work with constrained parameters rather than free variables, significantly reducing computational load during real-time operation while maintaining high productivity.
Solution Approach 2:
The patent implements an iterative optimization process where the pose estimation algorithm continuously refines its solution by comparing predicted 2D projections with actual camera observations and adjusting parameters based on feedback from constraint satisfaction. This feedback mechanism enables accurate real-time pose detection with reduced computational requirements compared to exhaustive search methods.
Data Source
AI summary
Aspects of the disclosure provide solutions for determining a position of an object in a video frame. Examples include: receiving a segmentation mask of an identified object in a video frame; adjusting a 3D representation of a moveable part of the object based on constraints for the moveable part; comparing the 3D model of the object to the segmentation mask of the object; determining a match between the 3D model of the object to the segmentation mask of the object is above a threshold; and based on the match being above the threshold, determining a position of the object.


