3D Model Visualization for Refueling Boom Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to effectively aid maneuvering of obscured objects by not utilizing 3D models to enhance visibility and guidance, particularly in scenarios like refueling operations where direct line-of-sight is obstructed.
Innovation Solution
A system that uses a camera and processor on a refueling aircraft to generate a 3D model visualization of the receiver aircraft and refueling boom, determining their positions and separation distance, and displaying a side perspective view to guide the boom to the receptacle, while also indicating potential collisions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If synthetic or enhanced-vision systems are used to enhance scene visibility, then information content within imagery is improved, but the system does not exploit the unconstrained nature of model-based scene generation and remains limited to simple enhancement
Solution Approach 1:
The system creates a virtual copy of the physical scene using 3D models of objects (refueling boom, receiver aircraft, etc.) and renders it from any desired viewpoint. This virtual scene copy allows complete freedom of viewing angles without being constrained by actual camera positions, enabling the operator to see around obstacles and understand spatial relationships that are impossible to capture with physical cameras alone.
Solution Approach 2:
The system transitions from 2D camera imagery to 3D virtual scene reconstruction. By building three-dimensional models of all objects and their spatial relationships, the system enables viewing from any angle and position in 3D space, not just the fixed perspectives available from physical cameras. This dimensional enhancement provides comprehensive situational awareness.
2Ease of operation
If vision-guided robotics systems are used to assist manipulation of objects, then robotic servo-systems capability is improved, but the system does not exploit the advantage gained through knowledge of 3D models of objects in a scene
Solution Approach 1:
The system continuously updates the virtual scene based on actual sensor data and camera imagery, comparing the rendered virtual positions of objects with their actual detected positions. This feedback loop ensures the 3D model remains accurate and synchronized with the real scene, providing reliable guidance information for manual or automated manipulation tasks.
3Area of stationary object
If multiple physical cameras are used to capture all viewing angles, then complete scene coverage is improved, but device complexity and cost increase significantly
Solution Approach 1:
Instead of deploying multiple physical cameras to capture every viewpoint, the system creates a virtual copy of the scene using 3D models and software rendering. This single virtual scene can be viewed from any angle or position computationally, eliminating the need for complex multi-camera arrangements while achieving complete scene coverage.
Solution Approach 2:
The system replaces the mechanical solution of multiple physical cameras with a computational approach. By using 3D model-based rendering and image processing algorithms, the system generates virtual views from any perspective without requiring additional physical camera hardware, thereby reducing system complexity.
Data Source
Figure 1A
Figure 1B
Figure 2~3
AI summary
A system is provided. The system includes a camera on a refueling aircraft to obtain an image of a receiver aircraft having a receptacle for refueling the receiver aircraft. The system also includes a processor on the refueling aircraft to determine an orientation and position of the receiver aircraft relative to the camera, a separation distance and respective positions of a refueling boom of the refueling aircraft and the receptacle. The processor also generates a display of a side perspective view of 3D models of the refueling boom and the receiver aircraft having the receptacle. The display of the side perspective view illustrates a current position of the refueling boom relative to a current position of the receptacle and enables an operator on the refueling aircraft to observe and guide the refueling boom to the receptacle.