Camera Runway Sidestripe Detection for Aircraft State Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for estimating an aircraft's state during critical flight stages struggle with reliability and accuracy, particularly in autonomous aviation, due to limitations in fusion of inertial and GNSS data.
Innovation Solution
An Identification Engine that utilizes camera data and a 3D map to identify aircraft runway side stripes, employing a CenterNet deep neural network and image analysis algorithms for precise aircraft positioning and orientation determination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional fusion of inertial and GNSS data is used for state estimation, then the system structure is simple, but the reliability and accuracy of aircraft state estimation deteriorates
Solution Approach 1:
The patent merges multiple data sources including camera images, 3D map data, and runway feature data into a unified identification system. The system combines image processing algorithms with geometric modeling to create a comprehensive state estimation approach that overcomes the limitations of conventional inertial and GNSS data fusion alone.
Solution Approach 2:
The patent introduces 3D map data as an intermediary element that bridges the gap between raw camera images and aircraft state estimation. The 3D map serves as a reference framework that enables the system to accurately determine aircraft position and orientation by comparing detected runway features with pre-stored three-dimensional runway information.
2Measurement precision
If camera data and 3D map processing are used to improve state estimation accuracy, then the measurement precision improves, but the computational complexity and processing time increases
Solution Approach 1:
The patent segments the complex image processing task into distinct modules: runway feature detection, 3D map matching, and state calculation. By dividing the processing pipeline into separate functional components, the system achieves high measurement precision while managing computational complexity through modular architecture.
Solution Approach 2:
The patent performs preliminary processing by pre-storing three-dimensional runway map data before flight operations. This advance preparation allows the system to quickly match detected runway features with known 3D information during critical flight stages, reducing real-time computational burden while maintaining high measurement precision.
3Reliability
If multiple image analysis algorithms are employed for side stripe identification, then the reliability of runway feature detection improves, but the processing time and computational load increases
Solution Approach 1:
The patent implements continuous image processing during flight, where runway side stripe detection and aircraft state estimation occur continuously rather than in discrete batches. This continuous processing approach maintains high reliability through consistent feature tracking while optimizing processing time by eliminating idle periods between measurements.
Solution Approach 2:
The patent incorporates feedback mechanisms where previously detected runway features and estimated aircraft states inform subsequent detection and processing steps. This feedback loop improves reliability by maintaining consistent tracking of runway features across multiple frames while reducing processing time through intelligent use of historical data to guide current analysis.
Data Source
AI summary
Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an Identification Engine. The Identification Engine identifies a portrayal in image data of at least one side stripe of an aircraft runway at a geographical location. The Identification Engine applies a three-dimensional (3D) map of the geographic location to the portrayal of the at least one side strip in the image data. Based on applying the 3D map, the Identification Engine determines a current position of an aircraft in the 3D map with respect to the aircraft runway at the geographical location.