Runway FOD Detection Using Thermal and Visible Image Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing FOD detection systems struggle to reliably detect foreign objects on runways during adverse weather conditions, particularly fog, and often generate false positive alerts due to light reflections, compromising safety and accuracy.
Innovation Solution
A dual-camera system combining a thermal camera operating in the infrared spectrum and a visible light camera, where both cameras have overlapping fields of view, processes thermal and visible light images to accurately identify foreign objects by comparing attributes such as position and size, and utilizes image processing to enhance detection and minimize false alarms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a visible light spectrum camera is used for FOD detection, then detection accuracy is improved under normal clear weather conditions, but detection reliability deteriorates under foggy weather conditions
Solution Approach 1:
The patent combines a thermal imaging camera and a visible light camera into a unified FOD detection system. The thermal camera captures thermal radiation images that penetrate fog, while the visible light camera provides high-resolution images under clear conditions. The system merges data from both cameras through image registration and fusion algorithms, enabling reliable FOD detection across varying weather conditions by selecting or combining appropriate data sources.
Solution Approach 2:
The system changes the detection parameter from solely visible light reflection to thermal radiation emission. By detecting the thermal radiation emitted by FOD objects rather than relying on visible light reflection, the system can penetrate fog and adverse weather conditions. The thermal camera operates in the infrared spectrum where fog has minimal attenuation, fundamentally changing the detection mechanism to overcome visibility limitations.
2Measurement precision
If a visible light spectrum camera is used for FOD detection, then detection capability is improved under normal conditions, but false alarm rate increases due to light reflections
Solution Approach 1:
The thermal imaging camera serves as an intermediary verification tool. When the visible light camera detects a potential FOD object, the system uses the thermal camera to verify the detection by checking for corresponding thermal radiation signatures. This intermediary verification step distinguishes actual FOD objects from false alarm sources like light reflections, water puddles, or runway markings that do not emit thermal radiation in the same pattern.
Solution Approach 2:
The system implements feedback through cross-validation between thermal and visible light image data. The thermal image data provides feedback to confirm or reject detections made by the visible light camera. This feedback mechanism reduces false alarms by requiring consistent detection signals from both imaging modalities before confirming FOD presence, thereby improving overall system reliability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables reliable detection of foreign objects under various visibility conditions, including fog, and reduces false alarms by correlating thermal and visible light image data, ensuring accurate identification and minimizing interference with airport and aircraft systems.
Implementation Method 1
capturing a thermal image of an area of interest on the runway using a thermal camera operating in an infrared spectrum
Implementation Method 2
capturing a visible light image of the area of interest on the runway using a visible light camera
Data Source
Figure 1~1A
Figure 2A~2B
Figure 3~4
AI summary
The present invention relates to a system for detecting a foreign object on a runway. The system includes a thermal camera having a first field of view and adapted to capture a thermal image of an area of interest on the runway, a visible light camera having a second field of view and adapted to capture a visible light image of the area of interest on the runway, such that the first field of view overlaps the second field of view. The system further includes a processor, a memory in communication with the processor for storing instructions executable by the processor, such that the processor is configured to detect a thermal object image in the thermal image, detect a visible light object image in the visible light image, and determine that the foreign object is detected when the thermal object image and the visible light object image are detected in the thermal image and the visible light object image respectively. The present invention further provides a method thereof and a detection system for detecting the same.