Multi-Sensor Image Stabilization for Aerial Vehicles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Imaging devices on aerial vehicles face challenges in stabilizing imaging data due to motion caused by forces such as vibrations and rotations during flight, especially when a fixed reference point is not available in the field of view, leading to blurry and misaligned images.
Innovation Solution
The implementation of multi-sensor image stabilization techniques, where a secondary imaging device captures data on ground terrain and processes it in real-time to determine the translational and rotational motion of a primary imaging device, allowing for stabilization of the captured images by adjusting them based on the calculated motion vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single imaging device is used on an aerial vehicle, then the device complexity is reduced, but the image stabilization capability deteriorates when no fixed reference point is available
Solution Approach 1:
The system divides the imaging function into two separate devices: a primary imaging device for capturing images and a secondary imaging device for detecting motion. This segmentation allows each device to specialize in its function, with the secondary device providing motion data that stabilizes the primary device's images even when no fixed reference point is visible
Solution Approach 2:
The secondary imaging device acts as an intermediary that indirectly measures the motion of the primary imaging device. By detecting motion through alternative means (when fixed reference points are unavailable), it provides stabilization data without requiring direct visual reference in the primary device's field of view
2Reliability
If a secondary imaging device is added for motion detection, then the image stabilization capability is improved, but the device complexity increases
Solution Approach 1:
The secondary imaging device serves multiple functions: it detects translational motion, detects rotational motion, and provides data for stabilizing images. This multi-functionality justifies the added complexity by delivering comprehensive motion compensation capabilities
Solution Approach 2:
The system combines data from two imaging devices and integrates it with image processing to achieve stabilization. The computing device merges motion detection data with image capture data, processing them together to produce stabilized output images
3Measurement precision
If multi-sensor stabilization is implemented, then image quality is improved, but the processing complexity and time increase
Solution Approach 1:
The system performs preliminary motion detection using the secondary imaging device before final image processing. By detecting translational and rotational motion in advance, the system prepares stabilization parameters that streamline the subsequent image processing steps
4Speed
If real-time processing of secondary imaging data is performed, then the stabilization response speed is improved, but the energy consumption increases
Solution Approach 1:
The system processes only the essential motion parameters (translational and rotational motion) detected by the secondary imaging device, rather than performing exhaustive analysis of all imaging data. This partial processing approach maintains real-time response while reducing energy consumption
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
An aerial vehicle may include a first sensor, such as a digital camera, having a lens or other component that includes a second sensor mounted thereto. Information or data, such as digital images, captured using the second sensor may be used to determine or predict motion of the lens, which may include components of translational and/or rotational motion. Once the motion of the lens has been determined or predicted, such motion may be used to stabilize information or data, such as digital images, captured using the first sensor, according to optical or digital stabilization techniques. Where operations of the first sensor and the second sensor are synchronized, motion of the second sensor may be modeled based on information or data captured thereby, and imputed to the first sensor.