Multi-Sensor Camera Stabilization Through Video Stitching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional single image sensor/lens camera image stabilization methods require higher resolution sensors, reduce the field of view, and necessitate additional processing bandwidth, limiting post-processing capabilities.
Innovation Solution
Implement image stabilization for a multi-sensor camera by using video information from additional sensors to perform stabilization, allowing for post-processing and maintaining the field of view through video stitching and motion compensation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If extra margins of the sensor are used for image stabilization, then shake correction is achieved, but the field of view available for the captured image is reduced
Solution Approach 1:
The patent transitions from using spatial margins within a single sensor to utilizing temporal information across multiple sensors. By capturing data from multiple sensors and processing it over time, the system achieves image stabilization without sacrificing the field of view, as the stabilization is performed through computational methods rather than by discarding useful image data.
Solution Approach 2:
The patent introduces an intermediary processing system that uses multiple sensors and computational algorithms to achieve stabilization. Instead of relying on the sensor's physical margins, the system uses an intermediate layer of data processing that synthesizes stabilization information from multiple sensor inputs, thereby preserving the full field of view from each sensor.
2Reliability
If extra margins are used for image stabilization, then shake correction is achieved, but a higher resolution sensor is required
Solution Approach 1:
The patent makes the sensor system multi-functional by using multiple sensors to serve both the primary imaging function and the image stabilization function. Instead of requiring each sensor to have high resolution with extra margins for stabilization, the system uses a set of sensors where the stabilization information is derived from the collective data, allowing standard resolution sensors to achieve stabilization through their multi-purpose utilization.
3Reliability
If image stabilization is performed using extra margins, then shake correction is achieved, but extra processing bandwidth is required
Solution Approach 1:
The patent maintains continuous processing of stabilization data across multiple sensors and time frames. By continuously updating the stabilization information using data from multiple sensors in sequence, the system achieves effective image stabilization while managing processing bandwidth through efficient temporal and spatial data utilization, avoiding the need for additional processing resources that would be required by traditional margin-based approaches.
4Reliability
If image stabilization is performed using extra margins, then shake correction is achieved, but post-processing is not possible
Solution Approach 1:
The patent performs preliminary stabilization calculations using data from multiple sensors during the capture process. By preparing and storing the necessary stabilization information in advance from multiple sensor inputs, the system enables post-processing operations to be performed later without requiring the same computational resources at the time of image stabilization, thus maintaining both real-time stabilization and future post-processing capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables cost-effective image stabilization for multi-sensor cameras without reducing the field of view and allowing post-processing, using gyroscope information and digital motion estimation.
Implementation Method 1
calculate image stabilization data for the stitched video based on (A) the stitched video signal and (B) motion information
Data Source
AI summary
An apparatus comprising a plurality of capture devices and a processor. The plurality of capture devices may each be configured to generate a video signal in response to captured images. The processor may be configured to (i) receive the video signals from at least two of the capture devices, (ii) perform a video stitching operation on the video signals, (iii) generate a stitched video based on the video stitching operation and (iv) calculate image stabilization data for the stitched video based on (A) the stitched video signal and (B) motion information. Video data from one of the video signals is used to perform image stabilization for another of the video signals based on the image stabilization data.