Image Stabilization via Region-Specific Motion Offset
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image stabilization techniques for electronic devices are inefficient and inaccurate in real-time applications, particularly for on-device video stabilization, as they fail to effectively address motion-related disturbances such as hand shaking during video recording.
Innovation Solution
An electronic device with an image input unit, sensor input unit, and image processing unit that captures image frames, receives sensor data, determines motion variance, and adjusts the display offset of the image frame relative to a reference frame to minimize unwanted motion, using techniques like high pass filtering and motion estimation to accurately assess and correct for shaking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image alignment technique is used for video stabilization, then geometric matching accuracy is improved, but computing performance becomes critical and processing time increases
Solution Approach 1:
The patent segments the image into multiple regions (e.g., foreground objects, background, sky, ground) and applies different stabilization processing to each region. This allows selective processing of only critical areas, reducing overall computational load while maintaining stabilization accuracy where needed.
Solution Approach 2:
Different stabilization algorithms and processing intensities are applied to different regions of the image based on their importance and motion characteristics. Critical regions receive higher precision processing while less important regions use simplified processing, optimizing the balance between accuracy and computational efficiency.
2Measurement precision
If motion estimation is performed on the entire image, then stabilization accuracy is improved, but computational complexity and processing time increase
Solution Approach 1:
The image is divided into multiple regions and motion estimation is performed independently on each region rather than the entire image. This reduces the computational complexity from O(N²) to approximately O(k*N²) where k is the fraction of image processed, while maintaining accuracy in critical regions.
Solution Approach 2:
Motion estimation is applied partially to only the most critical regions of the image (such as foreground objects or regions with significant motion) rather than the entire image. This provides sufficient stabilization accuracy for the most important areas while reducing overall computational complexity.
3Manufacturing precision
If real-time stabilization processing is implemented, then video quality is improved, but processing speed and responsiveness may be compromised
Solution Approach 1:
Motion compensation parameters are calculated and prepared in advance based on sensor data and preliminary motion analysis. This allows the actual image stabilization to be applied quickly with minimal processing delay, maintaining real-time performance while ensuring high video quality.
Solution Approach 2:
The patent replaces complex mechanical image stabilization systems with computational methods that use sensor data and image processing algorithms. This substitution enables real-time processing with lower mechanical inertia and faster response times while maintaining or improving stabilization quality.
Data Source
AI summary
An electronic device and methods for image stabilization for use in an electronic device are provided. The method includes the steps of: receiving a plurality of motion data, at least a portion of the plurality of motion data corresponding to a first image frame, determining a motion value corresponding to the first image frame according to the portion of motion data, determining a display offset between the first image frame to a reference image frame according to the motion value and providing a portion of the first image frame for display according to the display offset. The reference image frame is displayed prior to the first image frame and is stored in a storage unit.