Image Stabilization Using Frequency-Component Motion Vector Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image stabilization systems face challenges in accurately separating error vectors caused by noise, subject movement, and changes in magnification, leading to suboptimal image stabilization performance.
Innovation Solution
An image stabilization apparatus and method that extracts frequency components from motion vectors and correlation values with shake detection signals, selecting the most reliable motion vectors for image stabilization, utilizing processors and circuitry to perform accurate image stabilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If motion vectors are obtained from multiple areas and averaged to obtain a reliable motion vector, then the reliability of image stabilization is improved, but the accuracy is degraded because error vectors from noise, subject movement, and magnification changes cannot be separated
Solution Approach 1:
The patent segments the motion vector analysis by dividing the image into multiple areas and processing each area's motion vectors separately. It then segments the frequency domain by extracting multiple frequency components from each motion vector and comparing them against shake detection signals. This segmentation allows the system to identify and separate reliable motion vectors from error vectors caused by noise, subject movement, and magnification changes, thereby improving both reliability and accuracy simultaneously.
Solution Approach 2:
The patent introduces frequency components as an intermediary between motion vectors and shake detection signals. By extracting frequency components from motion vectors and comparing them with frequency components from shake detection signals, the system creates an intermediary comparison mechanism that filters out error vectors. This intermediary approach enables the system to distinguish between actual camera shake and spurious motion vectors, improving measurement precision while maintaining reliability.
2Adaptability or versatility
If all motion vectors from multiple areas are used for image stabilization, then the coverage is improved, but the reliability is degraded due to inclusion of error vectors from noise and subject movement
Solution Approach 1:
The patent applies local quality by evaluating each motion vector from different image areas individually based on its correlation with shake detection signals. Instead of treating all motion vectors uniformly, the system assesses the local reliability of each motion vector by comparing its frequency components against the shake detection signal. This allows the system to include motion vectors from areas with high reliability while excluding those with high error content, thereby maintaining broad coverage while improving overall reliability.
Solution Approach 2:
The patent implements feedback by using shake detection signals to evaluate and select motion vectors. The shake detection signal serves as feedback information that guides the selection process. By continuously comparing motion vector frequency components against the shake detection signal, the system receives feedback about the reliability of each motion vector and adjusts the selection accordingly. This feedback mechanism ensures that only reliable motion vectors are used for image stabilization, improving reliability while maintaining adaptability across different imaging conditions.
Data Source
AI summary
An image stabilization apparatus comprises: a first extraction unit that extracts first signals of a plurality of different frequency components from each of a plurality of motion vectors obtained from an image signal output from an image sensor; a second extraction unit that extracts second signals of the plurality of different frequency components from a detection signal of a detected shake of an apparatus; an acquisition unit that acquires correlation values between the first signals of the plurality of motion vectors and the second signal for each of the frequency components; a selection unit that selects at least one of the plurality of motion vectors based on the correlation values each for each of the frequency components; and an image stabilization unit that performs image stabilization using the motion vector selected by the selection unit.