Image Stabilization Using Classified Unit Areas for Motion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image stabilization methods struggle to accurately correct shaking in ultra-high magnification scenarios due to the limitations of using a limited number of local motion vectors, which are often contaminated by dynamic objects, leading to reduced accuracy in calculating global motion vectors and increased computational load.

Innovation Solution

An image stabilization method that dynamically adjusts the size and number of unit areas based on noise levels and motion characteristics, using classification models to distinguish between background, foreground, and short-term motion areas, and extracts valid feature points to generate accurate motion data for correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a limited number of local motion vectors are used to reduce computational load, then processing speed improves, but accuracy of global motion vector calculation deteriorates due to contamination by dynamic objects

Engineering Contradiction:
Improveprocessing speedVSAvoidaccuracy of global motion vector calculation
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The image is divided into multiple unit areas, and local motion vectors are extracted from each unit area. By segmenting the image into manageable regions, the system can process multiple local motion vectors simultaneously, increasing the total number of vectors available for calculating the global motion vector without proportionally increasing computational complexity. This segmentation allows the system to overcome the limitation of using only a limited number of LMVs while maintaining real-time processing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different unit areas based on their characteristics. Unit areas are classified into background, foreground, and short-term motion areas, and valid feature points are selectively extracted based on this classification. This local quality approach ensures that only reliable local motion vectors from background areas are used for global motion calculation, filtering out contaminated vectors from dynamic objects while maintaining high processing efficiency.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If more local motion vectors are extracted to improve accuracy, then measurement precision improves, but computational load increases excessively

Engineering Contradiction:
Improveaccuracy of shaking correctionVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary classification of unit areas into background, foreground, and short-term motion areas before extracting local motion vectors. This preliminary action allows the system to pre-identify which unit areas will contribute valid motion vectors and which will be excluded. By performing this classification beforehand, the system avoids the computational waste of extracting and then discarding invalid vectors from dynamic objects, thus reducing overall computational load while ensuring high accuracy from the remaining valid vectors.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the range of the background model based on motion data to optimize the balance between accuracy and computational load. When motion characteristics indicate stable conditions, the model range can be expanded to include more unit areas for higher accuracy. When dynamic objects are detected or motion increases, the range is reduced to exclude contaminated areas. This parameter adjustment allows the system to adaptively control the number of local motion vectors processed, maintaining high accuracy when possible while reducing computational load when necessary.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the range of background model is expanded to classify more unit areas, then measurement precision improves, but reliability deteriorates when large dynamic objects are present

Engineering Contradiction:
Improveaccuracy of unit area classificationVSAvoidrobustness against dynamic objects
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements a dynamic background model whose range is adjusted based on motion data from the input frame. The system continuously monitors motion characteristics and adapts the model range accordingly. When the scene is stable, the background model covers a larger portion of the image for better classification accuracy. When dynamic objects appear or motion increases, the model range is reduced to maintain reliability. This dynamic adjustment allows the system to optimize the trade-off between precision and reliability in real-time according to scene conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses motion data extracted from the input frame as feedback to adjust the background model range. The motion characteristics serve as feedback signals that indicate whether the current model range is appropriate. If motion analysis detects large dynamic objects or abnormal motion patterns, the feedback triggers a reduction in model range to exclude contaminated areas. This feedback mechanism ensures the background model maintains high reliability by continuously adapting to changing scene conditions while preserving measurement precision when conditions are favorable.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20260057493A1Image stabilization method and image processing device
Publication Date: 2026.02.26 HANWHA VISION CO LTD
  • US20260057493A1 patent drawing
  • US20260057493A1 patent drawing
  • US20260057493A1 patent drawing

AI summary

An image stabilization method includes: determining a representative value of one or more unit areas constituting an input frame; determining a type of the one or more unit areas based on at least one classification model and the representative value of each of the one or more unit areas, respectively; extracting at least one valid feature point within the input frame based on the type of the one or more unit areas; generating motion data of the input frame based on an inter-frame motion of the at least one valid feature point; and correcting the input frame based on the motion data of the input frame.