Video Stabilization Using Direct Geometric Conversion Coefficients

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional automatic stabilization control methods for image stabilization in video cameras suffer from calculation errors in geometric conversion coefficients, leading to non-rendering areas in output frames and degradation in image quality, especially when handling moving objects.

Innovation Solution

The method calculates a direct geometric conversion coefficient between a reference frame and an input frame by accumulating and then inversely converting geometric conversion coefficients between adjacent frames, allowing for high-precision automatic stabilization control and interpolation of non-rendering areas to maintain image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If geometric conversion coefficients between adjacent frames are accumulated to calculate the coefficient between reference frame and input frame, then automatic stabilization control can be performed, but calculation errors accumulate leading to reduced precision

Engineering Contradiction:
Improveautomatic stabilization controlVSAvoidgeometric conversion coefficient precision
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent calculates the direct geometric conversion coefficient between the reference frame and input frame in advance using feature point matching, before performing automatic stabilization control. This preliminary calculation of the direct coefficient avoids the accumulation of errors that would occur if coefficients from multiple intermediate frames were accumulated, thereby maintaining high precision while enabling automated stabilization.

Inventive Principle:
Principle #10Preliminary action

2Stability of the object's composition

If geometric conversion is performed using accumulated coefficients, then frame stabilization is achieved, but non-rendering areas occur in output frames degrading image quality

Engineering Contradiction:
Improveframe stabilizationVSAvoidimage quality
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent performs preliminary calculation of the direct geometric conversion coefficient between reference frame and input frame using feature point correspondence. This direct coefficient calculation ensures accurate mapping relationships are established before rendering, preventing the occurrence of non-rendering areas and maintaining high image quality while achieving frame stabilization.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If feature point matching is performed between adjacent frames, then geometric conversion coefficients can be calculated, but calculation time increases

Engineering Contradiction:
Improvegeometric conversion coefficient accuracyVSAvoidcalculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and uses only the essential feature points from frames for matching and coefficient calculation, rather than processing all image data. By selecting key feature points that sufficiently represent the geometric relationship between frames, the calculation time is reduced while maintaining the accuracy needed for precise geometric conversion coefficients.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS7428003B2Automatic stabilization control apparatus, automatic stabilization control method, and recording medium having automatic stabilization control program recorded thereon
Publication Date: 2008.09.23 XACTI CORP
  • US7428003B2 patent drawing
  • US7428003B2 patent drawing
  • US7428003B2 patent drawing

AI summary

In an automatic stabilization control apparatus that makes automatic stabilization control of data representing a moving image within a range from a reference frame to a frame which is an arbitrary number of frames succeeding the reference frame, an automatic stabilization control apparatus comprises first means for calculating a geometric conversion coefficient between an input frame and a frame which is one frame preceding the input frame for converting coordinates on the input frame into coordinates on the frame which is one frame preceding the input frame as a geometric conversion coefficient between the adjacent frames; second means for accumulating the geometric conversion coefficients between the adjacent frames from the reference frame to the input frame, to calculate an indirect geometric conversion coefficient between the input frame and the reference frame; third means for calculating a direct geometric conversion coefficient between the input frame and the reference frame utilizing the indirect geometric conversion coefficient between the input frame and the reference frame; and fourth means for carrying out automatic stabilization control of the input frame using the direct geometric conversion coefficient between the input frame and the reference frame.