Digital Video Stabilization via Frame Translation and Spatial Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera vibration causes poor video quality, especially at high magnification, due to platform or object shaking, which existing surveillance systems fail to effectively address.

Innovation Solution

A method and apparatus that involve obtaining a reference frame, determining the frame translation vector, translating and low pass filtering incoming frames to remove vibration effects, and providing the realigned frame as output based on predetermined thresholds, using a processor and memory to implement these steps in a video surveillance system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the camera is zoomed in to large magnification, then the detail resolution is improved, but the video quality degrades due to camera shaking

Engineering Contradiction:
Improvedetail resolutionVSAvoidcamera shaking
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent replaces mechanical vibration compensation with digital image processing. Instead of using physical stabilization mechanisms, the system captures multiple frames and uses digital correlation algorithms to calculate translation vectors, then digitally repositions and blends the frames to eliminate shaking artifacts while maintaining high magnification detail.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent performs preliminary frame capture and correlation analysis before final image generation. Multiple frames are captured and processed in advance to determine translation vectors, which are then used to create a stable reference frame. This preliminary processing enables the system to compensate for shaking that occurs during the actual observation period.

Inventive Principle:
Principle #10Preliminary action

2Stability of the object's composition

If the platform or object is shaken, then the camera cannot maintain stable positioning, but the video quality becomes poor

Engineering Contradiction:
Improvecamera positioning stabilityVSAvoidvideo quality degradation
Core Design Contradiction:
Stability of the object's compositionVSObject-affected harmful factors

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors the relationship between consecutive frames, calculates translation vectors based on correlation analysis, and uses this information to dynamically adjust the reference frame. This closed-loop approach allows the system to compensate for platform or object shaking in real-time, maintaining video quality despite instability in the physical positioning.

Inventive Principle:
Principle #23Feedback

3Length of moving object

If the camera zoom is increased, then the magnification is improved, but the shaking effects become more evident

Engineering Contradiction:
Improvemagnification levelVSAvoidshaking artifact visibility
Core Design Contradiction:
Length of moving objectVSObject-affected harmful factors

Solution Approach 1:

The patent substitutes mechanical stabilization with digital image processing techniques. By capturing multiple frames at high magnification and using correlation algorithms to calculate and compensate for translation, the system eliminates shaking artifacts that would otherwise be amplified by high zoom levels, thereby maintaining image quality at increased magnification.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8269844B2Method of improving video images by removing the effects of camera vibration
Publication Date: 2012.09.18 PELCO INC
  • US8269844B2 patent drawing
  • US8269844B2 patent drawing
  • US8269844B2 patent drawing

AI summary

A method of improving a video image by removing the effects of camera vibration comprising the steps of, obtaining a reference frame, receiving an incoming frame, determining the frame translation vector for the incoming frame, translating the incoming frame to generate a realigned frame, performing low pass filtering in the spatial domain on pixels in the realigned frame, performing low pass filtering in the spatial domain on pixels in the reference frame, determining the absolute difference between the filtered pixels in the reference frame and the filtered pixels in the realigned frame, performing low pass filtering in the temporal domain on the pixels in the realigned frame to generate the output frame if the absolute difference is less than a predetermined threshold, and providing the realigned frame as the output frame if the absolute difference is greater than the predetermined threshold.