Video De-shake Classification for Selective Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video de-shake systems lack the ability to automatically determine whether video content is suitable for camera shake compensation, often producing unsatisfactory results when applied to professional or unsuitable content.
Innovation Solution
A system and method that utilize a classification engine to differentiate between professional and non-professional video content based on characteristics such as closed caption data, frame rates, and copy protection, allowing selective application of camera shake compensation, with the option to apply de-shake processing at native frame rates and restore original frame rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If camera shake compensation is applied to all video content, then non-professional video quality is improved, but professional video content suffers from unpredictable shifts and degraded quality
Solution Approach 1:
The system performs preliminary classification of video content before applying camera shake compensation. By analyzing frame rate characteristics and content type in advance, the system determines whether de-shake processing is appropriate, preventing unwanted application to professional content while enabling it for non-professional content.
Solution Approach 2:
The system applies different processing quality and stabilization algorithms to different types of video content based on classification. Non-professional content receives aggressive stabilization with cropping, while professional content receives minimal or no processing to preserve original quality and avoid artifacts.
2Stability of the object's composition
If video de-shake processing is applied, then camera shake is reduced, but image quality deteriorates due to cropping and edge reconstruction
Solution Approach 1:
The system applies partial stabilization by selectively stabilizing only the central portion of the frame while leaving edges untouched. This approach reduces the need for aggressive cropping and edge reconstruction, thereby maintaining better image quality while still achieving effective shake reduction in the visible area.
3Measurement precision
If frame rate conversion is performed to apply de-shake at native frame rate, then processing accuracy is improved, but processing time and complexity increase
Solution Approach 1:
The system performs frame rate conversion and identifies native frame rate in advance before applying de-shake processing. By preparing the video at the correct native frame rate beforehand, the system achieves more accurate motion estimation and stabilization without requiring complex real-time rate conversion during the actual de-shake operation.
Data Source
AI summary
A system and method for applying video de-shake to video content includes a classification engine configured to generate a classification of the video content based on at least one source characteristic. The system also includes a de-shake engine configured to selectively apply camera shake compensation to the video content based on the classification. The classification engine may be configured to generate a classification based on, for example, the presence of closed caption data, the presence of copy protection data, current frame rate associated with the video content, or a native frame rate associated with the video content.