Content-Aware Video Resizing Reducing Jitter
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video resizing often results in video jitter or sliding, causing blurred motion effects due to misalignment of frames, especially when changing the aspect ratio from 4:3 to 16:9, which existing technologies fail to adequately address.
Innovation Solution
The solution involves analyzing the video content to identify dominant objects and resizing based on their energy levels, using edge detection and energy calculation to minimize frame stretching, and maintaining consistency in column or row selection across frames to reduce jitter. This is achieved through a process that compares edge detection results between frames, adjusts energy values to prevent frequent changes, and uses a process list to track and manage column or row modifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video resizing is performed to change aspect ratio from 4:3 to 16:9, then the video format adapts to different displays, but video jitter or sliding occurs causing blurred motion effects
Solution Approach 1:
The patent applies local quality by differentiating between important and unimportant regions within the video frame. Edge detection identifies dominant edges that define important objects, while energy calculation determines which columns contain significant content. During resizing, columns with low energy (unimportant regions) are preferentially stretched or removed, while columns containing dominant edges (important objects) are preserved with minimal distortion. This localized approach ensures that adaptability to different aspect ratios is achieved without degrading the visual quality of important objects.
Solution Approach 2:
The patent employs preliminary action by performing edge detection and energy calculation on each frame before the actual resizing operation. The process list is pre-computed to identify which columns should be stretched or removed based on their energy values and edge characteristics. This preliminary analysis allows the resizing algorithm to make informed decisions about column manipulation, ensuring that frame alignment is maintained and jitter is minimized before the resizing actually occurs.
2Manufacturing precision
If dominant objects are preserved during resizing by minimizing stretching, then visual quality of important objects is maintained, but more columns need to be removed or stretched from other regions
Solution Approach 1:
The patent replaces the traditional mechanical approach of uniform or simple proportional resizing with an intelligent, content-aware system. Instead of applying a uniform scaling factor to all columns, the system uses edge detection algorithms and energy calculation to intelligently determine which columns to stretch, remove, or preserve. This substitution of mechanical resizing with an analytical, content-based approach allows for precise control of object distortion while maintaining overall aspect ratio adaptation.
Solution Approach 2:
The patent utilizes parameter changes by dynamically adjusting the energy threshold and selection criteria based on the specific content of each frame. The energy calculation parameter is used to quantify the importance of each column, and this parameter drives the decision-making process for column manipulation. By changing the selection parameters based on frame-specific content analysis, the system achieves precise distortion control for dominant objects while adapting to varying scene compositions.
Data Source
AI summary
In accordance with some embodiments, jitter accompanying video resizing, can be reduced or even eliminated by analyzing the content that is to be depicted and resizing based on the nature of the content being depicted. As a result, dominant objects in one frame can be handled in a way that reduces or eliminates video jitter or sliding.