Non-destructive Video Encoder Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems that apply motion stabilization transformations to reduce or correct motion between media item frames end up removing content intended by the creator, as they destroy the original intent of the media item by removing motion between frames during encoder optimization.
Innovation Solution
The method involves identifying a video item and detecting motion between frames, applying motion stabilization transformations after padding frames with additional pixels to represent unknown content, encoding the video item, and transmitting instructions to reverse the transformations at the client device, thus preserving the original content and intent.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion stabilization transformations are applied to reduce motion between frames during encoding, then encoding efficiency and quality are improved, but the original content and creator's intent are lost
Solution Approach 1:
The system segments the processing into two distinct phases: encoding phase where motion stabilization is applied to improve compression efficiency, and playback phase where the original motion is restored. This segmentation allows each phase to optimize for its specific goal without compromising the other.
Solution Approach 2:
The system changes the motion parameters during encoding by applying stabilization transformations that reduce inter-frame motion. During playback, these parameters are reversed to restore the original motion characteristics, effectively changing the state of the video data between these two phases.
2Device complexity
If motion stabilization transformations are applied before encoding, then the complexity of the video item is reduced, but the motion between frames is destroyed
Solution Approach 1:
The system performs preliminary motion stabilization transformations before encoding to reduce video complexity and improve compression. The transformations are applied in advance, and the necessary information to reverse them is stored for later restoration during playback.
Solution Approach 2:
The system creates a transformed copy of the video data with reduced motion for encoding purposes, while preserving the ability to reconstruct the original motion. This copying approach allows the encoded version to have lower complexity without permanently altering the source material's characteristics.
3Loss of information
If frames are padded with additional pixels to represent unknown content, then motion stabilization can be applied without removing original content, but the data size increases
Solution Approach 1:
The system applies preliminary anti-action by padding frames with additional pixels before motion stabilization. This padding prevents the stabilization process from cropping or removing original content, effectively counteracting the potential information loss before it can occur.
Solution Approach 2:
The system addresses the data size increase by managing the padding in a temporary dimension that is resolved during playback. The additional pixels are introduced in the encoding phase but are reversed and removed during playback, effectively adding dimensionality temporarily without permanent increase in final data size.
Data Source
AI summary
A video item that is subject to one or more motion stabilization transformations applied to the video item is identified. The one or more motion stabilization transformations pertain to a motion between video frames of a video sequence associated with the video item. One or more operations to modify the one or more motion stabilization transformations applied to the video item are determined. The one or more operations to modify the motion stabilization transformations are performed. The video item is provided for playback via a client device. Playback of the video item depicts at least a portion of the motion between the video frames of the video sequence.