Content-Adaptive Frame Duration Extension for Similar Video Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding methods encode adjacent frames that are similar to each other, even when they are nearly identical, leading to inefficiencies in compression and bitrate usage.
Innovation Solution
An encoder determines frames that are similar based on a similarity analysis and decides to display them for an increased duration, reducing the need to encode these frames, using a supplemental enhancement information (SEI) message to signal this to the decoder.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all adjacent frames are encoded normally, then complete video information is preserved, but compression efficiency deteriorates due to redundant encoding of similar frames
Solution Approach 1:
The patent extracts and removes redundant frame encoding by identifying similar adjacent frames and excluding them from the encoding process. The encoder analyzes frame similarity and selectively skips encoding of frames that are determined to be similar to previously encoded frames, thereby eliminating redundant data while maintaining video quality through the SEI message mechanism.
Solution Approach 2:
The patent performs preliminary frame similarity analysis before encoding to determine which frames should be skipped. The encoder proactively identifies similar frames and prepares skip decisions in advance, allowing efficient encoding by avoiding redundant processing of similar frames while ensuring proper video reconstruction at the decoder end.
2Productivity
If frame encoding is reduced to improve compression efficiency, then bitrate decreases, but video quality may deteriorate due to missing frame data
Solution Approach 1:
The patent implements a feedback mechanism where the encoder transmits skip decisions and frame similarity information to the decoder via SEI messages. This feedback loop allows the decoder to understand which frames were skipped and reconstruct them appropriately using reference frames, thereby maintaining video quality while achieving compression efficiency through reduced encoding of similar frames.
Solution Approach 2:
The patent uses frame copying or reference frame mechanisms where skipped similar frames are reconstructed at the decoder by copying information from reference frames rather than transmitting new encoded data. This allows the decoder to regenerate missing frame data accurately, maintaining video quality while reducing the number of frames that need to be encoded and transmitted.
3Loss of time
If similar frames are encoded normally, then all frames are processed, but encoding time increases without providing additional visual information
Solution Approach 1:
The patent extracts and removes redundant encoding operations by identifying similar adjacent frames and excluding them from the encoding process. The encoder analyzes frame similarity and selectively skips encoding of frames that are determined to be similar to previously encoded frames, thereby reducing encoding time and improving throughput while maintaining video quality through the SEI message mechanism.
Solution Approach 2:
The patent performs preliminary frame similarity analysis before encoding to determine which frames should be skipped. The encoder proactively identifies similar frames and prepares skip decisions in advance, allowing efficient encoding by avoiding redundant processing of similar frames and improving overall encoding throughput.
Data Source
AI summary
Systems and methods are described herein for processing video data. An encoder may transmit information indicating a duration that a particular frame should be displayed. The information may comprise an indication of whether the particular frame should be displayed for an increased duration. The encoder may decide during encoding, a whether the particular frame should be displayed for an increased duration (e.g., doubled, tripled, or more). The decision may be based on a similarity analysis performed by the encoder on two or more frames. Information indicating the decision may be inserted into a message, which may then be transmitted in a transport stream comprising encoded video data to a decoder. The decoder may decode the information and cause a display device to display the particular frame for the increased duration.