Content-Adaptive Frame Duration Extension for Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding methods inefficiently handle similar frames, leading to unnecessary encoding and increased bitrate without perceptible visual difference.
Innovation Solution
An encoder determines frames with high similarity and extends their display duration, using a supplemental enhancement information message to signal the decoder, thereby reducing the number of frames encoded and optimizing bitrate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all frames are encoded using conventional video encoding methods, then complete video data is transmitted, but compression efficiency deteriorates and bitrate increases unnecessarily
Solution Approach 1:
The patent extracts and removes redundant frame encoding by identifying similar frames and excluding them from the encoding process. The system analyzes frame similarity and selectively encodes only distinct frames, extracting the unnecessary encoding operations that would process identical or near-identical frames.
Solution Approach 2:
The patent performs preliminary frame similarity analysis before encoding to determine which frames should be encoded and which can be skipped. This preliminary action involves comparing adjacent frames to predict redundancy, allowing the encoder to prepare the bitstream by pre-identifying frames that can be represented through frame duration extension rather than full encoding.
2Productivity
If frame duration is extended for similar frames, then compression efficiency improves, but decoder complexity increases due to additional control signals
Solution Approach 1:
The patent makes the SEI message structure universal by defining it as an optional enhancement that can be applied across different video coding scenarios. The message serves multiple functions: indicating frame duration extension, signaling compression efficiency improvements, and providing backward compatibility with standard decoders. This multi-functionality allows the same mechanism to handle various frame similarity cases without requiring decoder complexity changes.
3Productivity
If frame similarity analysis is performed, then encoding efficiency improves, but processing time increases during encoding
Solution Approach 1:
The patent applies partial action by performing frame similarity analysis only for adjacent frames rather than all frames in the sequence. The system analyzes a limited window of frames (typically current and previous frames) to determine redundancy, avoiding the excessive computational burden of analyzing the entire frame sequence while still achieving significant compression efficiency improvements.
Data Source
AI summary
Systems and methods are described herein for processing video data. An encoder may transmit information indicating a duration that a particular frame should be displayed. The information may comprise an indication of whether the particular frame should be displayed for an increased duration. The encoder may decide during encoding, a whether the particular frame should be displayed for an increased duration (e.g., doubled, tripled, or more). The decision may be based on a similarity analysis performed by the encoder on two or more frames. Information indicating the decision may be inserted into a message, which may then be transmitted in a transport stream comprising encoded video data to a decoder. The decoder may decode the information and cause a display device to display the particular frame for the increased duration.