Dynamic Video Codec Adaptation for Stable Frame Rates

Solution Overview

Problem

Existing video encoding and decoding technologies, such as constant bitrate and variable bitrate schemes, fail to account for processor speeds and fluctuations in data communications bandwidth, leading to variable frame rates and a poor user experience due to choppy video playback.

Innovation Solution

Dynamic codec adaptation adjusts encoder parameters to maintain a specified frame rate by varying the quality or resolution of video frames based on available bandwidth and processor capabilities, ensuring a consistent frame rate while optimizing encoding settings for efficient upload and playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If variable bitrate encoding is used to reduce bits when scene changes are minimal, then bandwidth efficiency is improved, but frame rate stability deteriorates when scene changes occur rapidly

Engineering Contradiction:

Improvebandwidth efficiencyVSAvoidframe rate stability

Core Design Contradiction:

Loss of energyVSReliability

Solution Approach 1:

The patent implements dynamic bitrate adjustment that adapts to both scene complexity and network conditions. The encoder continuously monitors scene changes and dynamically modifies bitrate allocation, transitioning between conservative and aggressive compression strategies based on real-time conditions, thereby maintaining frame rate stability while optimizing bandwidth efficiency.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms that monitor frame rate stability and scene change detection results. This feedback loop allows the encoder to adjust bitrate allocation in real-time, preventing frame rate drops during rapid scene changes while maintaining efficient compression during stable scenes.

Inventive Principle:

Principle #23Feedback

2Productivity

If constant bitrate encoding is used to maintain consistent processing load, then processor performance is improved, but bandwidth utilization deteriorates when network conditions vary

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidbandwidth adaptation

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic bitrate adjustment that adapts to both scene complexity and network conditions. The encoder continuously monitors scene changes and dynamically modifies bitrate allocation, transitioning between conservative and aggressive compression strategies based on real-time conditions, thereby maintaining frame rate stability while optimizing bandwidth efficiency.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system dynamically changes encoding parameters including bitrate, quantization levels, and compression aggressiveness based on detected scene changes. During rapid scene changes, the encoder reduces compression aggressiveness to maintain quality and frame rate, while during stable scenes, it increases compression to optimize bandwidth utilization.

Inventive Principle:

Principle #35Parameter changes

3Loss of time

If aggressive compression is used to reduce file size, then upload time is improved, but video quality deteriorates

Engineering Contradiction:

Improveupload timeVSAvoidvideo quality

Core Design Contradiction:

Loss of timeVSManufacturing precision

Solution Approach 1:

The patent implements dynamic bitrate adjustment that adapts to both scene complexity and network conditions. The encoder continuously monitors scene changes and dynamically modifies bitrate allocation, transitioning between conservative and aggressive compression strategies based on real-time conditions, thereby maintaining frame rate stability while optimizing bandwidth efficiency.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system applies different compression aggressiveness levels to different portions of the video based on scene change detection. During rapid scene changes, compression is reduced to preserve quality, while during stable scenes, compression is increased to reduce file size and upload time, achieving local optimization of quality versus compression ratio.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS11546596B2Dynamic codec adaptation

Publication Date: 2023.01.03 META PLATFORMS INC

AI summary

Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.