Video Coding Time-Budget Feedback to Limit RD Degradation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding techniques suffer from low coding efficiency and lack effective methods for complexity control, leading to significant RD degradation and difficulty in extending complexity control mechanisms across different video coding standards.

Innovation Solution

A video encoding complexity control scheme is implemented with three modules: complexity pre-allocation, a feedback mechanism, and an encoding strategy decision module, utilizing weighted budget allocation, feedback-based time error adjustment, and Pareto-based encoding strategies to achieve precise time control and minimize RD loss.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding techniques are used, then coding process is simple, but coding efficiency is low and RD degradation occurs

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcoding process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating coding time budgets for different video blocks before the actual encoding process. The system determines expected encoding times for various block types and pre-allocates time budgets accordingly, enabling dynamic adjustment during encoding to optimize coding efficiency without excessive complexity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by making the coding process adaptive through real-time adjustment of encoding parameters based on actual encoding time consumption. The system dynamically modifies coding strategies for different video blocks based on feedback from actual encoding operations, allowing the system to optimize performance while managing complexity through flexibility

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If complexity control mechanism is extended to different video coding standards, then adaptability improves, but implementation difficulty increases

Engineering Contradiction:
Improveadaptability to video coding standardsVSAvoidimplementation ease
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent applies universality by designing a complexity control mechanism that can be extended across different video coding standards (H.264, HEVC, VVC) using a unified framework. The system uses standard-defined video block structures and coding parameters, allowing the same core mechanism to function across multiple standards without requiring separate implementations for each standard

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent utilizes parameter changes by adjusting encoding parameters such as quantization parameters, partition depths, and coding modes based on the specific requirements of different video coding standards. The system modifies these parameters dynamically while maintaining the overall control mechanism, enabling easy extension to new standards through parameter adaptation rather than structural redesign

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12407831B2Method, apparatus, and medium for video processing
Publication Date: 2025.09.02 DOUYIN VISION CO LTD
  • US12407831B2 patent drawing
  • US12407831B2 patent drawing
  • US12407831B2 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a target video block of a video and a bitstream of the video, an adjusted coding process for the target video block based at least in part on a budget of coding time for at least one further video block and an actual coding time for the at least one further video block, the at least one further video block being coded before the conversion, the coding time representing a time duration during which the at least one further video block being coded, the budget of coding time representing a time duration being pre-allocated for encoding the at least one further video block; and performing the conversion by using the adjusted coding process.