Rho-Domain Rate Control for Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies face challenges in achieving optimal quality for a given bit rate, particularly in adapting to scene changes and efficiently managing bit rate and quality, especially when encoding camera video versus screen capture content, due to high computational complexity in previous rate control approaches.

Innovation Solution

The implementation of a method for rate control in video encoding that uses a rho value to set a target proportion of zero-value quantized transform coefficients, with a QP-rho mapping determined using a location-independent scale factor to reduce computational complexity, facilitating efficient caching and parallel processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If previous rate control approaches are used to achieve accurate rate control decisions, then rate-distortion performance is improved, but computational complexity increases significantly

Engineering Contradiction:
Improverate control accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a rho (ρ) parameter that represents the proportion of zero-valued quantized transform coefficients. This parameter serves as a simplified proxy for bit rate estimation, replacing complex computational models with a single measurable metric that can be quickly calculated and used for rate control decisions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces complex mechanical/computational rate control systems with a simplified statistical model based on the rho parameter. Instead of using intensive computational algorithms to predict bit rate, the system uses the proportion of zero coefficients, which can be determined through simple counting and statistical analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Stability of the object's composition

If traditional rate control methods are applied to adapt to scene changes, then quality consistency is improved, but processing time increases

Engineering Contradiction:
Improvequality consistencyVSAvoidprocessing time
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis by calculating the rho parameter early in the encoding process, before final rate control decisions are made. This allows the system to have rate control information ready in advance, enabling quick adaptation to scene changes without adding processing delays during critical encoding stages.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The rho parameter automatically adapts to different scene types (natural video vs. screen capture) by reflecting the actual statistical properties of the content. The system uses self-generated statistical data from the encoded coefficients to make rate control decisions, eliminating the need for external complexity management or manual parameter tuning.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If location-dependent scale factors are used in frequency transform, then transform accuracy is improved, but computational overhead increases

Engineering Contradiction:
Improvetransform accuracyVSAvoidcomputational overhead
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and isolates the rho parameter calculation from the complex frequency transform process. By separating the statistical analysis (counting zero coefficients) from the transform operations, the system can use location-dependent scale factors for accurate transforms while computing rate control information through a simpler, independent statistical process.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP3243328B1Variations of rho-domain rate control
Publication Date: 2019.07.31 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3243328B1 patent drawingFigure 1~2b
  • EP3243328B1 patent drawingFigure 3
  • EP3243328B1 patent drawingFigure 4a

AI summary

Variations of rho-domain rate control for video encoding or other media encoding are presented. For example, in some of the variations, an encoder sets a rho value for a unit of media based at least in part on a bit allocation for the unit. The encoder also computes transform coefficients for the unit using a frequency transform having multiple location-dependent scale factors, sets a value of quantization parameter ("QP") for the unit using a mapping of QP values to rho values, and uses the value of QP for the unit during quantization of the transform coefficients of the unit. When the QP-rho mapping is determined, a location-independent scale factor that approximates the multiple location-dependent scale factors is used and/or certain scaling operations are integrated, which reduces computational complexity while still supporting accurate rate control decisions. Implementations of such variations of rate control can exploit opportunities for caching and parallel computation.