Kalman Filter Parameter Estimation for Video Rate Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current models for estimating the rate-quantization function in video encoding are inaccurate and complex, with existing algorithms failing to provide a straightforward and sufficiently accurate estimation of model parameters, especially in real-time applications where precise rate control is crucial.

Innovation Solution

A system utilizing a time-discrete Kalman filter with two correction steps to estimate model parameters, incorporating complexity measures and actual coding rates, and employing a piecewise defined rate-quantization model with quadratic and exponential function pieces for improved accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a quadratic model with linear regression is used to estimate rate-quantization parameters, then the estimation process is straightforward, but the model accuracy and smoothness are insufficient

Engineering Contradiction:
Improvemodel parameter estimation accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the rate-quantization model into multiple segments using piecewise definition. Instead of using a single quadratic model, it employs different function pieces (quadratic, exponential, linear) for different quantization parameter ranges. This segmentation allows each piece to be optimized independently, improving overall accuracy while maintaining manageable complexity through structured piecewise definition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic model parameter estimation using the Kalman filter. The model parameters are not fixed but are continuously updated based on incoming data (complexity measures and actual coding rates). This dynamic approach allows the model to adapt to varying video characteristics in real-time, improving accuracy without requiring an overly complex static model structure.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If a piecewise defined model with multiple function pieces is used, then the model accuracy improves, but the complexity of the model increases

Engineering Contradiction:
Improverate-quantization function approximation accuracyVSAvoidmodel structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the rate-quantization relationship into multiple pieces based on quantization parameter ranges. Each piece uses an appropriate function (quadratic for certain ranges, exponential for others, linear for boundaries). This segmentation improves accuracy by fitting different functional forms to different regions while the piecewise structure provides a clear, organized way to manage the increased complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the functional parameters of the model pieces based on the quantization parameter range. By adjusting which function piece is active and its corresponding parameters (a, b, c coefficients), the model adapts to different regions of the rate-quantization curve. This parameter adaptation allows high accuracy without requiring all possible function types to be active simultaneously, managing complexity through selective application.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If Kalman filter-based parameter estimation is used, then the estimation accuracy and stability improve, but the computational complexity increases

Engineering Contradiction:
Improveparameter estimation stabilityVSAvoidestimation algorithm complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms through the Kalman filter, where the estimated parameters continuously influence the model predictions, which are then compared with actual coding rates and complexity measures. This feedback loop improves estimation stability by constantly correcting deviations. The feedback structure is systematic and algorithmic, managing the computational complexity through structured iterations rather than complex mathematical operations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The Kalman filter performs preliminary actions by predicting the next state based on current estimates before incorporating new measurements. This prediction step smooths out the estimation process and reduces the impact of sudden outliers. The preliminary prediction action stabilizes the overall estimation process, improving reliability while the systematic nature of the Kalman filter algorithm keeps the computational complexity manageable through efficient matrix operations.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If real-time rate control is implemented, then the productivity and responsiveness improve, but the measurement precision of rate-quantization function deteriorates

Engineering Contradiction:
Improvereal-time encoding efficiencyVSAvoidrate-quantization function accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by estimating the rate-quantization function parameters in advance using the Kalman filter before actual encoding occurs. The model continuously updates its predictions based on historical data, so when real-time encoding is needed, the parameters are already partially determined. This preliminary estimation enables fast real-time rate control decisions while maintaining accuracy through continuous refinement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses dynamic parameter estimation that adapts to real-time conditions. The Kalman filter continuously adjusts model parameters based on incoming complexity measures and actual coding rates, allowing the system to maintain accurate rate-quantization function approximation even during real-time operation. This dynamic adaptation enables the system to balance productivity requirements with measurement precision by learning from actual encoding performance as it occurs.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9445102B2Model parameter estimation for a rate- or distortion-quantization model function
Publication Date: 2016.09.13 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US9445102B2 patent drawing
  • US9445102B2 patent drawing
  • US9445102B2 patent drawing

AI summary

A more accurate model parameter estimation is achieved by using a Kalman filter for discretely estimating the model parameters between the consecutive frames of the frame sequence and performing the correction of the time-discrete Kalman filter twice per frame, firstly using a measurement value which depends on a complexity measure of the current frame to achieve a primarily corrected state of the time-discrete Kalman filter, and secondly using a measurement value depending on an actual coding rate or distortion of the video encoder in encoding the current frame using a predetermined quantization which may have been determined by an estimation of the actual rate- or distortion-quantization function according to the primarily corrected state. A rate-quantization model function relates the quantization of the video encoder to the coding rate of the video encoder and is piecewise defined to exhibit quadratic and exponential functions in finer and coarser quantization intervals, respectively.