Code Amount Estimation for Uniform Video Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies face challenges in maintaining uniform image quality due to inappropriate code amount assignment, which is influenced by changing coding difficulty of block images during the coding process.

Innovation Solution

A code amount estimation device and method that utilizes a learning-based model to estimate target code amounts for each code amount estimation area, associating multiple quantization parameters with corresponding code amount estimation areas and target code amounts, allowing for accurate code amount assignment by updating the model based on quantization parameters and target code amounts during the coding process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the same code amount is assigned to each block image, then the code amount control is simple, but the image quality becomes non-uniform when areas with different coding difficulty coexist

Engineering Contradiction:
Improvecode amount control simplicityVSAvoidimage quality uniformity
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies local quality by assigning different code amounts to different block images based on their individual coding difficulty. The coding difficulty is calculated for each block image, and the code amount is adjusted locally according to this difficulty metric, ensuring that complex areas receive more bits while simple areas receive fewer bits, thereby achieving uniform image quality across the entire picture.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the coding difficulty is calculated using pixel value difference, then the code amount assignment considers area characteristics, but the code amount becomes inappropriate when coding difficulty changes during the coding process

Engineering Contradiction:
Improvecoding difficulty measurementVSAvoidcode amount assignment accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements dynamics by making the code amount assignment adaptive rather than static. The coding difficulty is recalculated for each block image during the coding process, and the code amount is dynamically adjusted based on the current coding difficulty and the cumulative code amount used so far. This allows the system to respond to changes in coding difficulty throughout the coding process, maintaining accurate code amount assignment even as conditions change.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If a larger code amount is assigned to areas with high coding difficulty, then the image quality uniformity is improved, but the overall file size increases

Engineering Contradiction:
Improveimage quality uniformityVSAvoidfile size
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies parameter changes by adjusting the code amount parameter based on the coding difficulty parameter. The system calculates the coding difficulty for each block image and uses this to determine the appropriate code amount, thereby optimizing the distribution of bits to achieve uniform image quality while controlling the overall file size through intelligent parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11039132B2Code amount estimation device, code amount estimation method, and code amount estimation program
Publication Date: 2021.06.15 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11039132B2 patent drawing
  • US11039132B2 patent drawing
  • US11039132B2 patent drawing

AI summary

A code amount estimation device includes a code amount estimation unit configured to estimate a first target code amount on the basis of a first code amount estimation area in first image information and a code amount estimation model for estimating the first target code amount for each first code amount estimation area using the first code amount estimation area and multiple first quantization parameters determined in advance, and the code amount estimation model is a model generated by associating a second code amount estimation area in second image information, multiple second quantization parameters, and a second target code amount for each second code amount estimation area when coding is performed with respective values of multiple second quantization parameters with each other.