Scalable Quantization Matrix Encoding for Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for image processing in video coding, such as H.264/AVC and HEVC, face inefficiencies in compressing quantization matrices, leading to increased coding amounts and reduced compression efficiency.

Innovation Solution

An image processing device and method that sets a replacement difference coefficient in the quantization matrix, allowing up-conversion to larger block sizes, and transmits only the differences, enabling efficient dequantization and encoding by replacing the initial coefficient with the replacement coefficient, thereby reducing the amount of coding data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a quantization matrix is up-converted to larger block sizes for processing, then the adaptability to different block sizes is improved, but the coding amount increases due to transmitting more coefficient data

Engineering Contradiction:
Improveadaptability to different block sizesVSAvoidcoding amount
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments the quantization matrix coefficients into two parts: DC coefficients (low-frequency components) and AC coefficients (high-frequency components). This segmentation allows different encoding strategies to be applied to each part, reducing the overall coding amount while maintaining adaptability to different block sizes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the problem from transmitting absolute coefficient values to transmitting difference values (delta coefficients). By encoding the difference between the up-converted coefficient and a reference coefficient instead of the absolute value, the coding amount is significantly reduced while still allowing reconstruction of the original coefficients.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the DC coefficient is encoded separately from AC coefficients, then the measurement precision of low-frequency components is improved, but the device complexity increases due to separate encoding processes

Engineering Contradiction:
Improveprecision of DC coefficient encodingVSAvoidencoding process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies different encoding qualities and methods to different parts of the quantization matrix. DC coefficients are encoded with higher precision using separate DC prediction and difference encoding, while AC coefficients use a different approach. This local quality differentiation improves overall precision without uniformly increasing complexity across all coefficients.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary prediction of DC coefficients using neighboring block information before encoding the actual DC values. This preliminary action reduces the magnitude of values that need to be encoded, improving precision while simplifying the subsequent encoding process through differential coding.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If quantization step sizes differ for each orthogonal transform coefficient component, then the manufacturing precision of image quality is improved, but the loss of information increases due to more complex quantization matrices

Engineering Contradiction:
Improveimage quality precisionVSAvoidinformation loss in quantization matrix
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent changes the parameters of the quantization matrix by allowing different step sizes for different coefficient components (DC and AC). This parameter differentiation enables more precise control over image quality, allocating finer quantization steps to important low-frequency components and coarser steps to less critical high-frequency components, thereby improving overall image quality precision while managing information loss.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11539954B2Image processing device and method with a scalable quantization matrix
Publication Date: 2022.12.27 SONY GROUP CORP
  • US11539954B2 patent drawing
  • US11539954B2 patent drawing
  • US11539954B2 patent drawing

AI summary

An image processing device and method that enable suppression of an increase in the amount of coding of a scaling list. The image processing device sets a coefficient located at the beginning of a quantization matrix by adding a replacement difference coefficient that is a difference between a replacement coefficient used to replace a coefficient located at the beginning of the quantization matrix and the coefficient located at the beginning of the quantization matrix to the coefficient located at the beginning of the quantization matrix; up-converts the set quantization matrix; and dequantizes quantized data using an up-converted quantization matrix in which a coefficient located at the beginning of the up-converted quantization matrix has been replaced with the replacement coefficient. The device and method can be applied to an image processing device.