Residual Decoding Circuit Selective Syntax Element Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional Versatile Video Coding (VVC) decoder designs require unnecessary computation and re-calculation of quantization-related information, even when decoding is not required, due to their multi-pass residual decoding approach.

Innovation Solution

A video residual decoding apparatus and method that uses a storage device to record side information and state information for optimizing syntax element decoding, allowing selective decoding of specific coefficient positions and reducing computational burden by skipping unnecessary operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multi-pass residual decoding is applied to decode syntax elements at each coefficient position, then decoding completeness is improved, but computational complexity increases due to unnecessary traversal and re-calculation

Engineering Contradiction:
Improvedecoding completenessVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing a first decoding pass to identify coefficient positions requiring syntax element decoding, storing this side information before the second pass. This allows the second pass to selectively decode only necessary positions without re-traversing all coefficient positions, thereby reducing computational complexity while maintaining decoding completeness

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the residual decoding process into multiple decoding passes, where the first pass identifies necessary coefficient positions and the second pass selectively decodes only those positions. This segmentation allows the system to maintain comprehensive decoding coverage while avoiding redundant computations on positions that don't require syntax element decoding

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If quantization-related information is re-calculated in later decoding passes, then decoding accuracy is improved, but computational load increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by calculating and storing quantization-related information during the first decoding pass, making this information available for the second pass without requiring re-calculation. This preserves decoding accuracy while significantly reducing the computational load in later passes

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by storing side information containing quantization-related data from the first decoding pass, which is then referenced during the second pass instead of re-calculating. This copying mechanism maintains decoding accuracy while avoiding redundant computational operations

Inventive Principle:
Principle #26Copying

3Reliability

If all coefficient positions are traversed in each decoding pass, then no syntax element is missed, but processing time increases

Engineering Contradiction:
Improvesyntax element coverageVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using the first decoding pass to identify and store side information about coefficient positions that require syntax element decoding. The second pass then uses this pre-identified information to selectively process only necessary positions, maintaining syntax element coverage while reducing processing time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by performing complete traversal in the first decoding pass to ensure no syntax element is missed, then using the stored side information to perform selective partial traversal in the second pass. This approach ensures comprehensive coverage while minimizing redundant processing in subsequent passes

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11876990B2Video residual decoding apparatus using storage device to store side information and/or state information for syntax element decoding optimization and associated method
Publication Date: 2024.01.16 MEDIATEK INC
  • US11876990B2 patent drawing
  • US11876990B2 patent drawing
  • US11876990B2 patent drawing

AI summary

A video residual decoding apparatus is used for applying residual decoding to a transform block that is divided into sub-blocks, and includes a residual decoding circuit and a storage device. The residual decoding circuit enters a coefficient loop for decoding one or more syntax elements at each of coefficient positions within a sub-block that has at least one non-zero coefficient level. The coefficient loop includes one decoding pass and at least one other decoding pass. During the at least one other decoding pass, the residual decoding circuit records side information in the storage device, where the side information is indicative of specific coefficient positions at which specific syntax elements need to be decoded in the one decoding pass. During the one decoding pass, the residual decoding circuit refers to the side information for decoding the specific syntax elements at the specific coefficient positions, respectively.