Hypothetical Reference Decoder Initialization in V-PCC Bitstreams

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video Point Cloud Coding (V-PCC) systems lack conformance testing mechanisms, leading to interoperability issues and inefficient coding and decoding processes, particularly due to the absence of a hypothetical reference decoder (HRD) configuration, which affects the decoding of point cloud components and increases resource usage.

Innovation Solution

Implementing a method in an encoder to encode a buffering period SEI message and HRD parameters into the bitstream, allowing for HRD initialization and conformance testing at a coded atlas access unit, which includes encoding an atlas frame timing message to manage buffer operations and perform type I and II conformance tests to ensure decoding without buffer under/over-runs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If V-PCC systems implement conformance testing mechanisms with HRD configuration, then interoperability and decoding reliability improve, but device complexity and processing overhead increase

Engineering Contradiction:
ImproveinteroperabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The encoder performs HRD conformance testing during the encoding process itself, initializing the HRD with buffer parameters and performing type I and type II conformance tests before actual decoding occurs. This preliminary action ensures interoperability is verified in advance, preventing runtime failures without requiring complex runtime checking mechanisms in decoders.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The encoder serves the decoder by embedding buffering period SEI messages and HRD parameters directly into the bitstream. This self-service approach provides the decoder with all necessary HRD initialization information, allowing the decoder to perform conformance testing without requiring additional complex validation logic or external reference implementations.

Inventive Principle:
Principle #25Self-service

2Reliability

If HRD conformance testing is performed during encoding, then decoding errors are reduced, but encoding time and computational resources increase

Engineering Contradiction:
Improvedecoding accuracyVSAvoidencoding time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The HRD conformance testing is performed as part of the encoding workflow, initializing the HRD buffer and performing type I (component-level) and type II (bitstream-level) conformance tests before final bitstream output. This preliminary validation prevents decoding errors by ensuring the bitstream will be correctly decoded, eliminating the need for post-encoding debugging and re-encoding cycles.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The conformance testing process provides feedback to the encoder about bitstream validity, allowing real-time adjustments to encoding parameters. The HRD buffer status and conformance test results feed back into the encoding process, enabling dynamic optimization that reduces overall encoding time by preventing invalid bitstream generation in the first place.

Inventive Principle:
Principle #23Feedback

3Reliability

If buffer management is strictly controlled through HRD parameters, then buffer under/over-runs are prevented, but flexibility in coding strategies is reduced

Engineering Contradiction:
Improvebuffer managementVSAvoidcoding flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The HRD buffer parameters (initial buffer fullness, bitrate, buffer size) are dynamically adjusted based on the specific V-PCC bitstream characteristics and decoding requirements. The conformance testing process allows different buffer management strategies to be tested and validated, enabling the system to adapt to different coding scenarios while maintaining buffer control through standardized HRD mechanisms.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different HRD parameter configurations can be tested during conformance testing to find optimal settings for specific applications. The system can modify buffer size, initial fullness, and bitrate parameters to balance between strict buffer control and coding flexibility, allowing the same HRD framework to support multiple coding strategies tailored to different use cases.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3981162B1Hypothetical reference decoder for v-pcc
Publication Date: 2024.09.25 HUAWEI TECH CO LTD
  • EP3981162B1 patent drawingFigure 1
  • EP3981162B1 patent drawingFigure 2
  • EP3981162B1 patent drawingFigure 3

AI summary

A video coding mechanism is disclosed. The mechanism includes encoding a sequence of point cloud compression (PCC) components into a bitstream. A buffering period supplemental enhancement information (SEI) message is also encoded into the bitstream. A hypothetical reference decoder (HRD) is initialized at a coded atlas access unit (AU) associated with the buffering period SEI message. A HRD conformance check of the bitstream is performed starting at the coded atlas AU. The bitstream is stored for communication toward a decoder.