Multi-Layer Bitstream Conformance Checking via Picture Buffer Sizing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards like VVC face challenges in efficiently managing the processing power required for decoding multilayer video bitstreams, as decoders may need to handle the full toolset for each layer, leading to high computational complexity and memory requirements, which is impractical for many applications.
Innovation Solution
Implement a method to check bitstream conformance by determining the size of the decoded picture buffer required for a current output layer set and comparing it with the signaled level, ensuring that decoding can be achieved in real-time by parsing syntax elements and per-layer requirements, thereby optimizing decoder capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the full toolset is applied to the encoding of each layer in multilayer video, then compression performance is maintained, but the processing power required for decoding increases significantly
Solution Approach 1:
The patent segments the video content into multiple layers with different complexity levels, allowing the decoder to process only the necessary layers based on available resources. Each layer can be independently decoded, enabling flexible resource allocation while maintaining overall compression performance.
Solution Approach 2:
The patent implements partial action by allowing the decoder to process only a subset of the full toolset based on available processing power. The system can selectively apply coding tools to different layers, using full complexity only when resources permit, thereby reducing overall processing requirements while maintaining acceptable compression performance.
2Productivity
If multiple layers are decoded simultaneously in multilayer video, then compression efficiency is improved, but memory requirements increase
Solution Approach 1:
The patent divides the multilayer bitstream into separate layer streams that can be processed independently. This segmentation allows the decoder to manage memory requirements by processing layers in a controlled sequence rather than requiring all layers to be held in memory simultaneously, thus reducing peak memory usage while maintaining compression efficiency.
Solution Approach 2:
The patent performs preliminary analysis of the multilayer bitstream to determine the decoding requirements and memory needs before actual decoding begins. This allows the system to allocate memory resources efficiently and plan the decoding sequence to minimize peak memory requirements while still achieving the desired compression efficiency.
3Reliability
If conformance checking is performed on the entire multilayer bitstream, then decoding compliance is ensured, but computational complexity increases
Solution Approach 1:
The patent segments the conformance checking process into layer-specific checks rather than requiring a single comprehensive check of the entire multilayer bitstream. Each layer can be checked independently against its specific profile requirements, reducing the computational complexity of the overall conformance verification while ensuring complete decoding compliance.
Solution Approach 2:
The patent implements partial conformance checking by allowing the system to perform only the necessary checks based on the specific multilayer profile being used. Not all conformance checks need to be executed for every multilayer bitstream - only those relevant to the specific configuration, thereby reducing computational complexity while maintaining reliability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for bitstream conformance checking is disclosed. Information representative of a size of pictures contained in a same access unit and associated with a current output layer set is obtained (S500). For a level signaled for the current output layer set, a size of a decoded picture buffer is determined (S502) responsive to the obtained information. Bitstream conformance for the current output layer set is then checked (S504) by comparing the determined size of the decoded picture buffer with a size of the decoded picture buffer required for decoding the current output layer set.