Video Encoder SEI Structure for Temporal Sub-Layer HRD Parsing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing the increasing amount of digital video data across various applications, particularly in simplifying the parsing of hypothetical reference decoder (HRD)-related information for temporal sub-layers.
Innovation Solution
An encoder and decoder that store and encode/decode the total number of temporal sub-layers in a bitstream using either a picture timing supplemental enhancement information (SEI) message or a buffering period SEI message, eliminating the need for separate messages for each sub-layer, thereby simplifying the parsing of HRD-related information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If separate SEI messages are used for each temporal sub-layer, then complete HRD information is provided for each sub-layer, but the parsing complexity and processing overhead increase
Solution Approach 1:
The patent combines multiple SEI messages containing HRD information for different temporal sub-layers into a single unified SEI message. This message includes a total number of temporal sub-layers field and buffer occupancy fields that aggregate HRD information across all sub-layers, eliminating the need for separate messages and reducing parsing complexity while maintaining complete HRD information.
Solution Approach 2:
The unified SEI message structure is designed to serve multiple temporal sub-layers simultaneously. The buffer occupancy fields and HRD parameters are defined to represent aggregate states across all sub-layers, making the message universally applicable to any number of temporal sub-layers without requiring separate specialized messages for each.
2Loss of information
If separate SEI messages are used for each temporal sub-layer, then detailed buffer occupancy information is available for each sub-layer, but the bitstream size and processing overhead increase
Solution Approach 1:
The patent merges multiple buffer occupancy SEI messages into a single message that contains aggregate buffer occupancy information for all temporal sub-layers. This unified approach reduces the total bitstream size by eliminating redundant message headers and syntax elements while preserving the essential HRD information needed for decoding.
Solution Approach 2:
The patent introduces new parameter definitions for aggregate buffer occupancy that change from individual sub-layer specific parameters to unified parameters representing the total buffer state. This parameter transformation allows the same information to be conveyed more efficiently with fewer bits.
3Loss of information
If multiple SEI messages are transmitted for temporal sub-layers, then comprehensive timing information is provided, but the parsing efficiency and processing speed decrease
Solution Approach 1:
The patent combines multiple SEI messages containing timing and HRD information into a single integrated message structure. This consolidation reduces the number of parsing operations required by the decoder, improving processing efficiency while maintaining all necessary timing information for accurate reconstruction of temporal sub-layer synchronization.
Data Source
AI summary
An encoder includes memory and circuitry coupled to the memory. The circuitry stores a total number of temporal sub-layers in a bitstream Into either a picture timing supplemental enhancement information (SEI) message or a buffering period SEI message, and encodes the total number of the temporal sub-layers.