Encoder And Decoder HRD Signaling for Temporal Sub-Layer Timing Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing increasing amounts of digital video data, particularly in optimizing encoding and decoding processes to improve image quality, reduce processing load, and enhance scalability.
Innovation Solution
An encoder and decoder system that encodes and decodes hypothetical reference decoder (HRD) parameters into supplemental enhancement information (SEI) messages on a per temporal sub-layer basis, allowing for precise control of decoding timings and improved scalability, especially in temporal sub-layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video coding technology processes increasing amounts of digital video data using conventional standards, then processing capacity is maintained, but encoding efficiency and image quality improvement become insufficient
Solution Approach 1:
The video stream is divided into multiple temporal sub-layers with different resolutions and frame rates. Each sub-layer is encoded independently with its own HRD parameters, allowing efficient processing of high-volume data while maintaining quality options for different application scenarios
Solution Approach 2:
Temporal scalability is introduced as an additional dimension to the encoding system. By encoding multiple temporal sub-layers (e.g., low temporal resolution sub-layer and high temporal resolution sub-layer), the system can process large amounts of data efficiently while providing quality differentiation across temporal dimensions
2Productivity
If conventional video coding standards are used, then processing existing data volumes is adequate, but processing load increases with larger data amounts
Solution Approach 1:
The video data is segmented into multiple temporal sub-layers with different complexity levels. Each sub-layer can be processed independently, distributing the processing load across multiple streams rather than handling the entire high-volume data as a single complex stream
Solution Approach 2:
Different temporal sub-layers are assigned different quality levels and processing priorities. The low temporal resolution sub-layer uses simpler processing while the high temporal resolution sub-layer uses more sophisticated processing, optimizing the overall processing load for large data volumes
3Device complexity
If temporal scalability is implemented without per temporal sub-layer HRD parameter encoding, then system complexity is reduced, but decoding timing control precision deteriorates
Solution Approach 1:
HRD parameters are segmented and encoded separately for each temporal sub-layer rather than using a single set of parameters for all layers. This allows precise control of decoding timing for each sub-layer independently, achieving high precision timing control while maintaining manageable system complexity through structured parameter organization
4Measurement precision
If HRD parameters are encoded per temporal sub-layer, then decoding timing control and scalability are improved, but encoding complexity increases
Solution Approach 1:
The HRD parameter encoding structure is designed to be universal across different temporal sub-layers. The same encoding framework and parameter sets are reused for each sub-layer, reducing encoding complexity despite the increased precision and number of parameters. This multi-functional approach allows the system to handle multiple sub-layers with consistent processing rules
Data Source
AI summary
An encoder includes circuitry and memory coupled to the circuitry. In operation, the circuitry encodes, per temporal sub-layer, one or more hypothetical reference decoder (HRD) parameters into an HRD-related supplemental enhancement information (SEI) message, the one or more HRD parameters being one or more parameters for an HRD, the one or more parameters being related to a decoding unit, the HRD-related SEI message being an SEI message related to the HRD.