High Layer Video Syntax With Persistent Decoder Parameter Sets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding and decoding technologies face challenges in maintaining good error resilience properties while achieving coding efficiency, particularly due to the shift away from independent decodability of slices and the inefficiencies in sending redundant parameter sets.
Innovation Solution
A high level syntax architecture is introduced that includes a single Decoder Parameter Set (DPS) applicable to multiple video sequences, with Picture Parameter Sets and Picture Headers that can change per picture, and a persistent Decoder Parameter Set that remains constant throughout the video stream, enhancing error resilience and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single Decoder Parameter Set is used across multiple video sequences, then coding efficiency is improved and redundant transmissions are reduced, but error resilience may be compromised if the single parameter set is lost
Solution Approach 1:
The parameter set architecture is segmented into two distinct types: Decoder Parameter Sets (DPS) that are persistent and applicable to multiple video sequences, and Picture Parameter Sets (PPS) that are specific to individual pictures. This segmentation allows the system to maintain a single persistent parameter set for coding efficiency while having picture-specific parameter sets that can be independently transmitted and lost without affecting the persistent DPS
Solution Approach 2:
Different parameter sets are assigned different persistence and transmission characteristics based on their local requirements. The DPS is transmitted once and persisted for multiple sequences (local quality of persistence), while PPS is transmitted per picture with picture-specific values (local quality of variability). This allows optimization for both coding efficiency and error resilience in appropriate locations
2Reliability
If redundant copies of parameter sets are sent over lossy channels, then error resilience is improved, but bitrate consumption increases
Solution Approach 1:
The Decoder Parameter Set is transmitted and activated in advance before the video sequences it will govern. This preliminary action ensures the DPS is available in the decoder before needed, allowing it to be reused across multiple sequences without retransmission. This eliminates the need for continuous redundant transmission of the same parameter set
Solution Approach 2:
The system allows picture-specific parameter sets to be discarded (not persisted) while maintaining the persistent decoder parameter set. If a PPS is lost, the decoder can recover by using default values or inheriting from the persistent DPS, while the DPS itself remains available for recovery across multiple sequences
Data Source
AI summary
A method of and a device for decoding a video stream including at least two coded video sequences that each use a respective first parameter set that differ in at least one value from each other, and each of the at least two coded video sequences including at least two coded pictures, and the at least two coded video sequences have different presentation times. The method including decoding and activating, by a decoder, a single second parameter set pertaining to all video sequences of the video stream before any coded picture of the at least two coded video sequences is decoded.