High-Layer Syntax Architecture for Efficient, Error-Resilient Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding and decoding technologies face challenges in maintaining error resilience and coding efficiency due to the shift away from independent decodability of slices, which are less effective in modern network architectures and prediction mechanisms.
Innovation Solution
A high-level syntax architecture is introduced that includes a single Decoder Parameter Set (DPS) applicable to multiple coded video sequences, activated before decoding any picture, along with Picture Parameter Sets and Picture Headers, to enhance error resilience and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single Decoder Parameter Set is used for multiple coded video sequences, then coding efficiency is improved through parameter reuse, but error resilience may be compromised if the shared parameter set is lost
Solution Approach 1:
The patent applies preliminary action by sending redundant copies of the Decoder Parameter Set in advance before they are actually needed for decoding. This allows the parameter sets to be reliably received and stored before any potential loss events occur during transmission, thus maintaining both coding efficiency through reuse and error resilience through redundancy
Solution Approach 2:
The patent implements beforehand cushioning by creating redundant copies of the Decoder Parameter Set that can serve as backup if the original is lost during transmission. This cushioning mechanism ensures that even if one copy is lost, the decoder can still function using the redundant copy, thus protecting against errors while maintaining parameter reuse benefits
2Reliability
If redundant copies of parameter sets are sent in advance, then error resilience is improved, but bandwidth consumption increases
Solution Approach 1:
The patent applies local quality by sending redundant copies of parameter sets only at specific locations in the bitstream where they are most needed for error protection, rather than uniformly duplicating them throughout. This selective redundancy approach maintains error resilience while minimizing unnecessary bandwidth consumption in regions where redundancy is less critical
3Adaptability or versatility
If syntax elements are included in multiple redundant copies in each slice header, then independent decodability of slices is achieved, but bit cost increases
Solution Approach 1:
The patent applies preliminary action by placing syntax elements in the Decoder Parameter Set that is sent in advance, rather than repeating them in each slice header. This allows slices to be independently decodable while avoiding the bit cost of redundant copies, as the parameter set is established beforehand and can be referenced by multiple slices
Data Source
AI summary
A method of and a device for decoding a video stream including at least two coded video sequences that each use a respective first parameter set that differ in at least one value from each other, and each of the at least two coded video sequences including at least two coded pictures, and the at least two coded video sequences have different presentation times. The method including decoding and activating, by a decoder, a single second parameter set pertaining to all video sequences of the video stream before any coded picture of the at least two coded video sequences is decoded.