Distributed Decoding Refresh for Low-Latency Random Access Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in achieving low delay and efficient bit-rate management without relying on intra random access point (IRAP) pictures, leading to high bit-rate spikes and increased latency, particularly in applications like multi-party teleconferencing.
Innovation Solution
Distribute coded video data units of an intra-coded picture among other pictures using sub-units, allowing random access and refresh without IRAP pictures, reducing bit-rate fluctuations and latency through high-level syntax modifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If intra random access point (IRAP) pictures are used to enable random access and refresh, then random access capability is improved, but bit-rate spikes and latency increase
Solution Approach 1:
The patent segments the intra-coded picture into multiple sub-units and distributes them across multiple other pictures instead of concentrating all intra-coded data in a single IRAP picture. This segmentation allows random access functionality to be distributed across multiple smaller units, reducing the bit-rate burden on any single picture while maintaining overall random access capability.
Solution Approach 2:
The patent transitions from a temporal dimension approach (using sequential IRAP pictures at specific time points) to a spatial distribution approach (distributing sub-units across multiple pictures in the same or different temporal locations). This dimensional shift allows random access to be achieved through spatial distribution rather than temporal concentration, reducing bit-rate spikes.
2Adaptability or versatility
If intra random access point (IRAP) pictures are used to enable random access and refresh, then random access capability is improved, but latency increases
Solution Approach 1:
By segmenting the intra-coded picture into sub-units distributed across multiple pictures, the patent eliminates the need to wait for a complete IRAP picture to be decoded before accessing any portion of the content. Users can access distributed sub-units as they become available in different pictures, significantly reducing access latency.
Solution Approach 2:
The patent performs preliminary distribution of intra-coded sub-units across multiple pictures in advance, so that when random access is needed, the required sub-units are already positioned in accessible pictures rather than requiring waiting for a future IRAP picture.
3Quantity of substance
If distributed decoding refresh is implemented to reduce bit-rate and latency, then bit-rate management is improved, but implementation complexity increases due to low-level modifications
Solution Approach 1:
The patent segments the intra-coded picture into sub-units that can be independently distributed and decoded, allowing the decoding process to handle smaller, more manageable units rather than requiring complex low-level modifications to the entire decoding architecture.
Solution Approach 2:
The patent implements distributed decoding refresh at the syntax level (high-level) rather than requiring low-level modifications to the decoding engine. This dimensional shift in where the implementation occurs simplifies the actual decoding process while achieving bit-rate reduction goals.
Data Source
AI summary
A method of video encoding a sequence of pictures, the method being implemented in an encoding device and comprising: obtaining an intra prediction picture comprising at least two sub-units; obtaining a first encoded other picture, wherein the intra prediction picture and the first encoded other picture have the same Picture Order Count, POC, value; obtaining encoded other pictures different from the intra prediction picture and the first encoded other picture; and distributing the at least two sub-units of the intra prediction picture over one or more sub-units of the encoded other pictures and/or over one or more sub-units of the first encoded other picture.