Decoded Picture Buffer Partial Output for Low-Latency Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards like HEVC require whole-picture output after all decoding units are processed, limiting fast access to partial decoded data, which is inadequate for applications needing immediate access to specific video objects.
Innovation Solution
Implement a decoder apparatus that allows partial output of decoded decoding units (DUs) before the entire picture is decoded, enabling applications to access and process partial decoded data during the decoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If whole-picture output is implemented after all decoding units are processed, then decoding completeness is ensured, but access speed to partial decoded data is reduced
Solution Approach 1:
The picture is divided into multiple independent decoding units (DUs), each of which can be decoded and output separately. This segmentation allows applications to access partial decoded data from individual DUs without waiting for the entire picture to be decoded, thereby improving access speed while maintaining decoding reliability through independent unit processing.
Solution Approach 2:
The system enables partial output of decoded data by allowing applications to access decoded DUs as soon as they are available, rather than waiting for complete picture decoding. This partial action principle allows early access to useful decoded portions while the remaining DUs continue to be decoded in parallel.
2Stability of the object's composition
If all decoding units must be processed before output, then data consistency is maintained, but processing time is increased
Solution Approach 1:
The system performs preliminary decoding and output of individual DUs before the entire picture decoding is complete. By preparing and making available decoded DUs in advance, the system reduces overall processing time while maintaining data consistency through proper synchronization mechanisms that ensure decoded DUs are stable and ready for application access.
3Speed
If partial output of decoding units is enabled, then fast access to decoded data is achieved, but system complexity is increased
Solution Approach 1:
The picture structure is segmented into independent decoding units that can be processed and output separately. This segmentation enables fast access to partial decoded data while managing system complexity by using standardized, reusable decoding components for each unit rather than requiring complex custom processing logic.
Data Source
AI summary
Methods and apparatus for processing an encoded representation of a sequence of pictures are disclosed, wherein the method includes: a processor of a decoding apparatus allocating memory for one or more pictures in a decoded picture buffer, DPB; the processor receiving a bitstream comprising an encoded representation of a current picture, the encoded representation of the current picture comprising a plurality of decoding units, DUs, each of the plurality of DUs comprising an encoded set of pixels; the processor storing the plurality of DUs of the current picture in a coded picture buffer, CPB; the processor decoding the plurality of DUs into decoded DUs of the current picture and storing the decoded DUs in the allocated memory of the DPB, the processor executing at least one partial output during the decoding of the plurality of DUs of the current picture, the performing of the at least one partial output including: copying one or more of the decoded DUs from the DPB to a data sink before all of the plurality of DUs are decoded, the one or more decoded DUs representing one or more areas of pixels in the current picture; determining output information comprising information about the one or more areas of pixels that are copied to the data sink and information for identifying the current picture; providing access to the output information for use by an application or an application programming interface, API, outside the decoding apparatus.