Decoded Picture Buffer Size Management for Video Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Advanced video coding standards like AVC/H.264 pose challenges in managing resources when picture resolution changes, as prior decoded pictures are not yet output, leading to inefficiencies in memory allocation and deallocation in video decoding processes.
Innovation Solution
A method is disclosed where a processing device allocates memory for a decoded picture buffer (DPB) based on the maximum picture resolution, adjusting the number of frame buffers dynamically according to the frame buffer size, allowing seamless transition between different picture resolutions without deallocating and reallocating memory, by using auxiliary information to determine the optimal DPB size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If memory is allocated based on maximum picture resolution, then memory availability is sufficient for all resolutions, but memory usage efficiency decreases when lower resolutions are decoded
Solution Approach 1:
The patent implements dynamic frame buffer sizing where the DPB adjusts the number and size of frame buffers based on the current picture resolution being decoded. When resolution changes, the system dynamically reallocates buffer resources without requiring complete deallocation and reallocation, optimizing memory usage for each specific resolution while maintaining availability for maximum resolution support.
Solution Approach 2:
The system changes the parameter of frame buffer size and quantity based on the decoded picture resolution. By monitoring resolution parameters and adjusting DPB configuration accordingly, the system transitions from static maximum-size allocation to adaptive parameter-based allocation, improving efficiency while maintaining reliability.
2Adaptability or versatility
If the number of frame buffers is fixed at maximum resolution requirements, then all resolutions can be supported, but transition efficiency between resolutions decreases due to deallocation and reallocation overhead
Solution Approach 1:
The patent prepares the DPB structure in advance to accommodate resolution changes by maintaining a pool of frame buffers that can be dynamically activated or deactivated. This preliminary configuration allows seamless transitions between resolutions without requiring deallocation and reallocation operations, as the buffer infrastructure is already in place and can be reconfigured efficiently.
Solution Approach 2:
The system enables dynamic adjustment of the number of active frame buffers based on current resolution requirements. When transitioning between resolutions, the DPB dynamically activates or deactivates specific buffers rather than performing complete deallocation and reallocation, thereby maintaining adaptability while improving transition efficiency.
3Measurement precision
If prior decoded pictures are retained in memory for reference, then decoding accuracy is improved, but memory consumption increases when pictures are not yet output
Solution Approach 1:
The patent implements a mechanism where frame buffers are discarded and recovered based on picture output status and reference requirements. When pictures are no longer needed for reference or have been output, their associated buffers are discarded and made available for reuse. This selective discarding and recovering optimizes the balance between retaining necessary reference pictures for decoding accuracy and freeing memory resources.
Solution Approach 2:
The system dynamically changes the retention parameter of decoded pictures in the DPB based on their reference utility and output status. By adjusting which pictures are retained and for how long, the system optimizes memory consumption while maintaining sufficient reference pictures for accurate decoding operations.
Data Source
AI summary
In one embodiment a method of video processing is disclosed. The method may include receiving by a processing device a first portion of compressed pictures of a bitstream, the first portion of compressed pictures corresponding to a first picture resolution format (PRF), the first portion of the compressed pictures comprising at least one picture compressed at a first encoding level, the first portion of the compressed pictures having an intended picture output as a sequence of pictures in the first PRF; determining a size of the largest picture of the first encoding level; determining a first number of picture buffers corresponding to the largest picture; allocating a linear memory based on the first number of picture buffers and size of the largest picture; determining a ratio of a picture size of the at least one picture of the first portion of the compressed picture and the largest picture size of the first encoding level; determining a second number of picture buffers based on the determined ratio; and mapping the second number of picture buffers in the first number of picture buffers.