Scalable Video Reference Picture Marking for Memory Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current scalable video coding standards, such as SVC, inefficiently manage reference pictures in the decoded picture buffer, leading to unnecessary memory occupation due to the synchronized marking process of base and enhanced representations, which results in wasted memory slots.
Innovation Solution
Implement a modified sliding window reference picture marking process and an adaptive reference picture marking process that allow for separate and independent marking of base and enhanced representations, enabling more efficient memory management by prioritizing the marking of unused references.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If synchronized marking process of base and enhanced representations is used, then decoding complexity is reduced, but memory occupation increases due to wasted memory slots
Solution Approach 1:
The patent segments the reference picture buffer management into separate marking processes for base layer representations and enhancement layer representations. This allows independent control of reference picture retention for each layer type, enabling the decoder to retain only necessary reference pictures and release others, thereby reducing memory occupation while maintaining decoding simplicity through structured separation of marking operations.
2Quantity of substance
If separate marking of base and enhanced representations is implemented, then memory efficiency is improved, but device complexity increases
Solution Approach 1:
The patent introduces dynamic adaptive marking processes that adjust reference picture retention based on layer type, prediction mode, and temporal level. The marking process dynamically determines which representations to retain or release by evaluating specific conditions (e.g., whether a picture is used for inter-layer prediction, temporal scalability requirements), allowing memory efficiency optimization without requiring complex static structures.
3Reliability
If all layers are fully decoded for reference picture management, then prediction accuracy is improved, but decoding complexity increases
Solution Approach 1:
The patent applies local quality differentiation by treating base layer and enhancement layer representations differently in the reference picture buffer. Base layer representations are retained when needed for inter-layer prediction, while enhancement layer representations are selectively retained or released based on specific prediction requirements. This localized differentiation ensures prediction accuracy is maintained only where necessary, reducing overall decoding complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A device, an encoding method, and a decoding method enable a separate marking of base representations and enhanced representations of key access units to save memory or to allow a better scalable video coding optimization. The encoding method of a sequence of original pictures to a sequence of access units includes, after encoding of one of the access units, storing a first decoded picture of the first encoded picture and a second decoded picture of the second encoded picture for inter prediction for encoding of others of the access units; and identifying the first decoded picture and the second decoded picture to be no longer used for inter prediction. The decoding method includes decoding the first access unit, where a first decoded picture is decoded from the first picture and a second decoded picture is decoded from the second picture; marking the first and second decoded pictures as used for inter prediction; decoding the second access unit; and marking one of the first and second decoded pictures as no longer used for inter prediction.