Flexible Reference Picture Management in Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codec standards lack flexibility in reference picture management, leading to inefficient coding and resource utilization during video encoding and decoding.
Innovation Solution
The implementation of a global reference picture set (GRPS) that keeps reference pictures in memory longer, along with the ability to clip and denoise reference pictures, to improve coding efficiency and memory utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If reference pictures are retained in memory for longer periods to improve coding efficiency, then coding efficiency is improved, but memory usage increases
Solution Approach 1:
The patent changes the temporal parameter of reference picture retention by introducing a global reference picture set that maintains reference pictures across random access boundaries, extending their availability beyond traditional frame boundaries to improve coding efficiency without proportionally increasing memory usage
2Measurement precision
If all reference picture regions are retained in memory to ensure complete reference information, then reference accuracy is improved, but memory usage increases
Solution Approach 1:
The patent applies local quality by selectively retaining only the necessary regions of reference pictures in the global reference picture set, rather than storing entire reference pictures. This allows the system to maintain reference accuracy for relevant areas while reducing memory consumption by discarding redundant regions
Data Source
AI summary
Innovations in flexible reference picture management are described. For example, a video encoder and video decoder use a global reference picture set (“GRPS”) of reference pictures that remain in memory, and hence are available for use in video encoding/decoding, longer than conventional reference pictures. In particular, reference pictures of the GRPS remain available across random access boundaries. Or, as another example, a video encoder and video decoder clip a reference picture so that useful regions of the reference picture are retained in memory, while unhelpful or redundant regions of the reference picture are discarded. Reference picture clipping can reduce the amount of memory needed to store reference pictures or improve the utilization of available memory by providing better options for motion compensation. Or, as still another example, a video encoder and video decoder filter a reference picture to remove random noise (e.g., capture noise due to camera imperfections during capture).