Video Coding Reference Data Management via Selective Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face challenges in efficiently managing reference data for video decoding, leading to increased bandwidth and storage requirements due to the need to store and retrieve large amounts of data for accurate reconstruction of video frames.
Innovation Solution
The proposed solution involves processing circuitry that determines which data sets of reconstructed pictures to store as reference data based on control information, categorizing data into mutually exclusive categories such as sample and motion information, and managing memory spaces to store these categories separately, allowing for efficient storage and retrieval of reference data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If all reconstructed picture data is stored as reference data for accurate video decoding, then decoding accuracy is improved, but memory bandwidth usage and storage requirements increase significantly
Solution Approach 1:
The patent segments reference picture data into multiple categories (e.g., L0 reference pictures, L1 reference pictures, short-term references, long-term references) and manages each category separately with different retention policies. This allows the system to store only the most necessary reference data in high memory bandwidth areas while using lower bandwidth storage for less critical references, thereby reducing overall memory bandwidth usage while maintaining decoding accuracy.
Solution Approach 2:
The patent extracts and identifies only the essential reference data sets needed for accurate decoding from the complete set of reconstructed pictures. By analyzing prediction modes, motion vectors, and reference picture lists, the system determines which specific picture portions must be retained as reference data and separates them from non-essential data, storing only the extracted necessary portions to minimize memory bandwidth consumption.
2Measurement precision
If all reconstructed picture data is stored as reference data, then video reconstruction accuracy is improved, but storage space requirements increase
Solution Approach 1:
The patent applies different storage qualities and retention durations to different reference picture data based on their specific needs. Critical reference pictures used for high-priority prediction modes are stored with higher quality and longer retention, while less critical references use compressed or lower-resolution storage. This localized quality differentiation maintains video reconstruction accuracy for essential references while reducing overall storage space requirements.
3Quantity of substance
If reference data is selectively stored based on data category, then memory bandwidth usage is reduced, but system complexity increases
Solution Approach 1:
The patent implements dynamic reference picture management where the categorization and retention of reference data adapts based on current decoding requirements, picture types, and motion characteristics. The system dynamically adjusts which pictures are retained as references and in which memory categories based on real-time analysis of prediction modes and motion vectors, reducing memory bandwidth usage through intelligent selective storage while managing complexity through adaptive algorithms.
Data Source
AI summary
Aspects of the disclosure provide method and apparatus for video coding. In some examples, an apparatus includes processing circuitry. The processing circuitry decodes a first portion of video data to obtain first data of a first reconstructed picture, the first data including a first data set that corresponds to a first information category and a second data set that corresponds to a second information category. The processing circuitry determines whether to store at least one of the first data set and the second data set as reference data, and stores the at least one of the first data set and the second data set of the first reconstructed picture as the reference data based on the determination. The processing circuitry also decodes a second portion of the video data to obtain second data of a second reconstructed picture based on the stored reference data.