Shared Buffer Inheritance for Cross-Component Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing video coding standards, such as VVC, face challenges in managing the size and processing of virtual pipeline data units (VPDUs) due to the increased complexity introduced by ternary and binary tree partitions, leading to inefficiencies in hardware decoders, particularly with intra chroma blocks and cross-component prediction modes, which affect processing throughput and buffer management.
Innovation Solution
The implementation of a cross-component linear model (CCLM) and convolutional cross-component model (CCCM) for predicting chroma samples based on reconstructed luma samples, along with slope adjustments and multiple model variants, to optimize chroma prediction and reduce redundancy, while using shared buffer resources for coding tools in video coding systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If ternary and binary tree partitions are used to increase coding flexibility, then coding efficiency is improved, but VPDU size increases and hardware processing throughput deteriorates
Solution Approach 1:
The patent segments the chroma prediction process into multiple stages: first predicting chroma blocks of a first size using ternary tree partitions, then predicting chroma blocks of a second size using binary tree partitions. This segmentation allows the system to handle different block sizes appropriately, preventing VPDU size from becoming excessively large while maintaining coding efficiency through flexible partitioning.
2Productivity
If cross-component prediction modes are implemented to improve chroma prediction, then coding efficiency is improved, but buffer resource management becomes more complex
Solution Approach 1:
The patent implements a universal buffer management approach where the same buffer structure is used for storing both luma and chroma prediction data, as well as for storing data from different partition types (ternary and binary tree partitions). This multi-functional buffer design simplifies resource management while supporting the enhanced cross-component prediction modes that improve coding efficiency.
3Measurement precision
If intra chroma blocks are processed with multiple prediction modes, then prediction accuracy is improved, but processing throughput deteriorates
Solution Approach 1:
The patent dynamically selects between different prediction modes (ternary tree partition mode and binary tree partition mode) based on the specific characteristics of each chroma block. This dynamic adaptation allows the system to use more accurate prediction modes when needed while maintaining high processing throughput by using simpler modes when appropriate, thus resolving the contradiction between prediction accuracy and processing throughput.
Data Source
AI summary
A method and apparatus for video coding using shared buffer to store coding information among multiple coding tools including a cross-component model. According to the method, input data associated with a current block comprising a first-colour block and a second-colour block are received, wherein the input data comprise pixel data to be encoded at an encoder side or coded data associated with the current block to be decoded at a decoder side. The current block is encoded or decoded using a cross-component prediction mode. After said encoding or decoding the current block, CCM (Cross-Component Mode) information associated with the cross-component prediction mode is stored in a shared buffer shared with at least another coding tool for storing second coding information associated with said at least another coding tool, wherein the CCM information and the second coding information are used as model inheritance for encoding or decoding of subsequence video data.