Shared Chroma Neural Network Filtering in Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding techniques require separate neural network modes for different color components, leading to increased computational complexity and processing time.
Innovation Solution
Implementing a shared neural network mode for both chroma components, with a single filtering process for both color components, reducing the need for dual execution and complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate neural network modes are used for different color components, then filtering precision for each component can be optimized, but computational complexity and processing time increase
Solution Approach 1:
The patent merges the filtering processes for first and second chroma components by using a single shared neural network mode instead of separate modes. The syntax element indicates one filtering mode that is applied to both chroma components, combining what were previously separate operations into a unified process that reduces computational complexity while maintaining filtering effectiveness.
Solution Approach 2:
The patent implements universality by designing a single neural network mode that serves multiple functions - it filters both the first chroma component and the second chroma component. This universal filtering mode is indicated by a syntax element that applies to both components, allowing one mode to perform what previously required separate specialized modes.
2Measurement precision
If separate neural network modes are used for different color components, then component-specific filtering can be optimized, but processing time increases
Solution Approach 1:
The patent combines the filtering operations for multiple chroma components into a single unified process. By using one shared neural network mode indicated by a single syntax element, the processing time is reduced because the encoder and decoder perform filtering selection and execution fewer times compared to using separate modes for each component.
Solution Approach 2:
The patent establishes the shared neural network mode selection in advance through the syntax element, which defines the filtering mode for both chroma components simultaneously. This preliminary determination avoids the need for separate mode selections and executions for each component, thereby reducing overall processing time.
3Device complexity
If a shared neural network mode is used for both chroma components, then computational complexity decreases, but adaptability for component-specific optimization is reduced
Solution Approach 1:
The patent achieves universality by creating a single neural network mode that can effectively handle both chroma components. The syntax element indicates this universal mode that serves both components, providing adaptability through a unified approach rather than requiring separate component-specific modes, thus reducing complexity while maintaining versatility.
Data Source
AI summary
A method of processing video data includes receiving a syntax element that defines a filtering mode for a neural network (NN) model for both a first color component and a second color component, applying an instance of the NN model, in the defined filtering mode, to a first block of the first color component to generate a first filtered block, and storing the first filtered block for a coding unit (CU).