Cross-Component Chroma Prediction Using Deep Learning Matrices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression techniques struggle with high data volume and require improved coding efficiency as image sizes and resolutions increase, necessitating the integration of deep learning-based image processing to enhance prediction methods.
Innovation Solution
A video coding method and apparatus utilize a deep learning-based matrix operation to predict the chroma component of a current block using spatially adjacent luma components, forming a one-dimensional or two-dimensional vector and inputting it into an estimating model for improved prediction accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If deep learning-based matrix operation is used to predict chroma components from luma components, then coding efficiency is improved, but device complexity increases
Solution Approach 1:
The patent replaces traditional mechanical video coding operations with deep learning-based neural network operations. Specifically, it uses a neural network model to predict chroma components from luma components, substituting conventional matrix-based chroma prediction methods with learning-based approaches that automatically learn optimal prediction patterns from training data, thereby improving coding efficiency while managing complexity through specialized hardware acceleration
Solution Approach 2:
The patent changes the fundamental parameters of video coding by introducing deep learning models with learnable weights and biases. Instead of using fixed prediction parameters, the system trains neural networks to optimize prediction performance dynamically, allowing the model parameters to adapt and improve coding efficiency across different video content types and scenarios
2Measurement precision
If image size and resolution are increased, then image quality is improved, but data volume increases requiring more compression
Solution Approach 1:
The patent introduces deep learning-based chroma prediction as an intermediary process between luma and chroma components. The neural network acts as a mediator that generates predicted chroma values from luma inputs, reducing the actual chroma data that needs to be stored and transmitted. This intermediary prediction mechanism allows high-resolution video to be compressed more efficiently while maintaining image quality
Solution Approach 2:
The patent creates a learned copy of chroma information from luma components through neural network prediction. Instead of storing and transmitting full chroma data at high resolution, the system generates a predictive copy of chroma values based on luma inputs and learned patterns, significantly reducing data volume while preserving visual quality through the redundancy exploitation capability of deep learning models
Data Source
AI summary
A method and an apparatus for video coding using a matrix-based cross-component prediction are disclosed. The video coding method and apparatus predict a chroma component of a current block, by using a deep learning-based matrix operation, from a chroma component spatially adjacent to a chroma block of the current block and from a luma component spatially adjacent to a luma block corresponding to the chroma block.


