Cross-Component Chroma Prediction Using Deep Learning Matrices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression techniques struggle with high data volume and require improved coding efficiency as image sizes and resolutions increase, necessitating the integration of deep learning-based image processing to enhance prediction methods.

Innovation Solution

A video coding method and apparatus utilize a deep learning-based matrix operation to predict the chroma component of a current block using spatially adjacent luma components, forming a one-dimensional or two-dimensional vector and inputting it into an estimating model for improved prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If deep learning-based matrix operation is used to predict chroma components from luma components, then coding efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical video coding operations with deep learning-based neural network operations. Specifically, it uses a neural network model to predict chroma components from luma components, substituting conventional matrix-based chroma prediction methods with learning-based approaches that automatically learn optimal prediction patterns from training data, thereby improving coding efficiency while managing complexity through specialized hardware acceleration

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental parameters of video coding by introducing deep learning models with learnable weights and biases. Instead of using fixed prediction parameters, the system trains neural networks to optimize prediction performance dynamically, allowing the model parameters to adapt and improve coding efficiency across different video content types and scenarios

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If image size and resolution are increased, then image quality is improved, but data volume increases requiring more compression

Engineering Contradiction:
Improveimage qualityVSAvoiddata volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent introduces deep learning-based chroma prediction as an intermediary process between luma and chroma components. The neural network acts as a mediator that generates predicted chroma values from luma inputs, reducing the actual chroma data that needs to be stored and transmitted. This intermediary prediction mechanism allows high-resolution video to be compressed more efficiently while maintaining image quality

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a learned copy of chroma information from luma components through neural network prediction. Instead of storing and transmitting full chroma data at high resolution, the system generates a predictive copy of chroma values based on luma inputs and learned patterns, significantly reducing data volume while preserving visual quality through the redundancy exploitation capability of deep learning models

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12531973B2Method and apparatus for video coding using matrix based cross-component prediction
Publication Date: 2026.01.20 HYUNDAI MOTOR CO LTD
  • US12531973B2 patent drawing
  • US12531973B2 patent drawing
  • US12531973B2 patent drawing

AI summary

A method and an apparatus for video coding using a matrix-based cross-component prediction are disclosed. The video coding method and apparatus predict a chroma component of a current block, by using a deep learning-based matrix operation, from a chroma component spatially adjacent to a chroma block of the current block and from a luma component spatially adjacent to a luma block corresponding to the chroma block.