Content-Aware Chroma Prediction in Video Bitstream Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies, such as MPEG-2, MPEG-4, AVC, HEVC, and VVC, require further improvements in coding efficiency and performance, particularly in chroma prediction for image/video coding.

Innovation Solution

Implementing a method for video processing that determines whether to enable or disable coding tools based on content detection, utilizing techniques like slope adjustment for cross-component linear models, gradient-based prediction, multi-model LM modes, and extended MPM lists to enhance chroma prediction in video coding standards like HEVC and VVC.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional video coding technologies (MPEG-2, MPEG-4, AVC, HEVC, VVC) are used, then video compression is achieved, but coding efficiency and performance require further improvement

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcoding performance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements dynamic selection of chroma prediction tools (CCLM, PDPC, DBV) based on content detection and mode flags. The encoder and decoder adaptively enable or disable these tools for different video units based on detected content characteristics, allowing the system to optimize coding efficiency dynamically rather than using a fixed approach. This resolves the contradiction by making the coding system flexible and adaptive to different video content types.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent introduces multiple prediction parameters including CCLM mode flags, PDPC mode flags, DBV mode flags, and various prediction mode indices (intra_chroma_pred_mode). These parameters are dynamically adjusted and selected based on content detection results, enabling the system to change coding parameters adaptively to improve both coding efficiency and performance across different video content scenarios.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If chroma prediction tools are enabled for all video units, then coding performance improves, but coding complexity increases

Engineering Contradiction:
Improvecoding performanceVSAvoidcoding complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies different chroma prediction tools and modes to different local regions (video units) based on content detection. Instead of uniformly applying complex prediction tools across the entire video stream, the system selectively enables CCLM, PDPC, or DBV modes only for specific video units where they are most beneficial, as determined by content characteristics and mode flags. This localizes the complexity to where it provides maximum performance benefit.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements a hierarchical approach where basic chroma prediction is always applied, and additional prediction tools (CCLM, PDPC, DBV) are selectively added only when content detection indicates they would provide benefit. This partial application of advanced tools avoids the excessive complexity of always using all available tools while still achieving performance improvements where needed.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If content detection method is used to enable/disable coding tools, then coding efficiency improves, but processing time increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent performs content detection and determines the appropriate chroma prediction mode in advance during the encoding process, before actual chroma prediction is performed. The content detection analyzes video unit characteristics and pre-determines which prediction tools (CCLM, PDPC, DBV) should be enabled, storing this information in mode flags. This preliminary action allows the actual prediction to proceed efficiently without repeated detection overhead during decoding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where content detection results from encoding are used to set mode flags that guide both encoding and decoding operations. The decoder uses these pre-determined mode flags to quickly identify which prediction tools were applied without needing to perform its own content detection, thus maintaining coding efficiency improvements while minimizing the processing time penalty to only the encoding stage.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250358425A1Method, apparatus, and medium for video processing
Publication Date: 2025.11.20 DOUYIN VISION CO LTD
  • US20250358425A1 patent drawing
  • US20250358425A1 patent drawing
  • US20250358425A1 patent drawing

AI summary

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: determining, for a conversion between a video unit of a video and a bitstream of the video, whether to enable or disable a coding tool for the video unit based on a content detection method; and performing the conversion based on the determination.