Adaptive Color Transform in Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing High Efficiency Video Coding (HEVC) standard faces inefficiencies in video encoding and decoding, particularly due to the need for additional rate distortion optimization checks for adaptive color transform (ACT), which increases coding complexity and time, and may not provide benefits when color components are already de-correlated.

Innovation Solution

A method and system for video encoding that dynamically enables or disables the adaptive color transform (ACT) based on the correlation of color components within a coding unit, skipping unnecessary evaluations and transform unit size decisions for units with high correlation, thereby optimizing encoding efficiency and reducing processing time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If adaptive color transform (ACT) is enabled for all coding units, then video encoding quality improves through decorrelation of color components, but coding complexity and processing time increase due to additional rate distortion optimization checks

Engineering Contradiction:
Improvevideo encoding qualityVSAvoidcoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies ACT selectively to specific coding units based on local content characteristics rather than uniformly across all coding units. The encoder evaluates each coding unit to determine if ACT is beneficial, applying the transform only where color component decorrelation provides meaningful quality improvement. This local application approach maintains high encoding quality where needed while avoiding unnecessary complexity in regions where ACT would not provide benefit.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the application of ACT based on content analysis. The encoder performs rate distortion optimization checks to determine the optimal configuration for each coding unit, enabling or disabling ACT adaptively rather than using a static configuration. This dynamic approach allows the encoding system to respond to varying content characteristics, applying ACT only when it provides measurable quality improvement.

Inventive Principle:
Principle #15Dynamics

2Productivity

If adaptive color transform (ACT) is applied to all coding units, then color component decorrelation improves encoding efficiency, but processing time increases due to unnecessary evaluations for units with already de-correlated components

Engineering Contradiction:
Improveencoding efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies ACT partially rather than universally. By performing rate distortion optimization checks and selectively applying ACT only to coding units where it provides benefit, the encoder avoids the excessive action of applying ACT to all coding units regardless of need. This partial application reduces processing time by skipping unnecessary evaluations and transforms for coding units where ACT would not provide meaningful improvement.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent enables the encoder to skip unnecessary ACT evaluations and applications for coding units where color components are already de-correlated or where ACT would not provide benefit. By identifying such units through content analysis and rate distortion optimization checks, the encoder rushes through these regions without applying ACT, thereby reducing overall processing time while maintaining encoding efficiency in regions where ACT is beneficial.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentEP3104606B1Video encoding methods and systems using adaptive color transform
Publication Date: 2020.02.26 IND TECH RES INST
  • EP3104606B1 patent drawingFigure 1A
  • EP3104606B1 patent drawingFigure 1B
  • EP3104606B1 patent drawingFigure 1C

AI summary

A video encoding method includes receiving a source video frame, dividing the source video frame into a coding tree unit, determining a coding unit from the coding tree unit, enabling or disabling a coding mode of the coding unit, determining, if the coding mode is enabled, whether to evaluate a size of a transform unit for the enabled coding mode, and determining a transform unit of the coding unit for the enabled coding mode, wherein the size of the coding unit is defined by a number (N) of samples.