Palette Mode Video Coding With Adaptive Color Transform

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding technologies face challenges in efficiently processing and compressing digital video data, particularly in managing bandwidth demand and optimizing processing throughput, especially with the increasing number of connected devices and complex video formats.

Innovation Solution

The implementation of a palette mode in video processing that uses a palette of representative sample values for video blocks, with adaptive color transform and transform skip residual coding tools, along with optimized chroma deblocking and interpolation filters, to enhance coding efficiency and processing throughput.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a palette mode with representative sample values is used for video blocks, then coding efficiency is improved and bandwidth demand is reduced, but processing complexity increases due to adaptive color transform and transform skip residual coding

Engineering Contradiction:
Improvebandwidth demandVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The video block is segmented into a palette of representative sample values, where only the palette indices are transmitted instead of full pixel data. This segmentation reduces bandwidth demand while the adaptive color transform and transform skip residual coding handle the complexity of reconstructing the original video data from these segmented palette representations.

Inventive Principle:
Principle #1Segmentation

2Productivity

If adaptive color transform and transform skip residual coding tools are implemented, then coding efficiency is enhanced, but device complexity and processing overhead increase

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprocessing overhead
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The adaptive color transform and transform skip residual coding are implemented as dynamic, selectable tools rather than fixed processes. The encoder can adaptively choose whether to apply these transforms based on the specific video content and block characteristics, enhancing coding efficiency when beneficial while avoiding unnecessary processing overhead when not needed.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If chroma deblocking and interpolation filters are optimized, then video quality is improved, but processing time and computational load increase

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

Chroma deblocking and interpolation filters are optimized and pre-configured to be applied early in the decoding process, before final picture reconstruction. This preliminary action ensures video quality is maintained from the outset, reducing the need for subsequent corrective processing and thereby reducing overall processing time despite the initial computational load.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240107037A1Palette Mode For Local Dual Tree
Publication Date: 2024.03.28 BYTEDANCE INC
  • US20240107037A1 patent drawing
  • US20240107037A1 patent drawing
  • US20240107037A1 patent drawing

AI summary

Video processing methods, systems and appratrus are described. One example method includes performing a conversion between a video block of a video and a bitstream of the video using a palette mode in which samples of the video block are represented using a palette of representive color values. A size of the palette of the video block is determined based on whether a local dual tree is applied for the conversion.