Video Coding Palette Mode Luma Chroma Separation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding standards face challenges in determining optimal palette-table sizes and predictor sizes for luma and chroma components, which affects coding efficiency and compression performance, especially in advanced standards like VVC/H.266 aiming for higher compression ratios.

Innovation Solution

The method involves determining whether luma and chroma components are coded jointly or separately in a palette mode, and based on this, calculating specific maximum palette-table and predictor sizes to enhance prediction and coding efficiency within the coding unit (CU).

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If luma and chroma components are coded separately in palette mode, then coding precision for each component is improved, but device complexity increases due to separate palette table management

Engineering Contradiction:
Improvecoding precisionVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the palette coding process into separate luma and chroma component handling. When separate coding is selected, independent palette tables and predictors are maintained for each component, allowing precise optimization for each color plane while managing complexity through structured separation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic selection between joint and separate palette coding modes. The encoder can adaptively choose the optimal mode based on content characteristics, and the decoder dynamically configures its processing path accordingly, balancing precision requirements against complexity constraints.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If joint palette coding is used for luma and chroma, then device complexity is reduced through unified palette management, but coding precision deteriorates due to shared palette constraints

Engineering Contradiction:
Improvedevice complexityVSAvoidcoding precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent merges the palette management for luma and chroma components into a single unified palette table when joint coding mode is selected. This shared palette structure reduces device complexity by eliminating redundant data structures and simplifying the encoding/decoding process, while still providing adequate precision for many practical scenarios.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically switches between joint and separate palette coding modes based on content analysis. When switching to separate coding, the precision is improved; when using joint coding, complexity is reduced. This dynamic adaptation resolves the contradiction by contextually selecting the appropriate approach.

Inventive Principle:
Principle #15Dynamics

3Productivity

If maximum palette-table size is increased, then coding efficiency is improved through better color representation, but transmission bandwidth increases due to larger palette data

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtransmission bandwidth
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent changes the palette-table size parameter adaptively based on the selected coding mode and content characteristics. When separate palette coding is used, larger palette sizes can be allocated to each component for improved efficiency. When joint coding is used, the total palette size is constrained to limit bandwidth consumption. This parameter adaptation resolves the contradiction between efficiency and bandwidth.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system dynamically adjusts the maximum palette-table size based on the operating mode. In separate coding mode, each component can utilize larger palettes for high efficiency. In joint coding mode, the palette size is dynamically constrained to reduce transmission bandwidth. This dynamic parameter adjustment balances coding efficiency against bandwidth consumption.

Inventive Principle:
Principle #15Dynamics

4Manufacturing precision

If separate palette predictors are maintained for luma and chroma, then prediction precision is improved, but memory usage increases for storing predictor data

Engineering Contradiction:
Improveprediction precisionVSAvoidmemory usage
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the predictor storage into separate luma and chroma predictor structures when separate palette coding is enabled. This segmentation allows each predictor to be optimized independently for its specific component, improving prediction precision while managing memory usage through structured organization and selective allocation.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11765361B2Method and apparatus for coding video data in palette mode
Publication Date: 2023.09.19 HFI INNOVATION INC
  • US11765361B2 patent drawing
  • US11765361B2 patent drawing
  • US11765361B2 patent drawing

AI summary

Methods for performing palette coding of video data may include: determining whether a luma component of a coding unit (CU) and chroma components of the CU are coded jointly or separately in a palette mode; and in response to the luma component and the chroma components being coded separately in the palette mode, determining a maximum separate palette-table size for the CU; determining a maximum separate palette-predictor size for the CU; and predicting the CU based on the maximum separate palette-table size and the maximum separate palette-predictor size.