Transform Coefficient Buffer Reuse for Palette Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding systems face challenges in reducing implementation costs and improving system throughput, particularly in HEVC screen content coding, where palette coding techniques do not efficiently utilize system resources such as the transform coefficient buffer.

Innovation Solution

The method involves reusing the transform coefficient buffer for palette coding by storing palette-related information, including palette run type, indices, escape values, and flags, and grouping escape values and predictor initialization values for efficient encoding and decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the transform coefficient buffer is allocated separately for palette coding, then the reliability of palette coding is improved, but the device complexity and implementation cost increase

Engineering Contradiction:
Improvepalette coding reliabilityVSAvoidbuffer resource allocation
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The transform coefficient buffer is designed to serve multiple purposes: it stores transform coefficients for conventional prediction modes and palette-related information for palette coding mode. This multi-functional buffer eliminates the need for separate dedicated buffers, reducing implementation cost while maintaining reliable palette coding operations through proper buffer management and state clearing between different coding modes

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If escape values are coded individually for each pixel, then the measurement precision of pixel values is improved, but the productivity of encoding and decoding decreases

Engineering Contradiction:
Improvepixel value precisionVSAvoidencoding speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

Escape values for multiple pixels are grouped together and coded as a collective group rather than individually. The encoder identifies consecutive pixels requiring escape coding and transmits their values in a consolidated manner, while the decoder efficiently distributes these grouped values to the appropriate pixel positions, maintaining precise pixel representation while significantly improving encoding and decoding throughput

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If palette-related information is stored in dedicated memory, then the reliability of palette coding is improved, but the loss of substance in system memory increases

Engineering Contradiction:
Improvepalette coding reliabilityVSAvoidsystem memory usage
Core Design Contradiction:
ReliabilityVSLoss of substance

Solution Approach 1:

The transform coefficient buffer is repurposed to store palette-related information including palette indices, escape values, and run-length data during palette coding mode. This reuse of existing buffer infrastructure eliminates the need for additional dedicated memory allocation, reducing system memory consumption while ensuring reliable storage of all necessary palette coding data through appropriate buffer clearing and state management

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11457237B2Methods of escape pixel coding in index map coding
Publication Date: 2022.09.27 HFI INNOVATION INC
  • US11457237B2 patent drawing
  • US11457237B2 patent drawing
  • US11457237B2 patent drawing

AI summary

A method of video coding with reduced implementation cost by reusing transform coefficient buffer palette for palette coding is disclosed. If the current prediction mode is an Intra prediction mode or the Inter prediction mode, information related to transform coefficients for prediction residual of the current block resulted from Intra prediction or Inter prediction is stored in the transform coefficient buffer. If the current prediction mode is the palette coding mode, information related to palette data associated with the current block is stored in the transform coefficient buffer. The current block is then encoded or decoded based on the information related to the transform coefficients if the current block is coded in the Intra prediction mode or the Inter prediction mode, or the information related to the palette data stored in the transform coefficient buffer if the current prediction mode is the palette coding mode.