Coding Unit Size Adaptive Palette Mode for Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing video compression systems, such as those using the HEVC palette mode, are inefficient when applying the full palette mode or palette-based residual refinement to all coding unit sizes, especially when a subset of intra/inter prediction tools is sufficient for small coding units.
Innovation Solution
Implementing a coding unit size adaptive approach that selectively applies the palette mode, palette-based residual refinement method, or prediction method based on the size of the coding unit, using a threshold to determine whether to generate a reconstructed block through prediction methods for smaller units or palette-based methods for larger units, thereby improving decoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the full palette mode or palette-based residual refinement method is applied to all coding units, then compression efficiency is improved for screen content, but decoding complexity and computational resources increase unnecessarily for small coding units where simple prediction tools are sufficient
Solution Approach 1:
The patent changes the parameter of coding unit size to determine the encoding method. Different encoding approaches (palette mode vs. prediction tools) are selected based on the size parameter of the coding unit, allowing the system to adapt complexity to the actual needs of each region.
Solution Approach 2:
The patent applies different encoding methods to different regions (coding units) based on their size characteristics. Small coding units use simple prediction tools while larger ones use palette mode, creating local optimization rather than a uniform approach across the entire image.
2Measurement precision
If the palette mode is applied to small coding units, then color representation accuracy is maintained, but computational overhead and processing time increase
Solution Approach 1:
The patent uses coding unit size as a threshold parameter to determine when to apply palette mode. By setting appropriate size thresholds, the system ensures palette mode is only used when it provides necessary color accuracy, avoiding unnecessary processing for small units where simple prediction suffices.
Solution Approach 2:
The patent applies palette mode selectively rather than universally. Instead of applying the full palette mode to all coding units (excessive action), it applies the method partially only to larger coding units where it provides meaningful benefits, reducing overall processing time while maintaining color accuracy where needed.
3Productivity
If coding unit size adaptive approach is implemented, then decoding efficiency is improved by reducing computational resources, but system complexity increases due to threshold-based decision logic
Solution Approach 1:
The patent introduces size threshold parameters to control the selection of encoding methods. These parameters provide a simple decision boundary that balances decoding efficiency with system complexity, allowing the system to adapt to different coding unit sizes without requiring complex analysis.
Data Source
AI summary
Systems and methods are provided for improving efficiency of decoding performance of a video compression system by selectively applying, based on the size of the coding unit, a prediction method, a palette mode, or palette-based residual refinement method which combines the palette mode and the traditional prediction methods comprising deriving a prediction block of a coding unit, decoding palette-based residual information of the coding unit, deriving a palette-based residual block based on the decoded palette-based residual information, and combining the prediction block and the palette-based residual block to construct a reconstructed block.