In-loop Reshaping Palette Mode Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video processing technologies face challenges in efficiently managing bandwidth demand due to the increasing use of high-resolution video, particularly in digital communication networks, where existing video compression methods struggle to optimize coding efficiency and adapt to varying video formats.
Innovation Solution
The implementation of in-loop reshaping (ILR) techniques for video processing, which include refining motion information, scaling chroma residue in a luma-dependent manner, and applying various coding modes such as palette mode, intra block copy mode, and transform skip mode, to enhance compression performance across existing and future video standards like HEVC.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If in-loop reshaping is applied to improve coding efficiency, then bandwidth usage is optimized, but device complexity increases
Solution Approach 1:
The video processing system is segmented into distinct functional modules: motion information refinement module, domain conversion module, palette mode coding module, and in-loop reshaping module. Each module handles a specific aspect of the processing pipeline independently, allowing the system to achieve high coding efficiency through specialized processing while managing complexity through modular architecture.
Solution Approach 2:
The patent introduces domain conversion between first domain and second domain representations of video blocks. This dimensional transformation enables the application of palette mode coding and in-loop reshaping operations that improve compression efficiency by exploiting different statistical properties of video data in transformed domains.
2Productivity
If motion information refinement is performed to improve prediction accuracy, then coding efficiency improves, but processing time increases
Solution Approach 1:
Motion information refinement is performed as a preliminary step before domain conversion and palette mode coding. By pre-refining motion information using bilateral filtering or gradient-domain techniques, the system establishes accurate motion vectors that guide subsequent processing stages, reducing the need for iterative adjustments and minimizing overall processing time.
Solution Approach 2:
The system employs feedback mechanisms where refined motion information from previous processing stages is fed into subsequent stages. The motion refinement process uses feedback from prediction error analysis to iteratively improve motion vector accuracy, ensuring high coding efficiency while converging quickly to optimal results.
3Productivity
If palette mode is used for video block coding, then compression ratio improves, but computational complexity increases
Solution Approach 1:
Palette mode is applied selectively to specific video blocks based on their local characteristics. The system identifies regions suitable for palette coding (e.g., regions with limited color variation) and applies palette mode only to those blocks, while using other coding modes for blocks requiring higher fidelity. This localized application improves compression ratio for suitable blocks without unnecessarily increasing complexity across the entire video stream.
Solution Approach 2:
The system dynamically adjusts palette parameters such as palette size, palette generation method, and entry selection based on the statistical properties of each video block. By adapting these parameters to match the local characteristics of the video content, the system achieves high compression ratios while minimizing the computational overhead associated with palette mode processing.
Data Source
AI summary
A method for video processing is provided to include: making a determination that a coding mode is enabled for a conversion between a current video block of a video and a coded representation of the video; and performing the conversion using a palette prediction mode wherein at least a palette of representative sample values is used for the current video block, and wherein, in the coding mode, the current video block is constructed based on samples in a first domain and a second domain and/or chroma residue is scaled in a luma-dependent manner.