Merge Mode Coding for Video Data Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increased number of merge modes in video coding standards like HEVC and VVC leads to inefficiencies in signaling information from video encoders to decoders, resulting in higher bandwidth utilization and processing power consumption.
Innovation Solution
The techniques categorize merge modes by type and prioritize higher probability modes in the binarization tree, allowing for efficient signaling and parsing, which enables a video encoder to determine the merge mode type used for a block of video data, reducing decoding latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the number of merge modes is increased to improve video coding performance, then coding efficiency is improved, but signaling bandwidth utilization increases and processing power consumption increases
Solution Approach 1:
The patent segments the merge mode selection process into multiple stages: first determining whether to use merge mode with motion vector difference (MVD), and if not, then determining whether to use merge mode without MVD. This segmentation allows the decoder to efficiently parse only the necessary information based on the actual mode used, reducing unnecessary processing and bandwidth utilization while maintaining support for multiple merge mode types
Solution Approach 2:
The patent introduces dynamic syntax element signaling where the presence and type of merge mode indicators are adapted based on the actual merge mode selected for each block. The encoder dynamically selects which syntax elements to signal (e.g., merge_with_mvd_flag, merge_without_mvd_flag) based on the chosen merge mode, allowing the system to adapt the signaling overhead to the actual coding needs rather than always signaling all possible modes
2Adaptability or versatility
If multiple merge modes are supported to improve coding flexibility, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent divides the merge mode indication into separate syntax elements for different merge mode types (merge_with_mvd_flag for merge mode with motion vector difference, merge_without_mvd_flag for merge mode without motion vector difference). This segmentation allows the decoder to independently process each flag type and reduce complexity by only activating the relevant processing path based on which flag is set, rather than handling all merge modes uniformly
Solution Approach 2:
The patent uses flag syntax elements as intermediaries between the encoder and decoder to indicate merge mode selection. These flags serve as simple binary indicators that mediate the complex merge mode information, allowing the decoder to determine the appropriate processing path without directly handling the full complexity of multiple merge mode types. The flags act as a simplified interface that reduces the computational burden while maintaining full merge mode functionality
Data Source
AI summary
An example device for coding video data determines for a first block of the video data whether to use a sub-block merge mode. Based on the determination not to use the sub-block merge mode for the first block, the device determines whether to use a merge mode with blending for the first block. Based on the determination to use the merge mode with blending for the first block, the device codes the first block with the merge mode with blending.