Illumination Compensation Flag Derivation in Video Frame Rate Up-Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression technologies face challenges in managing the trade-off between coding efficiency and complexity, particularly in the use of Frame Rate Up-Conversion (FRUC) tools.
Innovation Solution
The proposed solution involves determining whether a FRUC prediction candidate corresponds to bi-direction temporal or bi-predictive candidates, setting illumination compensation flags based on these candidates, and encoding or decoding video blocks accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If FRUC tools are used to improve coding efficiency, then compression performance is improved, but encoding and decoding complexity increases
Solution Approach 1:
The patent enables the decoder to autonomously determine illumination compensation flags by analyzing candidate block types and reference picture relationships, eliminating the need for explicit encoder signaling. This self-determination mechanism maintains compression performance while reducing overall system complexity by distributing the computational burden to the decoder side where it can be efficiently managed.
Solution Approach 2:
The patent dynamically adjusts illumination compensation flag values based on the type of prediction candidate (bi-direction temporal vs. bi-predictive) and reference picture relationships. By changing these parameters adaptively rather than using fixed values, the system optimizes compression efficiency for different video content scenarios while maintaining manageable complexity through rule-based determination.
2Manufacturing precision
If multiple sub-tools with different parameters are used in FRUC, then coding precision is improved, but device complexity increases
Solution Approach 1:
The patent applies different illumination compensation flag determination rules based on the local characteristics of prediction candidates. Bi-direction temporal candidates use one set of rules, while bi-predictive candidates use another set, allowing each local case to be optimized independently without requiring a complex unified approach for all candidate types.
Solution Approach 2:
The patent segments the FRUC tool into distinct sub-tools (AMVP, Merge, Sub-part, Bilateral) with specific illumination compensation flag determination rules for each. This segmentation allows each sub-tool to be optimized independently with appropriate complexity-level rules, rather than requiring a single complex rule set for all operations.
3Measurement precision
If illumination compensation flags are explicitly signaled for all candidates, then measurement precision is improved, but loss of information increases due to additional bitrate
Solution Approach 1:
The patent extracts the illumination compensation flag determination logic from the encoder signaling process and relocates it to the decoder side. By taking out the explicit signaling requirement and replacing it with decoder-side derivation based on candidate block analysis, the system maintains measurement precision while eliminating bitrate overhead.
Solution Approach 2:
The patent copies illumination compensation flag values from reference picture candidates to current prediction blocks based on established relationships. Instead of transmitting new flag values, the system copies appropriate values from already-decoded reference data, maintaining accuracy while avoiding additional bitrate consumption.
Data Source
AI summary
Inferring an illumination compensation flag during encoding or decoding of a video image signal using frame rate up conversion can save one bit and eliminate complexity. The illumination compensation flag can be derived from the corresponding flags of at least one bi-predictive or bi-directional prediction candidates. The flag can also be derived from some function of the flags from those candidates. Alternatively, several flags can be used for respective coding or decoding of blocks if there are more than one prediction candidate using illumination compensation.