Scalable Video Coding Upsampling with Phase Offset Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scalable video coding systems face challenges in accurately upsampling base layer video data to match the resolution of enhancement layers, particularly in maintaining proper luma/chroma color space positions and achieving precise inter-layer prediction, which affects compression performance.
Innovation Solution
The proposed solution involves a three-module upsampling process that selects input samples from the base layer, chooses appropriate filters from a set of fixed filters based on phase adjustments, and applies these filters to recreate video data at the enhancement layer resolution, using phase filtering to ensure accurate alignment and interpolation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If standard upsampling filtering is applied to base layer video data, then the resolution matches the enhancement layer, but the luma/chroma color space positions become misaligned and inter-layer prediction precision deteriorates
Solution Approach 1:
The patent applies parameter changes by introducing phase offset adjustments to the upsampling filter. Specifically, it modifies the filtering process by applying phase offsets to the base layer video data before upsampling, which changes the temporal positioning parameters of the filter. This allows the filtered enhancement layer to align properly with the base layer in terms of luma/chroma color space positions, thereby improving both measurement precision and manufacturing precision simultaneously.
Solution Approach 2:
The patent implements dynamics by making the upsampling filter adaptive rather than static. It dynamically adjusts the phase offset based on the specific video content and layer relationships. The filter selectively applies different phase offsets depending on the prediction mode and layer configuration, enabling the system to adapt to varying alignment requirements and maintain optimal precision across different scenarios.
2Productivity
If phase offset adjustment is implemented to improve color space alignment, then the computational complexity increases, but the compression performance improves
Solution Approach 1:
The patent applies local quality by selectively applying phase offset adjustments only where needed. Instead of uniformly processing all video data with complex phase adjustments, it identifies specific regions and prediction modes that benefit from phase offset correction and applies the adjustment locally. This targeted approach improves compression performance in critical areas while minimizing unnecessary computational overhead in other regions.
Solution Approach 2:
The patent implements partial action by applying phase offset adjustment only to specific enhancement layers and prediction modes rather than universally. It selectively enables phase offset correction based on the video content characteristics and layer relationships, performing the additional computational work only when it provides measurable compression performance benefits, thereby balancing complexity and productivity.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A process for determining the selection of filters and input samples is provided for scalable video coding. The process provides for re-sampling using video data obtained from an encoder or decoder process of a base layer (BL) in a multi-layer system to improve quality in Scalable High Efficiency Video Coding (SHVC). In order to accommodate other applications such as interlace/progressive scalability and to increase the resolution of the alignment between layers, it is proposed that the phase offset adjustment parameters be signaled.