Scaled Reference Layer Offsets for Scalable Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scalable video coding systems face challenges in efficiently upsampling base layer video data to match the resolution of enhancement layers, particularly in achieving accurate spatial scalability and minimizing errors in the upsampling process.
Innovation Solution
The proposed solution involves a three-module upsampling process that selects input samples from the base layer, chooses appropriate filters based on phase shifts, and applies these filters to recreate video data at the enhancement layer resolution, utilizing a mapping between sample positions in both layers to ensure accurate interpolation and efficient encoding/decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If upsampling filtering is applied to the base layer to match enhancement layer resolution, then spatial scalability is improved, but computational complexity and processing time increase
Solution Approach 1:
The upsampling process is divided into three separate modules: a first module to select input samples from the base layer video signal, a second module to select a filter from a set of filters based on phase information, and a third module to apply phase filtering. This segmentation allows each module to perform a specific function efficiently, reducing overall processing complexity while maintaining accuracy.
Solution Approach 2:
The patent pre-calculates and stores multiple filter sets with different phases before the actual upsampling operation. During encoding/decoding, the appropriate filter is selected based on pre-determined phase information rather than calculating filters in real-time. This preliminary preparation significantly reduces computational complexity during the actual upsampling process.
2Manufacturing precision
If multiple filter sets with different phases are used for upsampling, then upsampling accuracy is improved, but memory requirements and data storage increase
Solution Approach 1:
Different filter sets with different phases are applied locally based on the specific phase requirements of each upsampling operation. Rather than storing all possible filters indefinitely, the system selects and applies only the specific filter phase needed for the current base-to-enhancement layer resolution conversion, optimizing memory usage while maintaining accuracy.
Solution Approach 2:
The patent implements a mechanism where filter sets are discarded after use and can be recovered or regenerated as needed. Instead of permanently storing all filter sets, the system can regenerate filters using predefined algorithms when different phase requirements arise, reducing long-term storage requirements while maintaining the capability to access multiple filter phases.
3Productivity
If a three-module upsampling process is implemented, then encoding efficiency is improved, but device complexity increases
Solution Approach 1:
The three-module upsampling structure is designed to be universal and can be applied to any base layer to enhancement layer resolution conversion scenario. The same module architecture handles different resolution ratios, different filter types, and different phase requirements, making the increased structural complexity worthwhile by providing a unified efficient solution across multiple use cases.
Solution Approach 2:
The upsampling system is designed to automatically select appropriate filters and parameters based on the input base layer and target enhancement layer specifications. The modules self-configure based on the resolution ratio and phase information without requiring manual intervention or complex external control logic, improving encoding efficiency while keeping the control structure relatively simple.
Data Source
AI summary
A process for determining the selection of filters and input samples is provided for scalable video coding. The process provides for re-sampling using video data obtained from an encoder or decoder process of a base layer (BL) in a multi-layer system to improve quality in Scalable High Efficiency Video Coding (SHVC). It is proposed that a single scaled reference layer offset be derived from two scaled reference layer offset parameters, and vice-versa. It is also proposed that a single scaled reference layer offset or a single reference layer offset be derived from a combination of a scaled reference layer offset parameter and a reference layer offset parameter.