Video Signal Layered Coding Spatial Resolution Enhancement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial-resolution scalable video coding schemes face inefficiencies due to lower correlation between the decoded base-layer signal and the input video signal at the enhancement layer, primarily because the decoded base-layer signal lacks high-frequency components after decimation, leading to reduced coding efficiency.
Innovation Solution
A video-signal layered coding apparatus and method that includes spatial down-scaling, encoding, and high-resolution estimation to enhance the predictive signal's correlation with the input video signal, using a spatial down-scaler, first encoder, high-resolution estimated signal generator, and second encoder to achieve higher spatial resolution through inter-spatial resolution prediction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If spatial decimation is applied to reduce the input video signal to base layer resolution, then the base layer can be encoded efficiently, but the decoded base layer signal loses high-frequency components and correlation with the enhancement layer input signal deteriorates
Solution Approach 1:
The patent applies preliminary action by performing spatial interpolation on the decoded base layer signal before using it as a predictive signal for enhancement layer encoding. This preliminary up-scaling operation restores high-frequency components that were lost during decimation, thereby improving the correlation with the enhancement layer input signal while maintaining the efficiency benefits of base layer encoding at lower resolution.
Solution Approach 2:
The patent changes the spatial resolution parameter of the base layer decoded signal through interpolation operations. By transforming the signal from base layer resolution to enhancement layer resolution via interpolation, the system adapts the signal characteristics to improve correlation with the enhancement layer input, resolving the contradiction between encoding efficiency and prediction accuracy.
2Device complexity
If a larger quantization step size is used in base layer encoding, then encoding complexity is reduced, but the correlation between the decoded signal and input video signal decreases
Solution Approach 1:
The patent performs spatial interpolation as a preliminary action on the decoded base layer signal before using it for enhancement layer prediction. This interpolation step compensates for the correlation loss introduced by larger quantization step sizes, allowing the system to use coarser quantization in the base layer while still maintaining sufficient correlation for effective enhancement layer encoding.
3Reliability
If spatial interpolation is applied to the decoded base layer signal to enhance resolution, then the predictive signal quality improves, but computational complexity increases
Solution Approach 1:
The patent segments the video coding process into distinct base layer encoding and enhancement layer encoding stages, with spatial interpolation applied only to the base layer decoded signal before enhancement layer processing. This segmentation allows the system to maintain low complexity in the base layer while adding interpolation only where necessary to improve enhancement layer prediction accuracy.
Solution Approach 2:
The patent changes the spatial resolution parameter through controlled interpolation operations that are applied selectively. By transforming the base layer decoded signal to enhancement layer resolution via interpolation, the system improves predictive signal quality while managing computational complexity through targeted application of the interpolation operation.
4Device complexity
If the base layer decoded signal is used directly as predictive signal without resolution enhancement, then processing is simplified, but coding efficiency at enhancement layer deteriorates
Solution Approach 1:
The patent applies spatial interpolation as a preliminary action to enhance the resolution of the base layer decoded signal before using it as a predictive signal for enhancement layer encoding. This preliminary up-scaling operation improves the correlation with the enhancement layer input signal, thereby increasing coding efficiency at the enhancement layer while maintaining relatively simple processing architecture.
Data Source
AI summary
An input video signal is encoded at a plurality of coding layers exhibiting different spatial resolutions. The input video signal is spatially scaled down to a resolution-lowered video signal that exhibits a resolution lower than the video signal. The resolution-lowered video signal is encoded by using a quantization parameter, with a decoding procedure, thus obtaining first coded data and a decoded signal. The decoded signal is spatially scaled up through a high-resolution procedure for controlling high-frequency components estimation depending on the quantization parameter, thus obtaining a high-resolution scaled-up video signal. The input video signal is encoded through inter-spatial resolution prediction using the high-resolution scaled-up video signal as a predictive signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal.