Scalable Video Coding Block Prediction Using Adjuvant Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for predicting lost or damaged blocks in enhanced spatial layer frames of scalable video coding are inefficient, especially when the corresponding lower spatial layer frames are inter-predicted, as they require time-consuming decoding processes.
Innovation Solution
A method that determines an adjuvant frame in the enhanced spatial layer using reference information from a lower spatial layer frame, generates an information-reduced block, and predicts the lost or damaged block using this block, reducing computational effort and making the prediction smoother by downscaling or upscaling motion and residual information as needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the corresponding lower spatial layer frame is inter-predicted by help of reference frames, then the prediction accuracy may be improved, but the decoding time and computational effort increase significantly
Solution Approach 1:
The patent extracts only the necessary motion information and residual data from the lower spatial layer frame, rather than fully decoding the entire reference frame. This selective extraction approach maintains prediction accuracy by preserving essential motion vectors while avoiding the computational overhead of complete frame decoding, thus resolving the contradiction between prediction quality and decoding time.
Solution Approach 2:
The patent segments the prediction process into separate components: motion vector extraction from lower layer, independent reference frame decoding, and selective application of motion compensation. This segmentation allows the system to perform only the necessary computations for prediction without fully decoding unnecessary frame data, reducing computational effort while maintaining prediction accuracy.
2Manufacturing precision
If the corresponding lower spatial layer frame is fully decoded to enable prediction, then the prediction quality improves, but the computational effort and processing time increase
Solution Approach 1:
The patent performs preliminary extraction of motion information from the lower spatial layer frame before the actual prediction process. By pre-extracting motion vectors and identifying relevant blocks, the system prepares necessary data in advance, avoiding redundant computations during the main prediction phase and thus improving processing speed without sacrificing prediction quality.
Solution Approach 2:
The patent introduces an intermediary step where motion information is extracted and processed separately from the main decoding pipeline. This intermediary layer acts as a bridge between the lower spatial layer and the enhanced layer prediction, allowing selective processing of only the essential motion data needed for prediction, thereby improving processing efficiency while maintaining prediction accuracy.
3Measurement precision
If motion-compensated prediction from previous frames is used, then the prediction accuracy improves, but the computational complexity increases due to multiple reference frame decodings
Solution Approach 1:
The patent extracts only the essential motion vectors and block information from lower spatial layer frames, rather than fully decoding multiple reference frames. This selective extraction maintains prediction accuracy by preserving the critical motion compensation data while eliminating the computational complexity of complete frame decoding, thus resolving the contradiction between prediction quality and computational complexity.
Solution Approach 2:
The patent applies partial action by performing motion compensation only on the specific blocks that require prediction, rather than processing entire frames. By applying motion compensation selectively to individual blocks using extracted motion vectors, the system achieves accurate prediction where needed while avoiding unnecessary computations in other areas, thus reducing overall computational complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention is related to prediction of a lost or damaged block of an enhanced spatial layer frame. A method for predicting a lost or damaged block of an enhanced spatial layer frame (E5) comprises the steps of determining an adjuvant frame (E3) in the enhanced spatial layer (EL) by help of reference information from a lower spatial layer frame (B5) corresponding said enhanced spatial layer frame (E5), generating an information reduced block by help of said adjuvant frame (E3) and predicting the lost or damaged block by help of the information reduced block. The reference information of the corresponding lower spatial layer frame can be decoded independently from any lower spatial layer reference frame and the adjuvant enhanced spatial layer frame is already decoded. Thus, the computational effort is reduced. By generation of the information reduced block the prediction is made smoother which makes it less vivid and therefore less salient to a user.