Scalable Video Coding Block Prediction Using Adjuvant Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for predicting lost or damaged blocks in enhanced spatial layer frames of scalable video coding are inefficient, especially when the corresponding lower spatial layer frames are inter-predicted, as they require time-consuming decoding processes.

Innovation Solution

A method that determines an adjuvant frame in the enhanced spatial layer using reference information from a lower spatial layer frame, generates an information-reduced block, and predicts the lost or damaged block using this block, reducing computational effort and making the prediction smoother by downscaling or upscaling motion and residual information as needed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the corresponding lower spatial layer frame is inter-predicted by help of reference frames, then the prediction accuracy may be improved, but the decoding time and computational effort increase significantly

Engineering Contradiction:
Improveprediction accuracyVSAvoiddecoding time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the necessary motion information and residual data from the lower spatial layer frame, rather than fully decoding the entire reference frame. This selective extraction approach maintains prediction accuracy by preserving essential motion vectors while avoiding the computational overhead of complete frame decoding, thus resolving the contradiction between prediction quality and decoding time.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the prediction process into separate components: motion vector extraction from lower layer, independent reference frame decoding, and selective application of motion compensation. This segmentation allows the system to perform only the necessary computations for prediction without fully decoding unnecessary frame data, reducing computational effort while maintaining prediction accuracy.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If the corresponding lower spatial layer frame is fully decoded to enable prediction, then the prediction quality improves, but the computational effort and processing time increase

Engineering Contradiction:
Improveprediction qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent performs preliminary extraction of motion information from the lower spatial layer frame before the actual prediction process. By pre-extracting motion vectors and identifying relevant blocks, the system prepares necessary data in advance, avoiding redundant computations during the main prediction phase and thus improving processing speed without sacrificing prediction quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary step where motion information is extracted and processed separately from the main decoding pipeline. This intermediary layer acts as a bridge between the lower spatial layer and the enhanced layer prediction, allowing selective processing of only the essential motion data needed for prediction, thereby improving processing efficiency while maintaining prediction accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If motion-compensated prediction from previous frames is used, then the prediction accuracy improves, but the computational complexity increases due to multiple reference frame decodings

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential motion vectors and block information from lower spatial layer frames, rather than fully decoding multiple reference frames. This selective extraction maintains prediction accuracy by preserving the critical motion compensation data while eliminating the computational complexity of complete frame decoding, thus resolving the contradiction between prediction quality and computational complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by performing motion compensation only on the specific blocks that require prediction, rather than processing entire frames. By applying motion compensation selectively to individual blocks using extracted motion vectors, the system achieves accurate prediction where needed while avoiding unnecessary computations in other areas, thus reducing overall computational complexity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP2152008B1Method for predicting a lost or damaged block of an enhanced spatial layer frame and SVC-decoder adapted therefore
Publication Date: 2018.08.29 INTERDIGITAL MADISON PATENT HLDG
  • EP2152008B1 patent drawingFigure 1
  • EP2152008B1 patent drawingFigure 2
  • EP2152008B1 patent drawingFigure 3

AI summary

The invention is related to prediction of a lost or damaged block of an enhanced spatial layer frame. A method for predicting a lost or damaged block of an enhanced spatial layer frame (E5) comprises the steps of determining an adjuvant frame (E3) in the enhanced spatial layer (EL) by help of reference information from a lower spatial layer frame (B5) corresponding said enhanced spatial layer frame (E5), generating an information reduced block by help of said adjuvant frame (E3) and predicting the lost or damaged block by help of the information reduced block. The reference information of the corresponding lower spatial layer frame can be decoded independently from any lower spatial layer reference frame and the adjuvant enhanced spatial layer frame is already decoded. Thus, the computational effort is reduced. By generation of the information reduced block the prediction is made smoother which makes it less vivid and therefore less salient to a user.