Scalable Video Intra Mode Derivation via Base Layer Copying

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current scalable video coding systems face inefficiencies in coding Intra modes across different layers, leading to increased complexity and reduced performance, particularly in exploiting inter-layer correlations without compromising video quality.

Innovation Solution

The method involves inheriting coding unit structures, prediction modes, and motion vectors from the base layer for the enhancement layer, and using inter-layer texture and residual predictions to reduce redundancy, while also optimizing Intra mode coding by deriving most probable modes from neighboring blocks and the base layer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional Intra mode coding is used independently in each layer, then coding simplicity is maintained, but coding efficiency is reduced due to failure to exploit inter-layer correlations

Engineering Contradiction:
Improvecoding efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies copying by inheriting the Intra mode of a co-located block from the base layer to predict the Intra mode of the current block in the enhancement layer. Instead of independently determining Intra modes in each layer, the system copies the mode information from the base layer, exploiting inter-layer correlations to improve coding efficiency while reducing the need for complex independent mode selection processes.

Inventive Principle:
Principle #26Copying

2Productivity

If inter-layer prediction is used to exploit correlations between layers, then coding efficiency is improved, but system complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local quality by selectively applying inter-layer Intra mode prediction only to specific blocks where co-located blocks exist and are available in the base layer. Rather than uniformly applying complex prediction mechanisms to all blocks, the system locally applies prediction where beneficial, maintaining simplicity for blocks where inter-layer correlation is not applicable or advantageous.

Inventive Principle:
Principle #3Local quality

3Productivity

If Intra mode is derived without considering neighboring blocks and base layer information, then processing speed is maintained, but coding performance deteriorates

Engineering Contradiction:
Improvecoding performanceVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-deriving and storing the Intra modes of neighboring blocks and co-located base layer blocks before performing mode selection for the current block. This preliminary preparation of candidate modes allows the encoder to quickly select the best mode without performing complex computations during the actual coding process, thus improving coding performance while minimizing additional processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2829065B1Method and apparatus for intra mode derivation and coding in scalable video coding
Publication Date: 2020.05.13 MEDIATEK SINGAPORE PTE LTD
  • EP2829065B1 patent drawingFigure 1
  • EP2829065B1 patent drawingFigure 2A~2B
  • EP2829065B1 patent drawingFigure 3

AI summary

A method and apparatus of Intra mode coding for a scalable video coding system are disclosed. For a current Intra-coded block in the enhancement layer (EL), predictive coding is applied to the current Intra mode based on the base layer (BL) coding mode associated with the co-located block in the BL and neighboring coding modes associated with neighboring blocks of the current block in the EL. The neighboring blocks of the current block in the EL comprise a left block adjacent to a left side of the current block and a top block adjacent to a top side of the current block. One or more most probable modes (MPMs) can be derived from the neighboring coding modes and the BL coding mode, and the MPMs is then used for predictive coding of the current Intra mode.