Inter-layer adaptive filtering for scalable video coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Scalable video coding systems face challenges in efficiently adapting video quality and resolution across different network conditions and device capabilities due to limitations in inter-layer prediction and filtering techniques, leading to artifacts and reduced coding efficiency.

Innovation Solution

The implementation of inter-layer adaptive filtering, which involves up-sampling and filtering of reconstructed base layer data to improve prediction accuracy and reduce differences between layers, using techniques such as sample adaptive offset (SAO) and adaptive loop filtering (ALF), to enhance the coding efficiency and quality of enhancement layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If inter-layer prediction is used to adapt video quality and resolution across different network conditions, then coding efficiency is improved, but artifacts and reduced prediction accuracy occur due to limitations in filtering techniques

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies filtering operations (deblocking, SAO, ALF) to the base layer reconstructed data before up-sampling to enhance layer in advance. This preliminary action prepares the base layer data with reduced artifacts and improved quality, which then serves as a better foundation for prediction in the enhancement layer, thereby improving both coding efficiency and prediction accuracy simultaneously

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If filtering techniques are applied to reduce differences between layers, then video quality is enhanced, but device complexity increases due to multiple filtering operations

Engineering Contradiction:
Improvevideo qualityVSAvoidfiltering operations
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple filtering operations (deblocking filter, sample adaptive offset, adaptive loop filtering) into a unified inter-layer adaptive filtering process that is applied systematically to base layer data before up-sampling. This merging approach consolidates what would otherwise be separate complex operations into an integrated workflow, reducing overall device complexity while maintaining enhanced video quality through the cumulative effect of all filtering stages

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10136144B2Method and apparatus of inter-layer filtering for scalable video coding
Publication Date: 2018.11.20 MEDIATEK SINGAPORE PTE LTD
  • US10136144B2 patent drawing
  • US10136144B2 patent drawing
  • US10136144B2 patent drawing

AI summary

A method and apparatus for inter-layer prediction for scalable video coding are disclosed. Embodiments according to the present invention apply inter-layer adaptive filtering to the video data derived from the reconstructed BL video data to generate inter-layer adaptive filtered data. The inter-layer adaptive filtered data is then included as prediction data to encode or decode the EL video data. The video data derived from the reconstructed BL video data is up-sampled before applying inter-layer adaptive filtering. The up-sampling may also be included in the inter-layer adaptive filtering. In another embodiment, the inter-layer adaptive filtering comprises adaptive up-sampling. For up-sampled BL video data at locations not collocated with the EL video data, the up-sampled BL video data is divided into location types according to locations of the up-sampled BL video data. Each location type may have an individual filter for up-sampling video data in the group.