Scalable Video Coder Motion Data Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding systems, such as H.264/AVC, lack a simple scalability option for improving video quality step-by-step while maintaining a low bit rate, leading to difficulties in generating enhancement scaling layers due to closed loops in quantization and motion estimation, which limits flexibility and increases bit rates in scalable coders.

Innovation Solution

A scalable video coder system that calculates base and enhancement motion data adaptively, using base motion data to determine enhancement motion data and signalization information, allowing for flexible scalability by integrating base motion data into enhancement motion compensation, and utilizing intermediate layer predictions to reduce bit rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If base motion data is calculated and used for enhancement scaling layer generation, then video quality improvement is achieved, but bit rate increases due to closed loops in quantization and motion estimation

Engineering Contradiction:
Improvevideo qualityVSAvoidbit rate
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent performs motion estimation for the base layer first, then uses the resulting base motion data as preliminary information for enhancement layer motion compensation. This preliminary action allows the enhancement layer to start with known motion parameters, reducing the need for additional bit rate while maintaining quality improvement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The base motion data serves as an intermediary between the base layer encoding and enhancement layer encoding. Instead of performing independent motion estimation in the enhancement layer (which would increase bit rate), the base motion data mediates the process by providing ready-made motion parameters that can be directly used or refined, thus reducing the quantity of data that needs to be transmitted.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If scalable video coding is implemented with enhancement layers, then flexibility in scalability is improved, but device complexity increases due to multiple motion compensators and predictors

Engineering Contradiction:
Improveflexibility in scalabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the base motion compensator and enhancement motion compensator into a unified scalable video coding framework. Instead of treating them as completely separate systems, the enhancement motion compensator is designed to work in conjunction with the base motion compensator, sharing common structures and algorithms, thus reducing overall device complexity while maintaining scalability flexibility.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The motion compensator is designed with multi-functionality to handle both base layer and enhancement layer operations. The same motion compensation structure can operate in different modes: using only base motion data, using only enhancement motion data, or combining both, thus providing universal functionality that reduces the need for separate dedicated components for each layer.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If base motion data is integrated into enhancement motion compensation, then residual value correlations are improved, but calculation complexity increases due to adaptive block-by-block processing

Engineering Contradiction:
Improveresidual value correlationsVSAvoidcalculation complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the video picture into multiple blocks and processes each block adaptively. For each block, the system decides whether to use base motion data, enhancement motion data, or a combination, based on local characteristics. This segmentation allows residual value correlations to be improved locally without requiring complex global processing, thus managing calculation complexity through localized decision-making.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The motion compensation system is made dynamic by allowing the processing mode to change adaptively for each block. The system can switch between different modes of using base and enhancement motion data depending on the local content characteristics, thus optimizing residual value correlations dynamically without requiring fixed complex processing for the entire picture.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8873622B2Apparatus and method for generating a coded video sequence by using an intermediate layer motion data prediction
Publication Date: 2014.10.28 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US8873622B2 patent drawing
  • US8873622B2 patent drawing
  • US8873622B2 patent drawing

AI summary

In the scalable video coding in connection with motion compensation both in a base layer and in an enhancement layer, a prediction of the motion data of the enhancement layer is performed by using the motion data of the base layer to obtain a scalability concept, which provides, on the one hand, a maximum flexibility for the calculation of the motion data of the different layers and, on the other hand, allows a lower bit rate.