Scalable Video Motion Vector Prediction for Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image encoding methods, such as those described in Non-Patent Literature 2 and 3, do not effectively utilize the correlation of motion between layers in scalable video coding, limiting encoding efficiency.

Innovation Solution

An image processing apparatus and method that acquires and sets motion vectors for prediction units in higher layers based on setting information from lower layers, enhancing encoding efficiency by leveraging the correlation of motion between layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing image encoding methods (Non-Patent Literature 2 and 3) are applied to scalable video coding layers, then the amount of code is reduced to some extent, but encoding efficiency is not sufficiently enhanced because the correlation of motion between layers is not utilized

Engineering Contradiction:
Improveencoding efficiencyVSAvoidmotion correlation information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent applies preliminary action by predicting motion vectors for enhancement layers based on motion information from the base layer before actual encoding. The motion vector prediction uses setting information from lower layers to pre-determine motion vectors for higher layers, reducing the need to encode complete motion information and thereby enhancing encoding efficiency while preserving motion correlation.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If motion vectors are independently encoded for each layer, then encoding simplicity is maintained, but the amount of code increases and encoding efficiency decreases

Engineering Contradiction:
Improvecode amountVSAvoidencoding process complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges motion information across layers by using motion vectors and setting information from the base layer to predict motion vectors in enhancement layers. This combining approach reduces the total code amount by eliminating redundant motion information encoding while maintaining manageable encoding complexity through systematic information reuse.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If simple inter-frame prediction is used, then the encoding process is simple, but compression rate is low when objects move greatly

Engineering Contradiction:
Improvecompression rateVSAvoidprediction process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the prediction process into multiple levels: base layer encoding, motion vector prediction, and enhancement layer encoding. By dividing the encoding process into distinct segments that handle different aspects (base layer motion, prediction offsets, enhancement details), the system achieves higher compression rates for moving objects while keeping each segment's complexity manageable.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10623761B2Image processing apparatus and image processing method
Publication Date: 2020.04.14 SONY GROUP CORP
  • US10623761B2 patent drawing
  • US10623761B2 patent drawing
  • US10623761B2 patent drawing

AI summary

Provided is an image processing apparatus including an information acquisition section that acquires setting information to set a motion vector to a second prediction unit in a second layer corresponding to a first prediction unit in a first layer of a scalable-video-decoded image containing the first layer and the second layer, which is higher than the first layer, the setting information being related to a motion vector set to the first prediction unit, and a motion vector setting section that sets the motion vector to the second prediction unit using the setting information acquired by the information acquisition section.