Scalable Video Encoding Reference Image Sharing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The HEVC scheme has poor coding efficiency due to information related to reference images being set for each layer, especially when encoding images with a hierarchical structure, where base and enhancement layers have high correlation.

Innovation Solution

An encoding device and method that sets and transmits reference image generation information for both base and enhancement layers, allowing for the sharing or prediction of reference image information between layers, and a decoding device that receives and uses this information to decode the scalable image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If reference image information is set for each layer independently, then each layer can be encoded separately, but coding efficiency deteriorates due to redundancy in hierarchical structures

Engineering Contradiction:

Improvelayered encoding capabilityVSAvoidcoding efficiency

Core Design Contradiction:

Ease of manufactureVSProductivity

Solution Approach 1:

The patent merges reference image information between base layer and enhancement layer by establishing correspondence relationships. The enhancement layer references corresponding reference images from the base layer, combining their information rather than treating them completely independently. This reduces redundant information while maintaining layered encoding capability.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

Reference image information serves multiple functions across layers. The same reference image can be utilized by both base layer and enhancement layer through the correspondence relationship, making the reference image information multi-functional and reducing overall information requirements.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Productivity

If reference image information is shared between layers, then coding efficiency improves, but information correlation between layers must be maintained

Engineering Contradiction:

Improvecoding efficiencyVSAvoidinformation correlation

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent applies local quality by establishing correspondence relationships between specific reference images in different layers. Rather than uniformly treating all reference images the same, it identifies and links corresponding reference images (e.g., first reference image in base layer corresponds to first reference image in enhancement layer) to maintain local correlation while enabling sharing.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The correspondence relationship acts as an intermediary mechanism that enables information sharing while maintaining correlation. It mediates between the base layer and enhancement layer, allowing reference image information to be shared through structured relationships rather than direct dependency.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If reference image generation information is transmitted for both layers, then decoding accuracy improves, but data amount increases

Engineering Contradiction:

Improvedecoding accuracyVSAvoiddata amount

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary reference image generation information for the enhancement layer from the base layer. Instead of transmitting complete reference image data for both layers, it extracts and transmits only the correspondence relationship information, significantly reducing data amount while maintaining decoding accuracy.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The base layer reference image information is prepared and stored in advance, and the correspondence relationship is pre-established. This preliminary action allows the enhancement layer to utilize the base layer information without requiring separate transmission of all reference image data, reducing overall data requirements.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10499079B2Encoding device, encoding method, decoding device, and decoding method

Publication Date: 2019.12.03 SONY GROUP CORP

AI summary

The present technology relates to an encoding device, an encoding method, a decoding device, and a decoding method, which are capable of sharing or predicting information related to a reference image of an image having a hierarchical structure. An enhancement encoding unit sets reference image specifying generation information used for generation of reference image specifying information of an enhancement image using reference image specifying information serving as information related to a reference image used when the enhancement image is encoded and reference image specifying information serving as information related to a reference image of a base image. The enhancement encoding unit encodes the enhancement image using the reference image, and generates encoded data. A transmission unit transmits the encoded data and the reference image specifying generation information. For example, the present technology can be applied to the encoding device.