Video Encoding Reference Information Reduction via GOP Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The amount of information related to reference image specifying information in existing encoding systems, such as the HEVC system, is not sufficiently reduced, leading to inefficiencies in data transmission and storage.

Innovation Solution

An encoding device and method that generates a predicted image using a reference image and transmits reference information indicating whether reference image specifying information from a prior image is used for the current image, specifically excluding this information for the first image in a GOP, thereby reducing the amount of data required.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If reference image specifying information is transmitted for every image in existing encoding systems, then decoding accuracy is maintained, but the amount of transmitted data increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoidamount of transmitted data
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary reference image specifying information for transmission. Specifically, it transmits this information only for images other than the first image in a GOP (Group of Pictures), thereby removing redundant data transmission while maintaining decoding accuracy where prediction can be performed

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the transmission of reference image specifying information by image type within a GOP structure. The first image is treated differently from subsequent images, with reference information transmitted only for non-first images, creating a segmented approach to data transmission that reduces overall data volume

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If full reference image specifying information is transmitted for all images, then reference accuracy is improved, but transmission efficiency deteriorates

Engineering Contradiction:
Improvereference accuracyVSAvoidtransmission efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies partial action by transmitting reference image specifying information only when necessary (for images other than the first in a GOP). This partial transmission approach maintains reference accuracy for images that require it while avoiding unnecessary transmissions, thereby improving transmission efficiency without sacrificing required reference precision

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If reference information is transmitted for every image, then decoding reliability is maintained, but data compression ratio decreases

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidcompression ratio
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent uses copying by having the decoding device generate reference image specifying information for the first image by copying or inferring from subsequent images in the GOP. This allows the first image to be decoded reliably without transmitting its reference information, as the information can be reconstructed from other images, thereby maintaining decoding reliability while improving compression ratio

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11399197B2Encoding device and encoding method with setting and encoding of reference information
Publication Date: 2022.07.26 SONY GROUP CORP
  • US11399197B2 patent drawing
  • US11399197B2 patent drawing
  • US11399197B2 patent drawing

AI summary

The present technology relates to an encoding device and an encoding method capable of reducing the amount of information relating to information that specifies a reference image.An encoding unit generates a predicted image using a reference image. A transmission unit transmits inter_ref_pic_set_prediction_flag representing whether reference image specifying information specifying the reference image of a prior image that is an image prior to a current coding image in coding order is used as the reference image specifying information of the current coding image in a case where the current coding image is an image other than a first image of a GOP (Group of Picture). The present technology, for example, can be applied to an encoding device of an HEVC (High Efficiency Video Coding) system.