Video Bitstream Concatenation via Hypothetical Reference Decoder Header Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In smart rendering editing, the relationship between concatenated bitstreams is not considered, leading to a risk of breaking the hypothetical reference decoder, necessitating cumbersome operations to ensure correct decoding.

Innovation Solution

An image encoding device and method that sets and updates header information related to the hypothetical reference decoder, including NAL unit type and bitstream concatenation information, to facilitate easier concatenation of bitstreams without breaking the decoder.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If bitstreams are concatenated without considering the relationship between them, then the concatenation operation becomes simple and fast, but the hypothetical reference decoder may break and decoding correctness cannot be guaranteed

Engineering Contradiction:
Improvebitstream concatenation efficiencyVSAvoiddecoder correctness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by setting specific header information related to the hypothetical reference decoder during the encoding process. The setting unit configures parameters such as cpb_removal_delay and other HRD-related syntax elements before concatenation occurs, ensuring that the concatenated bitstream maintains decoder correctness without requiring complex post-processing operations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If header information related to the hypothetical reference decoder is appropriately rewritten to ensure correct decoding, then decoding correctness is guaranteed, but the operation becomes troublesome and complex

Engineering Contradiction:
Improvedecoding correctnessVSAvoidbitstream processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements self-service by having the setting unit automatically configure the appropriate header information during encoding based on the current picture's position and reference information. The system self-adjusts the cpb_removal_delay and other HRD parameters without requiring external intervention or complex post-concatenation processing, thereby ensuring decoding correctness while maintaining operational simplicity.

Inventive Principle:
Principle #25Self-service

3Productivity

If smart rendering editing is used to encode video sections, then encoding time is shortened and image quality degradation is prevented, but the relationship between concatenated bitstreams is not considered

Engineering Contradiction:
Improveencoding efficiencyVSAvoidbitstream relationship information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent applies local quality by setting different header information parameters based on the local characteristics of each picture being encoded. The setting unit determines appropriate cpb_removal_delay and HRD-related parameters according to the current picture's position (first, last, or intermediate) and reference status, ensuring that each local segment maintains proper HRD state while preserving the overall bitstream relationship information needed for correct concatenation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3116230B1Method and apparatus for splicing in a compressed video bitstream
Publication Date: 2019.05.08 SONY GROUP CORP
  • EP3116230B1 patent drawingFigure 1A~1B
  • EP3116230B1 patent drawingFigure 2A~2B
  • EP3116230B1 patent drawingFigure 3

AI summary

The present disclosure relates to an image encoding device and an image encoding method, and an image processing device and an image processing method that enable easier bitstream concatenation. A structure according to the present disclosure includes: a setting unit that sets header information related to a hypothetical reference decoder in accordance with information about a position and information about reference, the information about a position and the information about reference being of the current picture of image data to be processed; and an encoding unit that encodes the image data and generates a bitstream containing the encoded data of the image data and the header information set by the setting unit. The present disclosure can be applied to image processing devices or image encoding devices, for example.