Recovery Point SEI Message Association in Multi-Layer Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding schemes, particularly in multi-layer coding, face ambiguity in handling recovery point Supplemental Enhancement Information (SEI) messages, leading to inconsistent behavior of video encoders and decoders due to the lack of clear semantics for associating these messages with multiple pictures within an access unit.

Innovation Solution

The proposed solution unambiguously associates recovery point SEI messages with specific pictures within an access unit in a multi-layer bitstream, clarifying the semantics to ensure consistent behavior of video encoders and decoders, and extends this clarity to region refresh information SEI messages for accurate association with individual pictures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If recovery point SEI messages are included in multi-layer bitstreams without clear association semantics, then the bitstream can carry recovery information, but the behavior of encoders and decoders becomes inconsistent

Engineering Contradiction:
Improveconsistency of encoder-decoder behaviorVSAvoidcomplexity of SEI message association semantics
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the multi-layer bitstream into distinct access units, each containing pictures from different layers. Recovery point SEI messages are then associated with specific access units rather than being ambiguously applied across multiple layers, thereby ensuring consistent encoder-decoder behavior without increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces access unit delimiters as intermediary elements that clearly mark the boundaries and contents of access units. These delimiters serve as mediators between the SEI messages and the multi-layer picture structures, providing unambiguous association semantics that resolve the inconsistency problem.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If region refresh information SEI messages are applied without clear picture association, then refresh information can be transmitted, but accurate application to individual pictures cannot be ensured

Engineering Contradiction:
Improveprecision of region refresh information associationVSAvoidcomplexity of message-picture association mechanism
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments region refresh information into picture-specific associations within access units. Each region refresh SEI message is explicitly tied to a specific picture in a specific access unit, ensuring precise application to individual pictures while maintaining a manageable association mechanism through the access unit structure.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10560710B2Method for coding recovery point supplemental enhancement information (SEI) messages and region refresh information SEI messages in multi-layer coding
Publication Date: 2020.02.11 QUALCOMM INC
  • US10560710B2 patent drawing
  • US10560710B2 patent drawing
  • US10560710B2 patent drawing

AI summary

Methods for coding recovery point supplemental enhancement information (SEI) messages and region refresh SEI messages in multi-layer coding are disclosed. In one aspect, the method may include determining at least one picture among a plurality of pictures included within an access unit with which to associate at least one recovery point SEI message, the access unit being included within the multi-layer bitstream. The method may further include associating the at least one recovery point SEI message with the determined at least one picture. The method may also include coding the video information based at least in part on the association of the at least one recovery point SEI message with the determined at least one picture.