SEI Message Ordering for Scalable Multiview Video Decoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding standards face challenges in efficiently managing and decoding supplemental enhancement information (SEI) messages, particularly in scalable and multiview video coding scenarios, leading to inefficiencies and increased bandwidth demand.

Innovation Solution

The proposed solution involves specifying a decoding order for certain SEI messages, such as the SDI SEI message preceding the MAI SEI message, and constraining certain SEI messages from being included in scalable nesting, thereby optimizing the video coding process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If SEI messages are decoded in traditional order without constraints, then decoding flexibility is maintained, but decoding efficiency and bandwidth utilization deteriorate

Engineering Contradiction:

Improvedecoding efficiencyVSAvoidbandwidth consumption

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by establishing a predetermined decoding order for SEI messages before actual decoding occurs. Specifically, the scalability dimension information SEI message is decoded before the multiview acquisition information SEI message, allowing the decoder to prepare necessary parameters in advance and avoid unnecessary bandwidth consumption by skipping redundant messages.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter of decoding order from traditional sequential processing to a constrained sequence where SDI SEI messages must precede MAI SEI messages. This parameter change enables more efficient bandwidth utilization by allowing the decoder to process critical scalability information before optional multiview acquisition information.

Inventive Principle:

Principle #35Parameter changes

2Reliability

If all SEI messages are included without constraints, then information completeness is maintained, but data redundancy and processing complexity increase

Engineering Contradiction:

Improveinformation completenessVSAvoidprocessing complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by differentiating the treatment of different SEI messages based on their specific characteristics and usage scenarios. Rather than uniformly processing all SEI messages, the patent applies specific constraints to SDI and MAI messages, allowing selective decoding based on local message properties and context.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent segments the SEI message processing into distinct categories with different requirements. By separating scalability dimension information messages from multiview acquisition information messages and applying different decoding constraints to each segment, the system reduces overall processing complexity while maintaining information completeness where needed.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS12581105B2Supplemental enhancement information message constraints

Publication Date: 2026.03.17 DOUYIN VISION CO LTD

AI summary

A method implemented by a video coding apparatus. The method includes determining that a scalability dimension information (SDI) supplemental enhancement information (SEI) message precedes a multiview acquisition information (MAI) SEI message in decoding order whenever an access unit (AU) contains both the SDI SEI message and the MAI SEI message; and performing a conversion between a video and a bitstream of the video based on the SDI SEI message and the MAI SEI message. A corresponding video coding apparatus and non-transitory computer readable medium are also disclosed.