SEI Message Repetition in RTP for Video Loss Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current video coding standards, particularly H.264/AVC and SVC, lack effective mechanisms for error resilience, especially in conveying temporal level 0 picture indices and handling SEI messages within RTP payload formats, which affects the detection of lost pictures and overall video quality in error-prone environments.

Innovation Solution

Conveying temporal level 0 picture indices within SEI messages instead of the NAL unit header and enabling repetition of SEI messages in RTP packets to enhance error resilience, allowing for robust loss detection without altering the NAL unit or slice headers, and incorporating these features into the RTP payload format without affecting the decoding process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If temporal level 0 picture indices are conveyed in the NAL unit header, then loss detection capability is improved, but the complexity of the NAL unit header structure increases

Engineering Contradiction:

Improveloss detection capabilityVSAvoidNAL unit header structure complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the temporal level 0 picture index information from the NAL unit header and places it in a separate SEI message. This separation removes the complexity from the NAL unit header while maintaining the loss detection capability through the SEI message mechanism.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The SEI message acts as an intermediary carrier for the temporal level 0 picture index information. Instead of directly embedding the indices in the NAL unit header, the system uses SEI messages as a mediator to convey this information, thereby simplifying the header structure while preserving functionality.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If SEI messages are made repeatable in RTP packets, then error resilience is improved, but the bandwidth consumption increases

Engineering Contradiction:

Improveerror resilienceVSAvoidbandwidth consumption

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent implements partial repetition of SEI messages in RTP packets. Instead of repeating every SEI message multiple times, the system selectively repeats certain critical SEI messages or repeats them a limited number of times, achieving improved error resilience while controlling bandwidth consumption.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adjusts the repetition parameter of SEI messages based on network conditions and importance of the information. By changing the repetition parameter adaptively, the system optimizes the balance between error resilience and bandwidth utilization.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS10110924B2Carriage of SEI messages in RTP payload format

Publication Date: 2018.10.23 NOKIA TECHNOLOGIES OY

AI summary

A system and method of modifying error resiliency features by conveying temporal level 0 picture indices, such as t10_pic_idx, within an SEI message instead of optionally including them in the NAL unit header is provided. In addition, a mechanism is provided for enabling repetition of any SEI messages in Real-Time Transport Protocol (RTP) packets. Enabling such repetition of any SEI messages facilitates detection of lost temporal level 0 pictures on the basis of any received packet.