System Level Signaling for SEI Message Parsing in Media Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques for streaming media data lack a signal at the system level to indicate the presence of SEI messages for CEA-608/708 in video elementary streams, the capability to render closed captions, and additional information such as language, which is crucial for proper operation and accessibility, especially with the advent of HDR technologies that require specific metadata for rendering.
Innovation Solution
The proposed solution involves generating and signaling system-level information within a media bitstream to indicate the presence of SEI messages, including payload types, and additional metadata for HDR formats, such as mastering color volume and content light level information, to enable proper rendering and adaptation based on display capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If system level information signaling for SEI messages is added to media bitstream, then media devices can accurately identify and process SEI messages including closed captions and HDR metadata, but device complexity increases due to additional parsing and processing requirements
Solution Approach 1:
The patent applies preliminary action by embedding system level information about SEI messages, payload types, and HDR metadata into the media bitstream during encoding. This allows receiving devices to have advance knowledge of what supplemental information is present without needing to perform complex analysis during playback, thereby improving reliability of SEI message identification while managing device complexity through pre-prepared metadata
2Adaptability or versatility
If system level information including payload types and HDR metadata is signaled in media bitstream, then proper rendering and content selection based on display capabilities is enabled, but loss of information is reduced as all necessary metadata is explicitly provided
Solution Approach 1:
The patent applies segmentation by dividing the media bitstream into distinct components: core video data and separate system level information structures that contain organized metadata about SEI messages, payload types, and HDR parameters. This structured segmentation ensures all necessary information is explicitly provided for adaptability while preventing information loss through systematic organization of metadata elements
3Productivity
If system level information is parsed and extracted from media bitstream, then processing efficiency is improved by enabling early determination of SEI message presence, but loss of time occurs during the parsing and extraction process
Solution Approach 1:
The patent applies preliminary action by structuring system level information to be parseable at the beginning of the media bitstream, allowing receiving devices to quickly determine SEI message presence and characteristics before full media playback begins. This enables early processing decisions while minimizing time loss through efficient, pre-organized metadata structures that require minimal parsing overhead
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one example, a device for retrieving media data includes one or more processors implemented in circuitry and configured to parse system level information of a media bitstream encapsulating a video elementary stream, the system level information indicating that the video elementary stream includes one or more supplemental enhancement information (SEI) messages and payload types for each of the SEI messages, extract the one or more SEI messages and the payload types from the system level information, and send the one or more SEI messages and the payload types to one or more other processing units of the device.