MSE Inband Event Dispatch for DASH and CMAF Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Media Source Extensions (MSE) specifications do not support parsing and processing inband events embedded in Moving Picture Experts Group (MPEG) Dynamic Adaptive Streaming over HTTP (DASH) or Common Media Application Format (CMAF) media segments, preventing browsers or user agents from natively processing these events and dispatching them to the respective application.
Innovation Solution
Extensions to the MSE are introduced to enable native processing of DASH and CMAF inband event boxes, including media and event buffers, synchronizers, and dispatchers, allowing events to be processed and dispatched based on specific modes and timing criteria.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current MSE specifications are used, then browser compatibility is maintained, but inband event processing capability is lost
Solution Approach 1:
The patent segments the event processing functionality into distinct components: event detection within media segments, event message box parsing, and event dispatching to applications. This modular approach allows the MSE to process inband events without requiring complete redesign of the specification, thereby improving adaptability while managing complexity through structured organization of processing functions.
2Ease of operation
If inband event processing is added to MSE, then event dispatch functionality is improved, but specification complexity increases
Solution Approach 1:
The patent introduces an intermediary event processing layer within the MSE that acts as a mediator between the incoming media segments containing inband events and the application layer. This intermediary component parses event message boxes, extracts event information, and dispatches events to appropriate applications, thereby improving ease of operation without requiring direct modification of the core MSE specification structure.
3Reliability
If native inband event processing is implemented, then application integration is enhanced, but implementation complexity increases
Solution Approach 1:
The patent implements preliminary action by pre-defining event message box structures, event types, and dispatching mechanisms within the MSE specification before actual media playback occurs. Event processing rules, parsing templates, and application dispatch protocols are established in advance, enabling reliable application integration without requiring complex runtime decision-making or adaptive processing logic during media playback.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method and apparatus for processing events in a media stream may be provided. The method may include obtaining media data; generating, from the media data, one or more event segments and one or more media segments; parsing a respective event from the one or more event segments to determine an event start time, event end time, and dispatch mode; appending the respective event from the one or more event segments to an event dispatch buffer based on a comparison of the event start time and a current playback position, and a determination that the respective event is not present in an already dispatched buffer; and dispatching the respective event based on the position associated with the respective event in the event dispatch buffer, the event start time, the event end time, and the current playback position.