Hybrid Media Synchronization via Timeline Alignment Events
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in media synchronization under hybrid delivery modes, where broadcast networks and broadband networks are combined, due to issues with clock continuity and synchronization, particularly with the use of a single reference clock.
Innovation Solution
A media processing method and apparatus that acquires and aligns Media Presentation (MP) timeline alignment event messages to determine aligned media segments and calculate Media Presentation Times (MPTs) relative to an external timeline, using InbandEventStream elements and specific fields like presentation_time_delta and timescale, ensuring synchronization across different media segments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single reference clock is used for media synchronization in hybrid delivery mode, then the synchronization mechanism is simplified, but clock continuity and synchronization reliability deteriorate
Solution Approach 1:
The patent segments the synchronization mechanism by introducing separate timing reference systems for broadcast media and broadband media. Instead of using a single reference clock, the system divides timing references into distinct segments (broadcast timeline and broadband timeline) that can be independently managed and maintained, thereby preserving clock continuity while keeping the overall mechanism manageable
Solution Approach 2:
The patent introduces an intermediary element - the mapping relationship between broadcast timeline and broadband timeline - that mediates between the two separate timing reference systems. This mapping acts as a bridge that enables synchronization without requiring a single reference clock, thus maintaining reliability while managing complexity
2Measurement precision
If digital watermark technology is used for media synchronization, then time synchronization reference can be obtained, but computational complexity and dependency on terminal capacity increase
Solution Approach 1:
The patent extracts the timing reference information directly from the media streams themselves through metadata and timing stamps embedded in the broadcast and broadband streams. Instead of requiring complex digital watermark extraction and processing at the terminal, the necessary synchronization information is taken out and provided directly in the stream data, reducing computational complexity while maintaining synchronization accuracy
Solution Approach 2:
The patent implements preliminary action by pre-establishing the mapping relationship between broadcast timeline and broadband timeline at the server side before delivery. This pre-computation of timing mappings eliminates the need for complex real-time computational processing at the terminal, reducing device complexity while maintaining precise time synchronization through pre-calculated reference points
3Adaptability or versatility
If hybrid delivery mode combining broadcast and broadband networks is implemented, then service flexibility and network investment efficiency are improved, but media synchronization difficulty increases
Solution Approach 1:
The patent implements dynamics by creating adaptive mapping relationships between broadcast timeline and broadband timeline that can dynamically adjust to different delivery scenarios. The system can flexibly establish and modify timing mappings based on network conditions, service requirements, and media types, thereby maintaining service flexibility while managing synchronization complexity through adaptive rather than static timing relationships
Data Source
Figure 1
Figure 2~3
Figure 4~5
AI summary
A media processing method and apparatus for adaptive streaming are provided. In the method, a Media Presentation (MP) timeline alignment event message carried in a media segment (S1102) is acquired; an aligned media segment is determined according to the MP timeline alignment event message, where the aligned media segment is a media segment of which a Media Presentation Time (MPT) in an MP timeline is aligned to an external timeline (S1104); and one or more MPTs of one or more media segments in an MP timeline alignment event (S1106) after a mapping between the MP timeline and the external timeline has been established are calculated. The solution may solve a problem in a related technology caused by employing a single reference clock to transmit hybrid media composed of a broadcast network and a broadband network, and media synchronization processing under a hybrid transmission mode may be more efficient.