Adaptive Streaming Media Synchronization via Transport Stream PTS Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing hybrid delivery modes for broadcast and broadband networks face challenges in media content synchronization due to limitations in digital watermark and fingerprint technologies, and the discontinuity of clock information when transport streams are de-multiplexed, leading to inefficiencies in media synchronization across different networks.
Innovation Solution
A method and device for processing adaptive streaming that extract and utilize presence time stamps (PTS) from extension headers in transport streams to determine time information, allowing for timeline alignment of segments across broadcast and broadband networks, and include mechanisms for reloading media presentation descriptions and extracting location information to ensure synchronized playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If digital watermark or fingerprint technology is used for media synchronization, then synchronization capability is improved, but computational complexity and terminal capability requirements increase significantly
Solution Approach 1:
The patent extracts the time synchronization information from the transport stream by obtaining presence time stamps (PTS) and carrying them in the adaptive streaming data structure. This extracts only the essential timing information needed for synchronization, avoiding the need for complex digital watermark or fingerprint analysis at the terminal, thus reducing computational complexity while maintaining synchronization reliability
Solution Approach 2:
The patent introduces an intermediary mechanism where time information from the transport stream is carried through the adaptive streaming data structure (via Location Descriptor or Extension Descriptor) to the player terminal. This intermediary approach provides direct time synchronization information without requiring the terminal to perform complex feature extraction or analysis, resolving the contradiction between synchronization reliability and terminal processing complexity
2Device complexity
If a single reference clock is used in hybrid delivery mode, then synchronization is simplified, but clock discontinuity occurs when transport streams are de-multiplexed
Solution Approach 1:
The patent applies preliminary action by obtaining and carrying the presence time stamp (PTS) from the transport stream before the adaptive streaming data is delivered to the terminal. By pre-extracting and embedding the time information in the data structure (via Location Descriptor or Extension Descriptor), the system prepares the synchronization information in advance, ensuring clock continuity is maintained even when transport streams are de-multiplexed, thus resolving the contradiction between system simplicity and clock reliability
3Adaptability or versatility
If adaptive streaming segments are delivered without time alignment information, then delivery flexibility is improved, but timeline synchronization between broadcast and broadband networks deteriorates
Solution Approach 1:
The patent introduces an intermediary mechanism where time alignment information (PTS) is carried through the adaptive streaming data structure via Location Descriptor or Extension Descriptor. This intermediary provides the necessary timeline synchronization information to the terminal while maintaining the flexibility of adaptive streaming delivery, as the time information is embedded within the existing adaptive streaming framework rather than requiring a separate synchronization system
Solution Approach 2:
The patent makes the adaptive streaming data structure multi-functional by enabling it to carry both content delivery information and time synchronization information through the Location Descriptor or Extension Descriptor. This universal approach allows a single data structure to serve dual purposes: maintaining adaptive streaming flexibility while also providing timeline synchronization, thus resolving the contradiction between delivery flexibility and synchronization reliability
Data Source
Figure 1
Figure 2~4
Figure 5
AI summary
A method and device for processing adaptive streaming is provided. The method includes that: location information and time information of the adaptive streaming carried in a TS is obtained; at least one segment, in the adaptive streaming, for timeline alignment with the transport stream is determined according to the location information; a presence time stamp, PTS, of media presentation time of each of the at least one segment in the adaptive streaming relative to a timeline of the transport stream is determined according to the time information. By the embodiments of the disclosure, the problem in the related art resulted from hybrid media transmission with a single reference clock in broadcast and the broadband networks is solved, thereby making media synchronization processing under the hybrid delivery mode more efficient.