Multi-View Streaming Synchronization via MPU Timestamps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-view streaming services experience playback time differences between main and sub-screens due to lack of synchronization in streaming data delivery, leading to user inconvenience and suboptimal playback experiences.
Innovation Solution
Implementing a method and apparatus using MPEG Media Transport (MMT) technology to synchronize playback time information across multiple screens, ensuring that both the main and sub-screens receive and play streaming data in real-time, adjusting according to events such as screen size changes or switching, through a multi-view streaming service server and terminal modules.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If streaming data is provided independently to each screen, then each screen can be displayed separately, but playback time differences occur between main screen and sub-screen
Solution Approach 1:
A synchronization module is introduced as an intermediary component that receives streaming data for multiple screens and adds synchronization information (timestamps) to each Media Presentation Unit. This mediator ensures that all screens receive properly timed data packets with playback time information, allowing the playback control module to synchronize display across all screens and eliminate playback time differences while maintaining independent screen display capability
Solution Approach 2:
The system implements a feedback mechanism where the synchronization module continuously monitors playback time information from multiple screens and adjusts the timing of data delivery. By using timestamps embedded in each MPU and comparing actual playback progress against expected timing, the system dynamically compensates for timing deviations and ensures synchronized playback across main and sub-screens
2Loss of time
If synchronization information is added to each data packet, then playback time difference is reduced, but data processing complexity increases
Solution Approach 1:
The streaming data is segmented into discrete Media Presentation Units (MPUs), with synchronization information (timestamps) added to each individual MPU. This segmentation approach allows the synchronization module to process and manage timing for each unit independently, making the complexity manageable through modular processing rather than handling entire streams as single units
Solution Approach 2:
The system changes the parameter of data packets by embedding timestamps and synchronization information within each MPU structure. This parameter enhancement enables automatic synchronization without requiring complex external coordination, as the timing information is intrinsic to each data unit and can be processed through standardized algorithms
3Adaptability or versatility
If multiple screens receive streaming data simultaneously, then multi-view service is provided, but network bandwidth consumption increases
Solution Approach 1:
The system merges multiple streaming data streams into a single unified data transmission channel from the server to the terminal. The synchronization module consolidates MPUs from different screens into one synchronized data flow, reducing redundant network transmissions while maintaining the ability to deliver content to multiple screens simultaneously through efficient data sharing
Data Source
AI summary
The disclosure relates to a method and apparatus for providing a multi-view streaming service having at least two screens. According to an embodiment, the multi-view streaming service providing apparatus includes a first screen control module, a second screen control module, and a playback control module. The first screen control module supports playback processing of a first MPEG media transport (MMT) streaming data for a first screen. The second screen control module supports playback processing of a second MMT streaming data for a second screen. The playback control module identifies playback time information inserted in each media processing unit (MPU) of the first and second streaming data in response to a request for multi-view streaming playback, and controls the first and second screen control modules to synchronize and play the respective MPUs of the first and second streaming data in accordance with the identified playback time information.