Media Stream Synchronization Points for Scalable Interactive Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging products do not scale to the same levels as the mature media streaming infrastructure in content delivery networks (CDNs), making it challenging to provide immersive and interactive experiences in live streaming services.
Innovation Solution
Embedding a messaging channel directly into a media stream, where messages are extracted at a client media player, or using a coordination index to synchronize data streams with media playback, leveraging the CDN's native delivery infrastructure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If existing messaging products are deployed alongside media streams, then interactive capabilities are provided, but scalability is limited compared to media streaming infrastructure
Solution Approach 1:
The patent merges the messaging channel with the media stream by embedding messages as data packets within the media stream protocol. This integration allows the messaging system to leverage the existing scalable media streaming infrastructure, achieving mass scalability while providing interactive capabilities. Messages are transmitted through the same CDN network that delivers media content, eliminating the need for separate messaging infrastructure.
Solution Approach 2:
The media stream protocol is enhanced to serve dual purposes: delivering media content and transporting messaging data. By making the media stream infrastructure universal enough to handle both media packets and message packets, the system achieves both scalability (from the media infrastructure) and interactive capabilities (through message embedding).
2Productivity
If messages are embedded directly in the media stream, then scalability is achieved using CDN infrastructure, but synchronization between messages and media frames must be maintained
Solution Approach 1:
The system performs preliminary actions by embedding synchronization metadata within the media stream packets before delivery. This metadata contains timing and sequence information that enables the client to pre-synchronize message extraction with media frame playback, ensuring reliable synchronization without requiring complex real-time coordination during stream delivery.
Solution Approach 2:
The synchronization mechanism incorporates feedback loops where the client monitors the arrival and playback of media frames, then adjusts message extraction and display timing accordingly. This feedback ensures that messages remain synchronized with the media content even in the presence of network variability, maintaining reliability while leveraging scalable CDN infrastructure.
3Device complexity
If all message data is embedded in the media stream, then single ingest point is achieved, but bandwidth usage increases
Solution Approach 1:
Instead of embedding complete message data in every media stream packet, the system uses partial embedding by including only essential synchronization metadata in the stream. The actual message content is transmitted separately or reconstructed at the client, reducing bandwidth consumption while maintaining the single ingest point architecture for the critical synchronization signals.
Data Source
AI summary
A messaging channel is embedded directly into a media stream. Messages delivered via the embedded messaging channel are extracted at a client media player. In lieu of embedding the message data in the media stream, a coordination index is injected, and the message data is sent separately and merged into the media stream downstream (at the media player) based on the index. In one example embodiment, multiple data streams (each potentially with different content intended for a particular “type” or class of user) are transmitted alongside the video stream in which the coordination index has been injected into a video frame. Based on a user's service level, a particular one of the multiple data streams is released when the sequence number appears in the video frame, and the data in that stream is associated with the media.