Reliable Streaming System Failover and Caching Architecture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current media streaming architectures face challenges such as tight coupling between server and client, limited scalability, inability to quickly adapt to changing network conditions, and lack of caching for live media, leading to latency and reduced attendance for live events.
Innovation Solution
A reliable streaming system with a robust server architecture that includes failover mechanisms, support for short-lived connections, ingest server failover, push proxy for bandwidth savings, and media data fragmentation for caching by existing Internet infrastructure, along with a distribution server for regional content syndication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a stateful connection between client and server is used to track client state, then the server can manage streaming sessions, but server overhead increases and scalability is limited
Solution Approach 1:
The patent segments the server architecture into multiple independent server instances that can handle client connections. Each server can operate autonomously, and client sessions can be distributed across multiple servers, reducing the overhead burden on any single server while maintaining session management capabilities.
Solution Approach 2:
The patent introduces a session management intermediary layer that handles state tracking separately from the media streaming functionality. This mediator component manages client state information, allowing servers to focus on media delivery without bearing the full overhead of session management, thus improving scalability.
2Reliability
If the server tracks client state in real-time to adapt to changing network conditions, then media delivery can be optimized, but the server cannot react quickly enough causing breaks in media playback
Solution Approach 1:
The patent implements preliminary action by pre-adapting media streams to multiple bitrate versions before delivery. When network conditions change, the client can immediately switch between pre-prepared stream versions without waiting for server adaptation, eliminating playback breaks while maintaining reliable delivery.
Solution Approach 2:
The patent implements a feedback mechanism where clients continuously report network conditions to servers, and servers respond by adjusting stream parameters. This closed-loop feedback enables the system to adapt to changing conditions while maintaining media delivery reliability.
3Reliability
If clients buffer data to avoid playback breaks, then media delivery reliability improves, but latency increases which is unacceptable for live events
Solution Approach 1:
The patent applies partial buffering by maintaining small buffers for error correction and packet reassembly rather than large buffers for latency tolerance. This partial action provides sufficient playback continuity for reliable delivery while minimizing latency for live events.
Solution Approach 2:
The patent dynamically changes buffering parameters based on network conditions and event type. For live events, buffering parameters are adjusted to minimize latency while maintaining adequate error handling, whereas for recorded content, larger buffers can be used for improved reliability.
4Reliability
If live media is delivered without caching to maintain freshness, then content is always up-to-date, but the number of parallel viewers and requests that servers can handle is limited
Solution Approach 1:
The patent merges live streaming delivery with HTTP caching infrastructure by making stream segments cacheable through standard web protocols. This combination allows cached segments to be served to multiple clients simultaneously, increasing concurrent viewer capacity while maintaining content freshness through periodic updates from the live source.
Solution Approach 2:
The patent creates multiple copies of media stream segments that can be distributed and cached across the network. These copies can be served to multiple clients simultaneously, allowing the system to handle many parallel viewers while the original source continues to receive updates, thus maintaining content freshness.
5Productivity
If specialized cache hardware is used to cache streaming media, then caching functionality is achieved, but existing HTTP-based Internet caching infrastructure cannot be utilized
Solution Approach 1:
The patent implements universality by designing the streaming system to work with existing HTTP-based caching infrastructure that already exists on the Internet. By making stream segments cacheable through standard web protocols, the system can utilize the vast existing cache network rather than requiring specialized caching hardware, reducing device complexity while maintaining caching capability.
Data Source
AI summary
A reliable streaming system increases reliability of live and on-demand streaming media events through a robust server architecture that allows fast failover and recovery in the event of network, hardware, or other failures. The system provides for failover of encoders, ingest servers, which receive encoded media data from encoders, and origin servers, which serve as the retrieval point of last resort for connecting clients. The system also provides a push proxy mechanism that allows one copy of data to feed redundant servers and pre-warm caches, saving on provisioned bandwidth. In addition, the system provides a distribution server role that allows content to be automatically syndicated to a region when needed. Thus, the reliable streaming system provides a streaming solution with no single point of failure and redundancy and fast failover built into the content network architecture.