VOD Server Shadow Streams for Fault Tolerance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Video-on-Demand (VOD) systems face challenges in efficiently managing media content storage and streaming, particularly in balancing storage and retrieval efficiency with bandwidth performance, and ensuring stream fault tolerance across multiple servers.
Innovation Solution
Implementing a hierarchical caching system that organizes temporary storage locations into multiple layers based on media content popularity, using faster memory for popular content and slower memory for less popular content, and generating shadow streams for backup in case of server failures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If media content is stored in distributed cache storage across multiple servers, then storage capacity and retrieval efficiency are improved, but system reliability deteriorates due to potential server failures
Solution Approach 1:
The system proactively creates shadow streams in advance before any failure occurs. When a media stream is established from a source server to destination devices, a corresponding shadow stream is simultaneously created from a different source server. This preliminary action ensures that backup streaming paths are ready immediately if the primary server fails, resolving the contradiction by preparing reliability measures without impacting storage efficiency.
Solution Approach 2:
The system dynamically adjusts stream parameters based on server health status. When a server failure is detected, the system changes the source server parameter for affected streams, redirecting them to shadow streams from alternative servers. This parameter change enables the system to maintain reliability while preserving the efficient distributed cache architecture.
2Power
If multiple media streams are created from multiple caches to balance load, then bandwidth performance is improved, but device complexity increases
Solution Approach 1:
The system creates shadow copies of stream configurations rather than managing entirely independent streams. Each shadow stream replicates the state information (buffer locations, identifiers, logical portion source files) of its primary stream counterpart. This copying approach simplifies management by using template-based replication, allowing the system to handle multiple streams for load balancing without proportionally increasing complexity.
Solution Approach 2:
The stream management system is designed to handle both primary and shadow streams through a unified mechanism. The same state information structure and management logic serve multiple purposes: tracking active streams, managing backup streams, and enabling failover. This multi-functionality allows the system to achieve improved bandwidth performance through multiple streams without linearly increasing device complexity.
3Reliability
If shadow streams are established for all media streams, then reliability is improved, but loss of time for stream setup increases
Solution Approach 1:
Shadow streams are established in advance as part of the primary stream creation process, not after failure occurs. By performing this action preliminarily, the system avoids time-consuming stream setup during failure recovery. The state information for shadow streams is prepared beforehand, including buffer locations and source file identifiers, enabling immediate failover without setup delays.
Solution Approach 2:
The system implements automatic failover mechanisms where shadow streams self-activate when their primary counterparts fail. This self-service approach eliminates manual intervention and reduces the time loss associated with detecting failures and switching to backup streams. The system autonomously manages the transition, maintaining reliability while minimizing time loss.
Data Source
AI summary
Embodiments of the present invention: provide, from a first VOD server having a first cache, a first media presentation to a first group of user devices and a second media presentation to a second group of user devices; provide, from a second VOD server having a second cache, a third content to a third group of user devices; measure a first popularity corresponding to the first media presentation and a second popularity corresponding to the second media presentation; store a copy of the first media presentation on the second cache based on the first popularity and the second popularity; determine when the first VOD server fails to continue to provide the first media presentation; and provide, from the second VOD server, the first media presentation to the first group of user devices, wherein the first cache has the first media presentation stored therein, and wherein the second cache has the second media presentation stored therein.