URL Replication for Live Broadcast Cache Stability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cache systems face challenges in maintaining a high cache hit rate while preventing overload during live broadcasting events, where simultaneous client requests can overwhelm the system, leading to potential crashes.
Innovation Solution
Implementing a request processing tier with proxy servers that coalesce client requests and use an exponential backoff algorithm to delay responses, and duplicating URLs to distribute the load across cache servers, thereby reducing the number of requests and cache misses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cache systems store popular content closer to users to reduce latency and bandwidth requirements, then cache hit rate increases and content delivery efficiency improves, but the system becomes vulnerable to overload when receiving simultaneous client requests during live broadcasting events
Solution Approach 1:
The patent segments the cache system into multiple independent cache servers (first cache server, second cache server, etc.) that can independently handle subsets of client requests. This segmentation distributes the load across multiple units, preventing any single server from becoming overwhelmed during simultaneous request bursts while maintaining high cache hit rates through collective caching capability.
Solution Approach 2:
The patent introduces a URL replication mechanism that acts as an intermediary layer between client requests and cache servers. When a URL is received, the system replicates it across multiple cache servers, distributing the request load. This intermediary replication strategy prevents direct overload on individual cache servers while maintaining efficient content delivery through the caching layer.
2Productivity
If cache systems serve a higher number of requesters with fewer cache systems to optimize hit rate, then each cache system handles more traffic, but the likelihood of overloading individual cache systems increases
Solution Approach 1:
The patent divides the cache system into multiple segmented cache servers, each capable of independently serving client requests. This segmentation allows the system to handle higher total request volumes by distributing traffic across multiple units, while each individual server maintains manageable load levels, preserving system stability and reliability.
Solution Approach 2:
The patent combines multiple cache servers into a unified cache system architecture where servers work collectively to serve client requests. By merging the capabilities of multiple servers while maintaining their operational independence through URL replication, the system achieves higher overall productivity while distributing risk and preventing single-point failures.
Data Source
AI summary
Several embodiments include a live stream system in a media distribution network. The live stream system can divide a broadcast stream from a broadcaster device into one or more media segments. The live stream system can generate an original manifest uniform resource locator (URL) and a duplicate manifest URL to associate with the media segments. The live stream system can generate a broadcast manifest that identifies the media segments via one or more segment identifiers. The live stream system can upload the broadcast manifest and the media segments to a cache system to make the broadcast manifest accessible via either the original manifest URL or the duplicate manifest URL.