Shuffle Request Buffering for Isolated Live Streaming Traffic
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing demand for live streaming content and diverse media formats poses challenges for media distribution services, including latency issues, resource overload, and potential security risks, while managing separate records and formats increases costs and complexity.
Innovation Solution
Implementing a shuffle-based request buffer to distribute requests uniformly across storage nodes, using shuffle sharding to isolate users, and separating resource fleets for manifests and segments to optimize scaling and resilience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a large number of users concurrently access the same set of resources, then content availability and access capability are improved, but the risk of malicious actors taking down resources and the system's vulnerability increase
Solution Approach 1:
The patent segments the system into separate resource fleets (manifest fleet and segment fleet) and isolates users through shuffle sharding, assigning different subsets of resources to different users. This segmentation ensures that a malicious actor affecting one user's resources cannot easily take down other users' resources, thus reducing system vulnerability while maintaining content access capability.
2Manufacturing precision
If separate records and files are maintained for various formats and configurations, then content delivery accuracy is improved, but cost and system complexity increase
Solution Approach 1:
The patent implements a universal resource pool where resources can serve multiple users and content formats through shuffle sharding and dynamic allocation. Instead of maintaining separate records for each user-format combination, the system uses a single resource pool that can be dynamically assigned to different users based on their needs, reducing system complexity while maintaining content delivery accuracy.
3Speed
If request traffic is not distributed uniformly, then request processing speed is improved for individual requests, but latency increases during traffic spikes and resource overload occurs
Solution Approach 1:
The patent implements a request buffer that holds incoming requests before they are processed, allowing the system to smooth out traffic spikes. By buffering requests and processing them at a controlled rate, the system maintains steady request processing speed while avoiding latency during traffic spikes and preventing resource overload.
4Productivity
If resources are shared among all users, then resource utilization efficiency is improved, but the impact of malicious actors on other users increases
Solution Approach 1:
The patent applies local quality by assigning different subsets of resources to different users through shuffle sharding. Each user gets a specific subset of resources with certain qualities (isolation properties), while the overall system maintains high resource utilization. This local differentiation ensures that malicious actors can only affect their own subset of resources, preventing cross-user impact while maintaining overall resource efficiency.
Data Source
AI summary
Approaches are disclosed for managing aspects of content delivery in a multi-tenant environment. A request buffer can be used to remove correlations between requests and randomly shuffle requests without storing all the requests concurrently. A shuffle sharding algorithm can be used to randomly allocate a subset of resources to different users in order to ensure less than a maximum risk of one user impacting the use of all resources allocated to other users. In some embodiments, separate fleets of resources can be maintained for manifests and video segments to allow for more accurate scaling and customization. Multiple manifests can also be associated with a single endpoint to allow multiple media players to obtain similar content segments from the single endpoint.