Video CDN Cache Sizing and Popularity-Based Asset Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video on demand (VOD) systems face inefficiencies in cache management due to linear scaling of local caches, which leads to unnecessary replication and high costs, and the 'most recently requested' algorithm fails to account for variable asset sizes and network costs, resulting in suboptimal performance.
Innovation Solution
A method to determine a preferred cache size for edge caches based on bandwidth availability, title dispersion data, and maximum cache memory, and implement an asset replacement algorithm considering popularity and size, enabling efficient caching and resource optimization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If local caches are sized linearly as content increases, then cache capacity increases, but unnecessary replication and costs increase
Solution Approach 1:
The patent changes the scaling parameter from linear to logarithmic, where cache size grows proportionally to the logarithm of total content size rather than linearly. This mathematical transformation allows the system to maintain adequate cache capacity for growing content libraries while dramatically reducing the rate of capacity increase, thereby avoiding unnecessary replication and associated costs.
Solution Approach 2:
The patent implements dynamic cache sizing that adapts to actual usage patterns and content popularity rather than static linear scaling. The system continuously monitors request patterns and adjusts cache allocation dynamically, ensuring capacity is allocated where most needed while avoiding waste on rarely accessed content.
2Reliability
If larger caches are implemented, then user satisfaction improves, but device complexity and cost increase
Solution Approach 1:
The patent transforms the cache management approach by changing from fixed linear sizing to dynamic logarithmic sizing based on actual content distribution patterns. This parameter change simplifies the management complexity while maintaining or improving user satisfaction, as the system automatically adapts to usage patterns without requiring complex manual configuration.
Solution Approach 2:
The system implements self-service cache management where the cache automatically adjusts its own size and content based on monitored usage patterns and request frequencies. This eliminates the need for complex external management while improving reliability through data-driven decisions about what content to cache.
3Ease of operation
If 'most recently requested' algorithm is used, then cache replacement is simple, but network costs increase due to variable asset sizes
Solution Approach 1:
The patent modifies the cache replacement parameter from simple recency-based eviction to a composite metric that incorporates both recency and asset size. This allows the system to prioritize eviction of large, rarely accessed assets over smaller or more frequently accessed content, reducing network costs for re-fetching content while maintaining operational simplicity.
Solution Approach 2:
The system implements feedback mechanisms that monitor network costs and usage patterns, using this information to dynamically adjust which assets are evicted from cache. This feedback loop ensures that replacement decisions account for variable asset sizes and their associated network costs, optimizing the balance between simplicity and cost efficiency.
Data Source
AI summary
Cache management techniques are described for a content distribution network (CDN), for example, a video on demand (VOD) system supporting user requests and delivery of video content. A preferred cache size may be calculated for one or more cache devices in the CDN, for example, based on a maximum cache memory size, a bandwidth availability associated with the CDN, and a title dispersion calculation determined by the user requests within the CDN. After establishing the cache with a set of assets (e.g., video content), an asset replacement algorithm may be executed at one or more cache devices in the CDN. When a determination is made that a new asset should be added to a full cache, a multi-factor comparative analysis may be performed on the assets currently residing in the cache, comparing the popularity and size of assets and combinations of assets, along with other factors to determine which assets should be replaced in the cache device.