Self-Tuning Cache Management for Media Adaptation Servers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media caching systems do not effectively utilize cache capacity by inefficiently managing the caching of media files and their adapted versions, leading to repeated downloads and re-adaptations of media files.
Innovation Solution
A self-tuning cache management system that dynamically adjusts the hit threshold based on cache space and object popularity, using a hits distribution list and time-to-live (TTL) window to prioritize caching of frequently requested objects and remove expired ones, ensuring optimal cache utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If media files are cached without a hit threshold mechanism, then cache capacity is utilized more aggressively, but cache efficiency deteriorates due to caching of rarely requested objects
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting the hit threshold parameter based on cache capacity and request patterns. The system monitors the number of hits for each media file and only caches files that exceed the dynamically calculated threshold, transforming the static caching decision into a dynamic parameter-based control mechanism that optimizes both cache utilization and bandwidth efficiency
Solution Approach 2:
The system implements feedback by continuously monitoring hit counts for cached media files and using this information to adjust the hit threshold and caching decisions. The cache management system receives feedback about request patterns and modifies its behavior accordingly, creating a closed-loop control system that adapts to changing traffic patterns and optimizes cache performance over time
2Loss of energy
If all requested media files are cached, then bandwidth usage is reduced, but cache capacity is wasted on rarely requested objects
Solution Approach 1:
The patent applies local quality by treating different media files differently based on their individual request patterns and popularity. Instead of applying a uniform caching policy to all files, the system evaluates each file's hit count separately and makes localized caching decisions, ensuring that cache space is allocated to files that will actually benefit from caching while avoiding waste on unpopular content
Solution Approach 2:
The system implements partial action by caching only a subset of requested media files - specifically those that exceed the dynamically determined hit threshold. Rather than caching all requested files (excessive action) or using a fixed conservative threshold (insufficient action), the system applies partial caching targeted at files with sufficient demand, optimizing the balance between bandwidth savings and cache utilization
3Ease of operation
If a fixed hit threshold is used for caching, then caching decisions are simple and fast, but adaptability to changing request patterns is poor
Solution Approach 1:
The patent applies dynamics by transforming the static, fixed hit threshold into a dynamic parameter that automatically adjusts based on cache capacity and observed request patterns. The system continuously monitors caching performance and modifies the threshold value in response to changing conditions, enabling the caching mechanism to adapt to varying traffic patterns, seasonal demands, and emerging popular content without manual intervention
Data Source
AI summary
Web objects, such as media files are sent through an adaptation server which includes a transcoder for adapting forwarded objects according to profiles of the receiving destinations, and a cache memory for caching frequently requested objects, including their adapted versions. The probability of additional requests for the same object before the object expires, is assessed by tracking hits. Only objects having experienced hits in excess of a hit threshold are cached, the hit threshold being adaptively adjusted based on the capacity of the cache, and the space required to store cached media files. Expired objects are collected in a list, and may be periodically ejected from the cache, or when the cache is nearly full.