Cache Key Composition for Fragmented Content Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cache-key generation methods lead to cache fragmentation and increased cache misses for less popular device variations, resulting in delayed and ineffective content delivery, which negatively impacts user experience and increases costs.
Innovation Solution
A computer-implemented method for just-in-time cache key composition creation and distribution, where user traits such as geographic location, software, and device type are used to dynamically generate and optimize content variations, allowing for a single response to be tailored for each user, and enabling multiple layers of caching with passive contracts to accommodate variations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If cache-key is created for each user request with multiple user attributes (browser kind, device type, geography, etc.), then content delivery is optimized for each user, but cache fragmentation increases and cache hit rates decrease
Solution Approach 1:
The patent segments user attributes into different priority levels (primary vs. secondary attributes). Primary attributes like device type and geography that significantly impact content delivery are used to create cache keys, while less critical attributes are excluded. This segmentation reduces cache fragmentation while maintaining effective content optimization for different user groups.
Solution Approach 2:
The patent creates a universal cache key structure that can serve multiple user types with similar characteristics. Instead of creating unique cache keys for every possible combination of user attributes, the system designs cache keys that represent groups of users with comparable content delivery needs, allowing a single cached response to serve multiple users effectively.
2Reliability
If multiple cache layers are created to offset re-generation, then content availability is improved, but popularity-based LRU caching pushes less popular content out, diminishing effectiveness for less-popular device variations
Solution Approach 1:
The patent applies different caching strategies to different cache layers based on their specific functions. The first cache layer (edge cache) is optimized for high-speed delivery of popular content, while the second cache layer (origin cache) is designed to handle less popular variations and regenerate content when needed. Each cache layer has tailored retention policies that match its role in the content delivery system.
Solution Approach 2:
The system pre-loads and caches content for less popular device variations in the origin cache before they are requested, based on predictive analytics of potential user needs. This preliminary action ensures that when users with less popular device types access the system, their content is already available in the cache rather than requiring regeneration at the moment of request.
3Reliability
If pre-generation is used to pre-populate caches with all variations, then cache hit rates improve, but computation costs and time delays for generating all permutations increase
Solution Approach 1:
The patent implements partial pre-generation by selectively caching only the most critical and frequently accessed content variations in the edge cache, while leaving less critical variations to be generated on-demand or cached in the origin layer. This partial action approach achieves sufficient cache hit rates for high-priority content without incurring the excessive computation costs of generating all possible content permutations.
Data Source
AI summary
There is disclosed herein computer implemented methods of cache key generation including receiving from a user a request for content; wherein the request comprises one or more of opening a browser software tab or window, launching a software application, activating a hyperlink; wherein the request causes an electronic communications network connection to be established and/or an HTTP request made; and wherein, the surrogate passes the request to an origin.