Parallel Cache Server Load Arbitration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As the number of mobile electronic devices accessing web content increases, existing systems face challenges in efficiently managing the load on content servers, leading to potential overload and delays in delivering up-to-date information to users.
Innovation Solution
A system comprising multiple content cache servers, data loaders, and feed servers is implemented, where cache servers store current content and data loaders periodically update this content from a source, with feed servers arbitrating requests and using a round-robin selection process to distribute load, and sending messages to devices to retry requests when content is not available, thereby reducing synchronous connections and server burden.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple mobile electronic devices access web content simultaneously, then information availability increases, but server load increases leading to overload and delays
Solution Approach 1:
The system divides the server infrastructure into multiple cache servers that store content locally. Each cache server handles a portion of the request load independently, segmenting the overall server workload to prevent single-point overload and improve response times for multiple simultaneous device accesses.
Solution Approach 2:
Content is pre-loaded and cached on cache servers before being requested by mobile devices. This preliminary action of storing content in advance allows the system to serve multiple devices simultaneously without real-time server processing delays, improving both availability and response speed.
2Loss of information
If content is frequently updated to stay current, then information freshness improves, but server burden increases
Solution Approach 1:
Cache servers act as intermediaries between the content source and mobile devices. They maintain local copies of content and can serve updates independently without requiring direct communication with the source server for every request, reducing server burden while maintaining information freshness through periodic updates.
Solution Approach 2:
The system implements periodic content updates where cache servers refresh their content at scheduled intervals rather than continuously. This periodic action maintains information freshness while reducing the overall server burden compared to real-time continuous updates.
3Measurement precision
If synchronous connections are used for content requests, then response accuracy improves, but server load increases causing delays
Solution Approach 1:
Cache servers autonomously manage their own content storage and delivery without requiring constant synchronous verification with the source server. They serve content from local caches independently, reducing synchronous connection requirements while maintaining delivery accuracy through cached data integrity.
Data Source
AI summary
A system of content delivery is provided. The system comprises cache servers, data loaders, and content feed servers. The cache servers store content. The data loaders communicate with the content cache servers, and each data loader writes updated content to each of the content cache servers. The data loaders schedule the retrieval of the updated content from content sources based on a refresh period. The data loaders arbitrate periodically to prevent duplication of file entries. The content feed servers are in communication with the content cache servers and each of the data loaders. Each feed server receives a request for content from an electronic device and requests the content from one of the content cache servers. When the content cache server replies that the requested content is not available, the feed server sends the request for the content to one of the data loaders.