Distributed Caching via Data Partitioning and Proxy Servers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current communication networks face inefficiencies in accessing large data resources, as devices often need to download entire files before accessing specific portions, leading to significant time delays and increased network usage due to multiple requests for partial data.
Innovation Solution
Implementing distributed caching by partitioning data resources into smaller segments, which are then distributed across multiple proxy servers, allowing requesting devices to access specific partitions directly from the nearest server, reducing latency and overall access time through a hierarchical caching system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a device downloads an entire data resource from a server before accessing specific portions, then the device can service random access requests from applications, but the access time is significantly delayed until the entire file is downloaded
Solution Approach 1:
The patent divides large data resources into smaller partitions and distributes them across multiple proxy servers. This segmentation allows devices to access only the specific partitions they need without downloading entire files, thereby reducing access latency while maintaining random access capability.
Solution Approach 2:
The patent pre-partitions data resources and distributes them to proxy servers before any access requests occur. This preliminary action enables devices to directly access specific partitions from the nearest proxy server without waiting for entire file downloads, solving the time delay problem while preserving random access functionality.
2Productivity
If a requesting device issues multiple HTTP Range Requests to obtain portions of a data resource, then it can access specific data portions, but the multiple requests with associated network delays and roundtrip transmission times require more overall time than a single transmission of the entire data resource
Solution Approach 1:
The patent introduces proxy servers as intermediaries between devices and the origin server. These proxy servers cache data resource partitions locally, allowing devices to access specific partitions from the nearest proxy server without issuing multiple requests to the origin server. This eliminates the cumulative network delays and roundtrip transmission times associated with multiple HTTP Range Requests.
Solution Approach 2:
By partitioning data resources and distributing them across multiple proxy servers, the system enables parallel access to different partitions from different servers simultaneously. This segmentation approach allows devices to retrieve multiple data portions in parallel rather than sequentially, significantly improving data retrieval efficiency while reducing overall access time.
3Device complexity
If data resources are stored on a single server, then the system structure is simple, but the network traffic and access time increase when multiple devices request data from the same server
Solution Approach 1:
The patent segments data resources into partitions and distributes them across multiple proxy servers. This segmentation allows network traffic to be spread across multiple servers rather than concentrated on a single server, improving network efficiency and reducing access times for multiple devices while maintaining a relatively simple hierarchical system structure.
Solution Approach 2:
The patent introduces a spatial dimension to the storage architecture by distributing data partitions across multiple proxy servers located at different network positions. This dimensional change from a single centralized server to a distributed network of servers enables parallel data access, improving network efficiency and productivity while the hierarchical organization maintains manageable system complexity.
Data Source
AI summary
Example systems and methods of caching data in a communication network are presented. In one example, a data resource at an originating server of the communication network is partitioned into multiple data partitions. At the originating server, a unique address is assigned to each of the data partitions. Each of the data partitions is distributed to at least one of a plurality of proxy servers based on the unique addresses. Each of the proxy servers is configured to receive a read request for one of the data partitions stored at the proxy server, and to transmit the one of the data partitions to a source of the read request in response to the read request.