Cache-Based Latency Virtualization for Mesh Cloud Transport
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mesh or connectionless data transport networks often fail to maintain consistent latency, leading to unacceptable variations that can impact latency-sensitive applications, such as synchronous mirroring storage area network (SAN) and video traffic, which require minimal absolute latency and cannot tolerate wide momentary swings in latency.
Innovation Solution
A cache device is placed on the connection path between user computers and the network, equipped with a processor and cache memory to measure latency, determine an acceptable range based on application requirements, and store data if the latency exceeds this range, thereby insulating applications from network path virtualization and performance variations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If mesh or connectionless transport is used for data communication, then network flexibility and routing options are improved, but latency consistency and reliability deteriorate
Solution Approach 1:
A cache device is introduced as an intermediary component between the mesh network and the application. This cache device measures latency, compares it against acceptable ranges, and stores data packets when latency exceeds thresholds. By acting as a mediator, the cache device isolates the application from network latency variations, allowing the system to use flexible mesh routing while maintaining reliable latency performance for latency-sensitive applications.
2Reliability
If data is cached to compensate for high latency, then latency consistency is improved, but device complexity and memory requirements increase
Solution Approach 1:
The cache device dynamically adjusts its behavior based on measured latency parameters. It measures actual network latency, compares it against an acceptable latency range, and only activates caching when latency exceeds the threshold. This parameter-driven approach allows the system to maintain simplicity during normal operation while automatically engaging cache functionality only when needed, thus improving latency consistency without permanently increasing device complexity.
3Productivity
If latency measurement and caching operations are performed, then application performance is improved, but processing overhead and energy consumption increase
Solution Approach 1:
The cache device performs latency measurement and caching operations selectively rather than continuously. It measures latency and only executes caching actions when the measured latency falls outside the acceptable range. This partial action approach provides application performance improvement only when needed, reducing unnecessary processing overhead and energy consumption during periods when network latency is already within acceptable limits.
Data Source
AI summary
A cache device is disposed on a connection path between a user computer executing a software application and a network. The application exchanges data with a further computer via the network. The cache device includes a cache memory and a processor. The cache device is configured to measure, by the processor, a first latency between the user computer and the further computer. The cache device is further configured to determine an acceptable latency range based on the latency and a requirement of the software application. The cache device is further configured to measure a second latency between the user computer and the further computer. The cache device is further configured to store, in the cache memory, a set of data transmitted from the user computer to the further computer, if the second latency is not within the acceptable latency range.