Latency Virtualization Cache for Consistent Cloud Transport

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Mesh or connectionless data transport networks often fail to maintain consistent latency, leading to unacceptable variations that can impact latency-sensitive applications, such as synchronous mirroring storage area network (SAN) and video traffic, which require minimal absolute latency and cannot tolerate wide momentary swings in latency.

Innovation Solution

A cache device is placed on the connection path between user computers and the network, equipped with a processor and cache memory to measure latency, determine an acceptable range based on application requirements, and store data if the latency exceeds this range, thereby insulating applications from network path virtualization and performance variations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mesh or connectionless transport is used for data communication, then network flexibility and routing options are improved, but latency consistency and reliability deteriorate

Engineering Contradiction:

Improvenetwork flexibilityVSAvoidlatency consistency

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

A cache device is introduced as an intermediary component between the user computer and the network. This cache device monitors latency measurements and selectively caches data packets when latency exceeds acceptable thresholds, thereby mediating between the flexible mesh network and the latency-sensitive application to ensure consistent performance

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary latency measurement and evaluation before data transmission. By measuring latency beforehand and determining acceptable ranges based on application requirements, the system can proactively cache data when latency issues are detected, preventing performance degradation before it occurs

Inventive Principle:

Principle #10Preliminary action

2Reliability

If latency measurement and caching operations are implemented, then application performance stability is improved, but device complexity increases

Engineering Contradiction:

Improveapplication performance stabilityVSAvoidcache device complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The cache device dynamically adjusts its operation based on latency parameters. By measuring latency and comparing it against application-specific acceptable ranges, the system changes its behavior (caching or non-caching) based on these parameter evaluations, providing intelligent control without excessive complexity

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS8397138B2Method and system for network latency virtualization in a cloud transport environment

Publication Date: 2013.03.12 AT&T INTELLECTUAL PROPERTY I L P

AI summary

A cache device is disposed on a connection path between a user computer executing a software application and a network. The application exchanges data with a further computer via the network. The cache device includes a cache memory and a processor. The cache device is configured to measure, by the processor, a first latency between the user computer and the further computer. The cache device is further configured to determine an acceptable latency range based on the latency and a requirement of the software application. The cache device is further configured to measure a second latency between the user computer and the further computer. The cache device is further configured to store, in the cache memory, a set of data transmitted from the user computer to the further computer, if the second latency is not within the acceptable latency range.