Low-Latency Data Transfer Paths Bypassing Network Intermediaries
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cloud-based network-accessible services often experience high latency due to the use of multiple network function execution intermediaries (NFEIs) for message transfers between client programs and network-accessible services.
Innovation Solution
The implementation of rules or algorithms that allow for the bypassing of NFEIs by enabling network managers (NMs) to execute sequences of network functions at a single host, reducing the need for intermediary devices and thus lowering latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple network function execution intermediaries are used for message transfers, then network security and service management are improved, but latency increases
Solution Approach 1:
The patent segments the network function execution into two distinct phases: (1) connectivity establishment phase where messages traverse multiple NFEIs for security processing, and (2) data transfer phase where established connections bypass NFEIs for low-latency communication. This segmentation allows security requirements to be met during connection setup while achieving low latency during actual data transfer.
Solution Approach 2:
The patent performs preliminary network function execution during the connectivity establishment phase, where all necessary security checks, authentication, and service management functions are executed before data transfer begins. This preliminary action ensures that subsequent data transfers can proceed without repeating these operations, thereby reducing latency.
2Adaptability or versatility
If multiple network function execution intermediaries are used, then service management capabilities are improved, but message transfer speed deteriorates
Solution Approach 1:
The patent divides message transfer into two segments: connection establishment messages that require full NFEI processing for service management, and subsequent data transfer messages that bypass NFEIs. This segmentation preserves service management capabilities where needed while maximizing transfer speed where possible.
Solution Approach 2:
The patent introduces a connection cache as an intermediary component that stores established connection information. Once a connection is established through multiple NFEIs, the connection cache enables subsequent messages to bypass the NFEI chain, thereby maintaining service management oversight during connection setup while achieving high-speed transfers during data movement.
3Loss of time
If NFEIs are bypassed using rules or algorithms, then latency is reduced, but network function execution capability may be compromised
Solution Approach 1:
The patent executes all necessary network functions preliminarily during the connectivity establishment phase through the full NFEI chain. Connection establishment messages traverse all NFEIs to perform security checks, authentication, and service management operations. Once connection is established, the cached connection information enables bypassing NFEIs for subsequent transfers without compromising network function execution, as these functions have already been performed.
Solution Approach 2:
The patent implements a feedback mechanism where the system continuously monitors connection status and dynamically adjusts the message path. Connection establishment messages receive feedback to traverse the full NFEI chain, while subsequent data transfer messages receive feedback indicating that NFEI bypass is safe and optimal. This feedback-driven approach ensures network function execution reliability while minimizing latency.
Data Source
AI summary
A network function execution intermediary obtains a result of execution of a set of network functions on a particular packet directed to a service from a client program running at a first host. Using the result, the packet is delivered to a request handler of the service, running at a second host; the path used for delivering the particular packet includes the network function execution intermediary. A networking manager of the first host obtains a rule for determining results of the set of network functions with respect to additional packets directed from the client program to the service. The networking manager causes, using the rule, another packet originating at the client program to be delivered to the request handler via a different path which does not include the network function execution intermediary.