Network Connector Pre-Establishment for PoP Latency Reduction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Cloud-based network connection setup latency is increased due to the need for multiple TCP connections between client and server, especially when Points of Presence (PoPs) are geographically distant, leading to inter-PoP communication overhead and decreased user experience.

Innovation Solution

A connector establishes initial and subsequent connections between PoPs to facilitate traffic between clients and a server, pre-establishing connections to reduce setup delays by leveraging proximity-based selection and caching of connection data, thereby avoiding inter-PoP communication overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple TCP connections are established between client and server across geographically distant PoPs, then service accessibility is improved, but connection setup latency increases

Engineering Contradiction:

Improveservice accessibilityVSAvoidconnection setup latency

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by establishing TCP connections between PoPs in advance before clients need to access services. The connector proactively creates connections between PoP proxies, so when a client requests service, the connection path is already prepared, eliminating setup latency while maintaining multi-PoP service accessibility

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If connections are established dynamically when clients request service, then connection accuracy to nearest PoP is improved, but inter-PoP communication overhead increases

Engineering Contradiction:

ImprovePoP location matching accuracyVSAvoidinter-PoP communication overhead

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

Inventive Principle:

Principle #10Preliminary action

3Speed

If connection data is cached at PoP proxies, then connection establishment speed is improved, but memory resource usage increases

Engineering Contradiction:

Improveconnection establishment speedVSAvoidmemory resource usage

Core Design Contradiction:

SpeedVSQuantity of substance

Solution Approach 1:

The system applies local quality by implementing caching selectively at PoP proxies rather than uniformly across all system components. Connection data is cached locally at each PoP proxy where it is most needed, enabling fast connection establishment for local clients while avoiding unnecessary memory usage in other parts of the system

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS11272014B2Systems and methods for reducing connection setup latency

Publication Date: 2022.03.08 CITRIX SYSTEMS INC

AI summary

Systems and methods for reducing latency in connection setup include a connector for connecting a server hosting a service to a network. The connector may establish a first connection between the connector and a first proxy of a first point of presence (PoP) of the network. The connector may receive, from the first proxy, a connection request to establish a second connection between the connector and a second proxy of a second PoP of the network associated with a plurality of clients. The first proxy may generate the connection request responsive to a first client of the plurality of clients requesting access to the service through the second proxy. The connector may establish the second connection between the connector and the second proxy, to facilitate exchange of traffic between the plurality of clients and the service across the network.