Proxy-Based Endpoint Connection Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud environments are closed ecosystems, restricting customers to using only the services offered by a specific cloud service provider, making it difficult for customers to access services from different providers.
Innovation Solution
The use of a network layer proxy and an application layer proxy to facilitate connection establishment between a client and an endpoint, allowing for the selection of the most suitable endpoint while reducing network latency by establishing a single connection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a customer uses a closed cloud environment from a specific CSP, then service reliability within that environment is improved, but adaptability to access services from different CSPs deteriorates
Solution Approach 1:
The patent introduces a proxy server as an intermediary component that mediates between clients and services across different cloud environments. The proxy receives connection requests, selects appropriate backend services from different CSPs, and establishes connections on behalf of clients, thereby enabling cross-cloud service access while maintaining the reliability of individual cloud environments.
2Adaptability or versatility
If multiple connections are established to access services from different cloud environments, then service accessibility is improved, but network latency increases
Solution Approach 1:
The patent merges multiple connection establishment operations into a single connection through the proxy server. Instead of clients establishing separate connections to multiple cloud environments, the proxy consolidates these into one connection that can access services from different CSPs, thereby reducing network latency while maintaining service accessibility.
Solution Approach 2:
The proxy server performs preliminary actions by pre-establishing connections to backend services and pre-selecting optimal service endpoints before actual client requests arrive. This preliminary preparation reduces the time needed for connection establishment and minimizes network latency during actual service access.
Data Source
AI summary
The present disclosure relates generally to establishing a connection between a client and an endpoint in a manner that reduces network latency. In an example, a network layer proxy receives a request of a client for an endpoint connection establishment, the request including endpoint information. The network layer proxy sends, to an application layer proxy, the endpoint information, the endpoint information sent using a connection-less protocol. Thereafter, the network layer proxy receives, from the application layer proxy, a network address of an endpoint selected by the application layer proxy based on the endpoint information and application layer information. The network layer proxy sends a response to the client such that a connection is established to the endpoint using a connection-based protocol and such that the connection bypasses the application layer proxy.