Provider Substrate Extension for Low Latency Cloud Networking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As data centers grow in scale and complexity, managing and provisioning physical computing resources becomes increasingly complicated, and existing cloud services may not be optimal for applications requiring low latency and high data processing at customer premises due to geographical constraints.

Innovation Solution

The deployment of a provider substrate extension (PSE) that allows customers to set up a local extension of cloud network capabilities at their own premises, providing virtualized computing resources and networking components, managed through the same interfaces as the provider network, with secure and reliable communication tunnels to ensure security and efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If applications are deployed at customer premises outside provider network data centers, then latency and responsiveness are improved, but network security and management control are worsened

Engineering Contradiction:
ImprovelatencyVSAvoidnetwork security
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent introduces a provider substrate extension (PSE) as an intermediary component deployed at customer premises. The PSE acts as a mediator that provides local computing resources while maintaining secure connectivity to the provider network through encrypted tunnels. This intermediary structure allows applications to run locally (reducing latency) while the PSE maintains security boundaries and management control (preserving network security).

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the provider network infrastructure into distributed substrate extensions that can be deployed independently at multiple customer locations. Each PSE is a self-contained unit that provides local resources while maintaining connection to the central provider network. This segmentation enables applications to be deployed closer to users (improving latency) while the segmented architecture maintains security isolation (preserving network security).

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If provider substrate extension is deployed externally, then adaptability and customer control are improved, but device complexity and networking configuration are worsened

Engineering Contradiction:
Improvecustomer controlVSAvoidnetworking configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal control plane that manages multiple provider substrate extensions using standardized interfaces and protocols. The control plane provides multi-functional capabilities including provisioning, configuration, monitoring, and security management across all PSEs. This universal management approach allows customers to deploy PSEs at various locations (improving adaptability) while the standardized control plane simplifies configuration and reduces complexity (mitigating device complexity).

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent enables PSEs to automatically discover and configure their own networking parameters through interaction with the control plane. The system provides self-service capabilities where PSEs can autonomously establish secure connections, obtain network configuration, and register with the provider network without manual intervention. This self-service mechanism improves customer control over deployment (improving adaptability) while automating complex configuration tasks (reducing device complexity).

Inventive Principle:
Principle #25Self-service

3Productivity

If data is processed locally at customer premises, then productivity and data processing speed are improved, but data transfer over long distances is worsened

Engineering Contradiction:
Improvedata processing speedVSAvoiddata transfer
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent implements local quality by deploying computing resources directly at customer premises through provider substrate extensions. This allows data processing to occur locally where the data resides or is generated, eliminating the need to transfer large volumes of data over long distances to centralized data centers. The local processing capability improves productivity and data processing speed (improving productivity) while significantly reducing energy consumption associated with long-distance data transmission (reducing data transfer energy loss).

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11411771B1Networking in provider network substrate extensions
Publication Date: 2022.08.09 AMAZON TECH INC
  • US11411771B1 patent drawing
  • US11411771B1 patent drawing
  • US11411771B1 patent drawing

AI summary

Techniques for networking in provider network substrate extensions are described. A compute instance of an isolated virtual network is hosted by an extension of a provider network that is in communication with the provider network via a secure tunnel through a customer network. A request to establish communications between the isolated virtual network and the customer network is received at an interface to the provider network. A message to cause a gateway of the extension to route traffic between the isolated virtual network and the customer network is sent via the secure tunnel.