Serverless Packet Processing Nodes for Isolated Virtual Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current packet processing services in provider networks face challenges in efficiently managing high volumes of traffic and enforcing security settings across isolated virtual networks, often requiring manual provisioning and integration of security and routing rules, which can lead to complexity and inefficiency.

Innovation Solution

A server-less packet processing service that dynamically provisions and programs nodes for packet processing operations within isolated virtual networks, using fast-path and slower-path nodes to handle traffic efficiently and automatically enforce security and routing rules, allowing for scalable and secure packet processing without explicit client intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual provisioning and integration of security and routing rules is used, then customization and control are improved, but device complexity and administrative overhead increase

Engineering Contradiction:
ImprovecustomizationVSAvoidadministrative overhead
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically provisions and configures packet processing nodes based on received traffic, without requiring manual administrative intervention. The control plane component autonomously monitors traffic patterns, determines when new nodes are needed, and performs configuration tasks, allowing the system to serve itself rather than requiring external manual management.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-configures packet processing nodes with necessary security and routing rules before they are activated. The control plane component prepares configuration templates and rule sets in advance, so when traffic requires new processing capacity, nodes can be rapidly deployed with pre-prepared configurations rather than requiring manual setup at deployment time.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If dynamic provisioning of packet processing nodes is implemented, then productivity and scalability are improved, but device complexity increases

Engineering Contradiction:
Improvepacket processing throughputVSAvoidsystem architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The packet processing service is divided into distinct functional components: a control plane component that manages provisioning and configuration, and data plane nodes that perform actual packet processing. This segmentation allows the control plane to handle complex provisioning logic centrally while keeping individual data plane nodes relatively simple and focused on their core processing function.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The control plane component performs multiple functions including monitoring traffic patterns, determining provisioning needs, configuring new nodes, and managing the overall packet processing service. This multi-functionality consolidates complexity into a single management component rather than distributing it across multiple specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If fast-path and slower-path nodes are used, then speed of packet processing is improved, but device complexity increases

Engineering Contradiction:
Improvepacket processing speedVSAvoidnode architecture
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

Different packet processing nodes are assigned different operational characteristics: fast-path nodes are optimized for high-speed processing of routine traffic with simplified rule evaluation, while slower-path nodes handle complex security inspections and unusual traffic patterns. Each node type has quality optimized for its specific function rather than attempting to excel at all tasks.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies full security inspection rules only when necessary (for slower-path nodes handling suspicious or complex traffic), while allowing fast-path nodes to use simplified rules for routine traffic. This partial application of complex rules only where needed maintains high speed for the majority of traffic while providing thorough inspection where required.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10848418B1Packet processing service extensions at remote premises
Publication Date: 2020.11.24 AMAZON TECH INC
  • US10848418B1 patent drawing
  • US10848418B1 patent drawing
  • US10848418B1 patent drawing

AI summary

A representation of packet processing operations is obtained from a client of a provider network. A set of packet processing nodes is configured at a premise external to the provider network, and the representation is transmitted to the premise. In response to a reception of a network packet, the set of packet processing nodes perform the packet processing operations at the external premise.