Flexible Packet Flow State Workload Distribution

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing virtualization-based services in provider networks face challenges in managing network packet address manipulation across large-scale networks, leading to inefficiencies and potential disruptions due to ad-hoc solutions for packet transformation.

Innovation Solution

The implementation of exception-path routing rules based on packet flow egress interfaces allows for the flexible distribution of packet flow state management workloads among isolated cells of nodes in a multi-layer packet processing service, enabling seamless modification of mappings and reducing the likelihood of application disruptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If ad-hoc solutions are used for packet transformation in large provider networks, then flexibility in addressing is improved, but system complexity and scalability deteriorate

Engineering Contradiction:

Improveflexibility in addressingVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments packet processing by creating separate exception-path cells that handle specific packet transformation tasks. Each cell is isolated and dedicated to particular exception paths, dividing the complex ad-hoc transformation logic into manageable, independent units that can be processed separately without affecting the entire system.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces exception-path cells as intermediary components between the fast-path packet processing and the complex address manipulation requirements. These cells act as mediators that handle the intricate packet transformation logic, shielding the main fast-path processing from complexity while maintaining flexibility in address manipulation.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If ad-hoc solutions are used for packet transformation, then addressing flexibility is improved, but processing efficiency and scalability worsen

Engineering Contradiction:

Improveaddressing flexibilityVSAvoidprocessing efficiency

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

By segmenting packet processing into fast-path and exception-path components, the system achieves high processing efficiency for common packets while maintaining addressing flexibility only where needed. The exception-path cells handle complex address transformations selectively, preserving overall processing efficiency despite the flexibility requirements.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system applies complex address transformation logic only partially - specifically for packets that require exception handling - rather than applying it to all packets. This partial action maintains processing efficiency for the majority of packets while providing addressing flexibility where required.

Inventive Principle:

Principle #16Partial or excessive action

3Stability of the object's composition

If fixed mappings are used between packet flows and isolated cells, then system stability is improved, but adaptability to workload changes deteriorates

Engineering Contradiction:

Improvesystem stabilityVSAvoidworkload distribution flexibility

Core Design Contradiction:

Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic mapping between packet flows and exception-path cells, allowing the mappings to be modified based on workload conditions. This dynamic approach enables the system to adapt to changing workloads while maintaining stability through controlled, seamless mapping modifications that avoid application disruptions.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system performs preliminary setup of exception-path cells and their capabilities before workload distribution decisions are made. This preliminary action allows for flexible workload distribution while maintaining system stability, as the infrastructure is prepared in advance to handle various mapping configurations without disruption.

Inventive Principle:

Principle #10Preliminary action

4Productivity

If more isolated cells are used to distribute workload, then load balancing is improved, but system complexity and management difficulty worsen

Engineering Contradiction:

Improveload balancingVSAvoidmanagement complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The exception-path cells are designed with universal interfaces and standardized functions, allowing multiple cells to be managed through common mechanisms. This universality enables effective load balancing across multiple isolated cells while reducing management complexity, as the same management approaches can be applied regardless of the number of cells deployed.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12212496B1Flexible distribution of flow state management workloads among isolated exception-path cells of packet processing services

Publication Date: 2025.01.28 AMAZON TECH INC

AI summary

A fast-path node of a packet processing service receives a packet of a forward-direction flow. The node obtains an exception-path routing rule from an exception-path routing rule source. The node sends a query to an exception-path cell of the service based on the routing rule, and receives a packet rewriting rule in response to the query. The rewriting rule is used to send a rewritten version of the packet to a destination.