Stateful Network Router for Dynamic Appliance Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network appliances face challenges in scaling capacity to handle varying network traffic loads, with traditional solutions like state replication and load balancers causing downtime and inefficiencies, especially when multiple appliances are needed to maintain service availability and functionality.

Innovation Solution

A stateful network router that routes traffic transparently to and from network appliances, allowing for dynamic deployment and scaling, reduces the need for state replication and enhances flexibility by maintaining flow assignments and performing health checks to reroute traffic in case of failures, thereby avoiding downtime.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If state replication is used to distribute traffic among multiple network appliances, then service availability is improved, but system complexity and memory requirements increase significantly

Engineering Contradiction:
Improveservice availabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the state management function from individual network appliances and centralizes it in a control plane. The data plane appliances no longer need to maintain full state information, instead relying on the control plane to provide state data on demand. This separation reduces complexity in each appliance while maintaining service availability through centralized state management.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The control plane acts as an intermediary between network appliances and traffic flows. Instead of appliances directly managing state replication, the control plane mediates by receiving state information, managing it centrally, and providing it back to appliances as needed. This intermediary approach simplifies the appliance architecture while maintaining reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple network appliances are deployed to handle traffic loads, then capacity and reliability are improved, but flow assignment management and connection integrity become more difficult

Engineering Contradiction:
Improvetraffic handling capacityVSAvoidflow assignment management
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The control plane implements feedback mechanisms by continuously monitoring traffic flows and appliance states. When a flow is assigned to an appliance, the control plane tracks this assignment and uses feedback to ensure subsequent packets of the same flow are routed to the same appliance. This feedback loop maintains connection integrity while enabling multiple appliances to handle increased capacity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes routing parameters based on flow characteristics and appliance availability. The control plane modifies flow assignment parameters in real-time, adjusting which appliance handles which flow based on current system state. This parameter-based approach simplifies management compared to static configurations while maintaining connection integrity.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If traditional load balancers are used to distribute traffic, then traffic distribution is improved, but connection integrity is lost due to parameter changes

Engineering Contradiction:
Improvetraffic distributionVSAvoidconnection integrity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The control plane serves as an intermediary that preserves connection integrity while enabling traffic distribution. Unlike traditional load balancers that directly modify packet parameters, the control plane intercepts flows, assigns them to appliances, and ensures subsequent packets maintain the same assignment. This intermediary approach distributes traffic effectively while preserving the original connection parameters and integrity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11792116B1Stateful network router for managing network appliances
Publication Date: 2023.10.17 AMAZON TECH INC
  • US11792116B1 patent drawing
  • US11792116B1 patent drawing
  • US11792116B1 patent drawing

AI summary

Disclosed are various embodiments of a stateful network router. In one embodiment, a network data connection is intercepted between a first host and a second host on a network. First data packets from the network data connection sent by the first host to the second host are routed to a target network appliance. Second data packets from the network data connection sent by the second host to the first host are also to the target network appliance.