Container Load Balancing via Node-Level IP Table DNAT Rules

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing load balancing solutions for containerized computing systems introduce latency and are often tied to specific cloud providers, limiting scalability and portability.

Innovation Solution

A container cluster management system that utilizes a cluster manager, nodes with proxy managers and service firewalls to implement post-routing Destination Network Address Translation (DNAT) rules and deny rules, decoupling load balancing from cloud providers and enhancing security and scalability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing load balancing solutions are implemented in containerized computing systems, then load balancing functionality is provided, but latency is introduced and cloud provider dependency increases

Engineering Contradiction:
Improveload balancing efficiencyVSAvoidlatency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The load balancing functionality is segmented into individual node-level IP table rules rather than a centralized external solution. Each node independently manages its own load balancing rules through proxy managers and service firewalls, eliminating the need for external load balancer intermediaries and reducing latency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The containerized computing system performs self-service load balancing by implementing post-routing DNAT rules and deny rules within the cluster's IP tables. The system manages its own load distribution and security requirements internally through cluster managers and node-level components, eliminating dependency on external cloud provider solutions.

Inventive Principle:
Principle #25Self-service

2Productivity

If existing load balancing solutions are used, then load balancing is provided, but scalability and portability are limited due to cloud provider ties

Engineering Contradiction:
Improveload balancing capabilityVSAvoidscalability and portability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The IP table-based load balancing solution provides universal functionality that can be applied across different containerized computing systems regardless of cloud provider. The same post-routing DNAT and deny rule mechanisms work across various platforms and configurations, enabling portability and scalability without cloud provider-specific dependencies.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The load balancing functionality is extracted from cloud provider-specific solutions and implemented as standalone IP table rules within the containerized system. This extraction removes the coupling between load balancing and specific cloud providers, enabling the system to be deployed across different infrastructure providers and enhancing portability.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If service-specific deny rules are added to IP tables, then security is enhanced by blocking unauthorized access, but system complexity increases

Engineering Contradiction:
ImprovesecurityVSAvoidIP table management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The proxy manager and service firewall functionalities are merged into a unified component that jointly manages both load balancing and security rules in the IP table. This consolidation reduces operational complexity by providing a single interface for managing both types of rules rather than requiring separate management systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements automated feedback mechanisms where service firewalls dynamically add or modify deny rules based on service creation events and security requirements. This automation reduces manual configuration complexity while maintaining enhanced security through context-aware rule generation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10848552B2Determining whether to perform address translation to forward a service request or deny a service request based on blocked service attributes in an IP table in a container-based computing cluster management system
Publication Date: 2020.11.24 HEWLETT PACKARD ENTERPRISE DEV LP
  • US10848552B2 patent drawing
  • US10848552B2 patent drawing
  • US10848552B2 patent drawing

AI summary

In an example, a container cluster management system includes a cluster manager providing access to services provided by containers within a container cluster and a plurality of nodes. Each node has access to an IP table, and is to forward a service request for a service received via the cluster manager to at least one container sub-cluster by translating a destination address of the service request to an IP address of a container sub-cluster. At least one of the nodes comprises a proxy manager, to manage an IP table of the node and a service firewall, to add a service-specific rule to the IP table.