Load Balancer Configuration for Multi-Tenant Cloud Network Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current network management systems are limited to managing single datacenter environments and face challenges in providing cloud-based management for multiple tenant networks spanning across various datacenters, including on-premises and virtual datacenters in public clouds.

Innovation Solution

A cloud-based network management and monitoring system is deployed, utilizing a container cluster like Kubernetes, with service instances for policy management, network flow monitoring, and threat monitoring, along with local managers at each datacenter and multi-tenant services in the public cloud, ensuring isolation and high-level operations across different datacenter groups.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a cloud-based network management system is deployed to manage multiple tenant networks across various datacenters, then the system's versatility and scalability are improved, but the system complexity increases

Engineering Contradiction:
Improveability to manage multiple tenant networksVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system is divided into separate service instances, each dedicated to managing specific datacenter groups. Each service instance operates independently with its own microservices, making the overall complex system manageable through modular segmentation. This allows the system to handle multiple tenant networks without requiring a single monolithic complex architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Connection servers act as intermediaries between local managers at datacenters and service instances in the cloud. These intermediaries simplify the communication architecture by centralizing connection management, allowing service instances to remain isolated while still enabling complex multi-tenant network management operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If multiple service instances are deployed for different datacenter groups, then the system's ability to provide dedicated management is improved, but the operational complexity increases

Engineering Contradiction:
Improvededicated management capabilityVSAvoidservice instance management
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The management system is segmented into separate service instances, each dedicated to specific datacenter groups. This segmentation provides dedicated management capability for different tenant networks while isolating operational complexity within each service instance, preventing it from propagating across the entire system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multi-tenant services provide universal functionality across all service instances, handling common operations like user authentication, authorization, and service provisioning. This universality simplifies operational complexity by consolidating common tasks while maintaining dedicated management for each datacenter group.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If connection servers are used to manage connections from multiple datacenters, then the system's scalability is improved, but the routing configuration complexity increases

Engineering Contradiction:
Improveconnection management efficiencyVSAvoidload balancer routing configuration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Connection servers are pre-configured with routing information before receiving connections from datacenters. The system establishes connection pools and pre-defines routing paths, allowing connections to be automatically routed without complex real-time configuration. This preliminary setup maintains scalability while simplifying runtime routing management.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where connection servers monitor connection status and routing effectiveness. This feedback allows the system to dynamically adjust routing configurations based on actual performance, reducing the need for manual routing configuration complexity while maintaining high scalability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240152375A1Configuration of load balancer for connection servers between network management system and managed datacenters
Publication Date: 2024.05.09 VMWARE INC
  • US20240152375A1 patent drawing
  • US20240152375A1 patent drawing
  • US20240152375A1 patent drawing

AI summary

Some embodiments provide a method for initiating a connection between a network management system in a public cloud and a datacenter managed by the network management system. The method is performed at a controller executing in the public cloud. The method receives a registration message from a particular datacenter to be managed by the network management system. The method identifies one of multiple connection servers in the public cloud for handling a persistent connection initiated by the datacenter. The method configures a load balancer in the public cloud to statically select the identified connection server for data messages that include a datacenter identifier associated with the particular datacenter.