Edge Microservice Load Balancing Through Request Forwarding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing edge server systems struggle to accurately determine load imbalances among microservices, leading to potential overload conditions that degrade performance, especially in microservice architectures where resources are allocated per microservice.
Innovation Solution
A control unit monitors and balances loads by transferring requests from overloaded microservices to resource-rich microservices on other edge servers, adjusting the transfer ratio based on load states to prevent overload.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If requests are concentrated on a single microservice operating on one edge server, then service functionality is maintained, but the edge server becomes overloaded and performance degrades
Solution Approach 1:
The patent segments the request processing function by introducing a load distribution control unit that divides incoming requests into multiple groups. This control unit directs different request groups to different microservices (first microservice and second microservice), which may operate on the same or different edge servers. This segmentation prevents any single microservice from handling all requests, thereby avoiding overload while maintaining service functionality through distributed request processing.
2Productivity
If load distribution is implemented across multiple microservices, then edge server overload is prevented, but system complexity increases
Solution Approach 1:
The patent introduces a load distribution control unit as an intermediary component that manages the complexity of load distribution. This control unit sits between the request source and the microservices, centralizing the decision-making logic for request routing. By concentrating the load distribution intelligence in this single intermediary component, the patent simplifies the overall system architecture while still achieving effective load balancing across multiple microservices, rather than distributing complexity across all components.
Data Source
AI summary
An information processing device for performing load balancing between a plurality of edge servers. Acquire a load on one or more microservices operating at each of the plurality of edge servers, and determine to operate at the first edge server to forward a predetermined percentage of requests of one or more requests issued to the first microservice loaded by a predetermined amount or more to a second microservice operating at the one or more second edge servers.