Intelligent Service Distributor for Real-Time Load Calibration

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current software industry challenges include inefficient work distribution to servers, concurrency issues, high response times, and potential service malfunctions due to CPU overshoot or RAM deficiency, with existing load balancer operations failing to assess server capabilities accurately in production environments.

Innovation Solution

The implementation of an intelligent service distributor and controller that assesses server capacity and assigns tasks dynamically, setting thresholds for service execution and using unique identifiers to optimize load balancing and calibration in real-time, avoiding concurrency issues and predicting service completion effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional load balancer operations are used based on incoming requests or weighted percentages, then work distribution is simplified, but server capability assessment is inaccurate leading to inefficient resource utilization

Engineering Contradiction:

Improveresource utilizationVSAvoidload balancing complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system continuously monitors server capacity metrics (CPU utilization, memory availability, active connections) and uses this feedback to dynamically adjust service distribution decisions, ensuring accurate capability assessment without requiring complex manual configuration

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

Servers automatically report their capacity status and service execution results to the load balancer, eliminating the need for external monitoring infrastructure and reducing system complexity while improving resource utilization accuracy

Inventive Principle:

Principle #25Self-service

2Reliability

If performance testing is conducted in non-production environments, then server capability assessment is safer, but the testing environment cannot match production conditions leading to unpredictability

Engineering Contradiction:

Improveservice execution reliabilityVSAvoidcapability assessment accuracy

Core Design Contradiction:

ReliabilityVSMeasurement precision

Solution Approach 1:

The system performs capability assessment by analyzing historical performance data and current server status before service execution, preparing capacity thresholds in advance to ensure reliable service distribution without requiring separate testing environments

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts capacity thresholds based on real-time server conditions and service types, allowing the same server to handle different workloads at different times, thus achieving both safety and accuracy without environment mismatches

Inventive Principle:

Principle #35Parameter changes

3Productivity

If more services are assigned to a server to increase throughput, then productivity improves, but CPU overshoot or RAM deficiency may cause service malfunction

Engineering Contradiction:

Improveservice throughputVSAvoidservice stability

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system dynamically adjusts the number of services assigned to each server based on real-time capacity monitoring, allowing servers to handle variable workloads without exceeding their processing or memory limits, thus maintaining both throughput and stability

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The load balancer acts as an intermediary that buffers between service requests and server capacity, distributing work to prevent any single server from being overwhelmed while maintaining overall system throughput

Inventive Principle:

Principle #24Intermediary (Mediator)

4Speed

If concurrent service execution is allowed to reduce response time, then service speed improves, but duplication of work and concurrency issues arise

Engineering Contradiction:

Improveresponse timeVSAvoidservice consistency

Core Design Contradiction:

SpeedVSReliability

Solution Approach 1:

The system tracks service execution status and provides feedback to prevent duplicate processing of the same service instance, allowing safe concurrent execution while maintaining data consistency through real-time status monitoring

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11240295B2Intelligent service distributor and controller with real time service calibration

Publication Date: 2022.02.01 EMC IP HLDG CO LLC

AI summary

Described embodiments provide real time load balancing and calibration processes. An aspect includes receiving a request to execute a service, assessing capacity of a target server to execute the service, and setting a threshold for a number of services to be executed on the target server. A further aspect includes assigning a unique identifier of the service to the target server, and based on the threshold and an assessment of a capability of other servers, assigning the service to the server.