Dynamic Load Balancing Mechanism for Application Servers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional load balancing algorithms fail to manage workload fairly across application servers, leading to inefficient distribution of tasks and suboptimal performance in on-demand services environments.

Innovation Solution

A dynamic load balancing mechanism that polls application servers for status, assigns priority levels based on their availability and capacity, and distributes workload accordingly to ensure fair distribution and efficient resource utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If conventional load balancing algorithms are used, then load distribution is simplified, but workload fairness across application servers deteriorates

Engineering Contradiction:
Improveload balancing mechanism complexityVSAvoidworkload distribution fairness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements dynamic load balancing by continuously monitoring application server status (CPU utilization, memory usage, active sessions) and adjusting priority levels in real-time. This dynamic adaptation allows the system to respond to changing server conditions, ensuring fair workload distribution while maintaining manageable complexity through automated status-based priority adjustment.

Inventive Principle:
Principle #15Dynamics

2Reliability

If dynamic status monitoring is implemented, then workload distribution fairness is improved, but system overhead increases

Engineering Contradiction:
Improveworkload distribution fairnessVSAvoidsystem overhead
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system employs feedback mechanisms where application servers periodically report their status (CPU utilization, memory usage, active sessions) to the load balancer. The load balancer uses this feedback to dynamically adjust priority levels and redistribute workload fairly. This feedback-based approach achieves workload fairness while controlling overhead through efficient status collection and priority-based routing decisions.

Inventive Principle:
Principle #23Feedback

3Loss of time

If priority-based load balancing is used, then response time is improved, but system complexity increases

Engineering Contradiction:
Improveresponse timeVSAvoidload balancing algorithm complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent changes the parameter used for load balancing from simple round-robin or static weighting to dynamic priority levels based on server status parameters (CPU utilization, memory usage, active sessions). By adjusting these parameters in real-time, the system optimizes response time while managing complexity through standardized status monitoring and priority assignment mechanisms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8954587B2Mechanism for facilitating dynamic load balancing at application servers in an on-demand services environment
Publication Date: 2015.02.10 SALESFORCE INC
  • US8954587B2 patent drawing
  • US8954587B2 patent drawing
  • US8954587B2 patent drawing

AI summary

In accordance with embodiments, there are provided mechanisms and methods for facilitating dynamic load balancing at application servers in an on-demand services environment. In one embodiment and by way of example, a method includes polling a plurality of application servers for status, receiving status from each of the plurality of application servers, assigning a priority level to each of the plurality of application servers based on its corresponding status, and facilitating load balancing at the plurality of application servers based on their corresponding priority levels.