Dynamic Load Balancing Using Packet Core State Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional networking systems face inefficiencies in distributing computer transactions among processing cores, leading to underutilization, overutilization, increased power consumption, and latency due to improper routing, resulting in suboptimal system performance.

Innovation Solution

A dynamic load balancing system utilizing a load balancing unit that receives workflow packets and state data from packet processing cores, employing machine learning algorithms to determine the optimal core for processing based on utilization, power state, distance, and priority, dynamically adjusting the distribution of transactions in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional static load balancing methods are used to distribute transactions among processing cores, then system simplicity is maintained, but transaction distribution efficiency deteriorates leading to underutilization and overutilization of cores

Engineering Contradiction:
Improvetransaction distribution efficiencyVSAvoidload balancing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic load balancing by continuously monitoring processor utilization metrics and adjusting transaction routing decisions in real-time based on current system state, transforming the static load balancing approach into an adaptive dynamic system that optimizes transaction distribution efficiency

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by collecting processor utilization data from multiple cores and using this information to inform subsequent transaction routing decisions, creating a closed-loop control system that continuously improves transaction distribution based on observed performance

Inventive Principle:
Principle #23Feedback

2Use of energy by stationary object

If transactions are routed to processing cores based on simple round-robin or static methods, then routing complexity is reduced, but power consumption increases due to overutilization of certain cores

Engineering Contradiction:
Improveprocessing core power consumptionVSAvoidrouting decision complexity
Core Design Contradiction:
Use of energy by stationary objectVSDevice complexity

Solution Approach 1:

The system changes routing parameters dynamically by selecting different processing cores based on real-time utilization metrics rather than fixed routing rules, adjusting the destination core parameter based on current system state to optimize power consumption

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The load balancing system monitors its own operational state and automatically adjusts transaction routing to balance load across cores, enabling the system to self-optimize power consumption without external intervention

Inventive Principle:
Principle #25Self-service

3Productivity

If processing cores are continuously monitored and dynamically selected based on multiple state parameters, then system performance is improved, but measurement and detection complexity increases

Engineering Contradiction:
Improvesystem performanceVSAvoidcore state monitoring complexity
Core Design Contradiction:
ProductivityVSDifficulty of detecting and measuring

Solution Approach 1:

The load balancing unit performs multiple functions including monitoring processor utilization, collecting state data from multiple cores, analyzing performance metrics, and making routing decisions, consolidating these diverse functions into a single multi-functional component that improves system performance while managing measurement complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If transaction routing decisions consider multiple factors including utilization state, operating state, distance, and priority, then transaction processing efficiency is improved, but decision-making time increases

Engineering Contradiction:
Improvetransaction processing efficiencyVSAvoidrouting decision time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-collecting and maintaining up-to-date state information about processing cores including utilization metrics and operational status, so that when a transaction needs routing, the load balancing unit can make informed decisions using pre-prepared data rather than gathering information in real-time

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12425343B2Methods, systems, and computer program products for dynamic load balancing
Publication Date: 2025.09.23 MELLANOX TECHNOLOGIES LTD(IL)
  • US12425343B2 patent drawing
  • US12425343B2 patent drawing
  • US12425343B2 patent drawing

AI summary

Methods, systems, and computer program products for selecting packing processing cores are provided. An example system includes a plurality of packet processing cores and a load balancing unit communicatively connected to the plurality of packet processing cores. The load balancing unit is configured to receive a workflow packet including packet description data indicative of at least a packet structure and a packet priority and receive, from the plurality of packet processing cores, state data indicative of at least a utilization state and an operating state of each of the respective packet processing cores. The load balancing unit determines a selected packet processing core from amongst the plurality of packet processing cores based on the state data of the packet processing core and the packet description data of the workflow packet and transmits the workflow packet to the selected packet processing core.