Data Center Application Traffic Distribution via Programmable Switches

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data center systems face inefficiencies in traffic flow management due to high latency and jitter caused by numerous rules with varying priorities, especially for low-traffic workloads, which are not effectively addressed by existing network managers and virtual machine migration solutions.

Innovation Solution

Implementing a system that captures rule statistics, allocates rules to network interface cards, and creates new virtual functions or network interfaces to segregate high-traffic and low-traffic workloads, using a flow optimizer to automate the migration of low-traffic rules to dedicated threads, thereby reducing rule processing overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple rules with varying priorities are implemented to handle different traffic patterns, then traffic routing capability is improved, but latency and jitter increase due to extensive rule matching

Engineering Contradiction:
Improvetraffic routing capabilityVSAvoidlatency and jitter
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent segments the rule set into multiple priority groups (first group with higher priority, second group with lower priority). Packets are matched against rules in the first group first, and only if no match is found are they evaluated against the second group. This segmentation reduces the average number of rules each packet must be matched against, thereby reducing latency and jitter while preserving comprehensive traffic routing capability.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If CPU speeds stagnate but processing cores increase to handle more workloads, then workload capacity is improved, but rule processing speed does not improve

Engineering Contradiction:
Improveworkload capacityVSAvoidrule processing speed
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The patent divides the rule processing workload into segmented priority groups. By organizing rules into first and second priority groups, the system ensures that packets matching high-priority rules are processed quickly without requiring evaluation of all rules. This segmentation maintains rule processing speed even as the total number of rules increases to handle greater workload capacity.

Inventive Principle:
Principle #1Segmentation

3Productivity

If virtual machine migration is used to address traffic distribution issues, then resource allocation is improved, but resource consumption and complexity increase

Engineering Contradiction:
Improveresource allocation efficiencyVSAvoidmigration overhead
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Instead of migrating virtual machines to address traffic distribution issues (which consumes significant resources), the patent inverts the approach by migrating rules to different priority groups based on traffic patterns. This rule-based approach achieves similar resource allocation efficiency without the resource-intensive VM migration process, thereby improving productivity while reducing device complexity.

Inventive Principle:
Principle #13The other way round (Inversion)

4Reliability

If high priority rules are placed at the top of the rule list for low-traffic workloads, then service quality for those workloads is improved, but lookup speed for high-traffic workloads deteriorates

Engineering Contradiction:
Improveservice qualityVSAvoidlookup speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent segments rules into priority groups where the first group contains high-priority rules and the second group contains lower-priority rules. This segmentation ensures that high-traffic workloads are quickly routed via high-priority rules without being blocked by numerous low-priority rules, maintaining both service quality for low-traffic workloads and lookup speed for high-traffic workloads.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP4018599B1System and method to distribute traffic flows among a plurality of applications in a data center system
Publication Date: 2025.10.01 TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
  • EP4018599B1 patent drawingFigure 1
  • EP4018599B1 patent drawingFigure 2
  • EP4018599B1 patent drawingFigure 3

AI summary

A system and method to distribute traffic flows among a plurality of applications in a data center system. In one embodiment, an apparatus (200) is operable with a plurality of applications (120, 130, 140) connected through a programmable switch (230) and is configured to select traffic flows to ones of the plurality of applications (120, 130, 140). The apparatus (200) is also configured to monitor and collect statistics for the traffic flows to determine rule level statistics, and move at least one traffic flow of the traffic flows from a network interface to a different network interface based on the rule level statistics.