Data Center Application Traffic Distribution via Programmable Switches
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data center systems face inefficiencies in traffic flow management due to high latency and jitter caused by numerous rules with varying priorities, especially for low-traffic workloads, which are not effectively addressed by existing network managers and virtual machine migration solutions.
Innovation Solution
Implementing a system that captures rule statistics, allocates rules to network interface cards, and creates new virtual functions or network interfaces to segregate high-traffic and low-traffic workloads, using a flow optimizer to automate the migration of low-traffic rules to dedicated threads, thereby reducing rule processing overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple rules with varying priorities are implemented to handle different traffic patterns, then traffic routing capability is improved, but latency and jitter increase due to extensive rule matching
Solution Approach 1:
The patent segments the rule set into multiple priority groups (first group with higher priority, second group with lower priority). Packets are matched against rules in the first group first, and only if no match is found are they evaluated against the second group. This segmentation reduces the average number of rules each packet must be matched against, thereby reducing latency and jitter while preserving comprehensive traffic routing capability.
2Quantity of substance
If CPU speeds stagnate but processing cores increase to handle more workloads, then workload capacity is improved, but rule processing speed does not improve
Solution Approach 1:
The patent divides the rule processing workload into segmented priority groups. By organizing rules into first and second priority groups, the system ensures that packets matching high-priority rules are processed quickly without requiring evaluation of all rules. This segmentation maintains rule processing speed even as the total number of rules increases to handle greater workload capacity.
3Productivity
If virtual machine migration is used to address traffic distribution issues, then resource allocation is improved, but resource consumption and complexity increase
Solution Approach 1:
Instead of migrating virtual machines to address traffic distribution issues (which consumes significant resources), the patent inverts the approach by migrating rules to different priority groups based on traffic patterns. This rule-based approach achieves similar resource allocation efficiency without the resource-intensive VM migration process, thereby improving productivity while reducing device complexity.
4Reliability
If high priority rules are placed at the top of the rule list for low-traffic workloads, then service quality for those workloads is improved, but lookup speed for high-traffic workloads deteriorates
Solution Approach 1:
The patent segments rules into priority groups where the first group contains high-priority rules and the second group contains lower-priority rules. This segmentation ensures that high-traffic workloads are quickly routed via high-priority rules without being blocked by numerous low-priority rules, maintaining both service quality for low-traffic workloads and lookup speed for high-traffic workloads.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system and method to distribute traffic flows among a plurality of applications in a data center system. In one embodiment, an apparatus (200) is operable with a plurality of applications (120, 130, 140) connected through a programmable switch (230) and is configured to select traffic flows to ones of the plurality of applications (120, 130, 140). The apparatus (200) is also configured to monitor and collect statistics for the traffic flows to determine rule level statistics, and move at least one traffic flow of the traffic flows from a network interface to a different network interface based on the rule level statistics.