Virtual Switch Packet Routing for VM Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing communications systems face challenges in efficiently managing packet exchange among multiple virtual machines (VMs) within a communications server, leading to inefficiencies in processing resources and electrical power consumption due to the need for frequent context switching and high latency.

Innovation Solution

The implementation of a communications server that analyzes packet contents to determine pathways and configures virtual network interfaces to operate in polling or non-polling modes dynamically, adjusting processing rates based on buffer thresholds to prevent overflow and underflow, and allowing direct packet exchange between VMs to minimize latency and resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If virtual network interfaces operate in polling mode to reduce latency, then packet processing speed improves, but processing resource demand increases

Engineering Contradiction:
Improvepacket processing speedVSAvoidprocessing resource demand
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The system dynamically configures virtual network interfaces to operate in either polling mode or interrupt mode based on real-time traffic conditions. When traffic requires low latency, interfaces switch to polling mode for faster processing. When traffic is light, interfaces switch to interrupt mode to conserve processing resources. This dynamic adaptation resolves the contradiction between speed and resource demand.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameter of virtual network interfaces between two states: polling mode and interrupt mode. This parameter change allows the system to optimize performance based on traffic conditions, achieving low latency when needed while minimizing resource consumption during normal operation.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by stationary object

If multiple separate servers are replaced by a single physical server with VMs to reduce cost and energy consumption, then electrical power consumption decreases, but context switching overhead increases latency

Engineering Contradiction:
Improveelectrical power consumptionVSAvoidcontext switching latency
Core Design Contradiction:
Use of energy by stationary objectVSLoss of time

Solution Approach 1:

The system performs preliminary configuration of virtual network interfaces during VM creation, pre-establishing polling mode operation for interfaces that require low latency. This preliminary action ensures that when VMs need to communicate, the packet pathway is already optimized, reducing context switching overhead and latency while maintaining the energy efficiency of consolidated server operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces a configuration mechanism that acts as an intermediary between the virtualized environment and the physical hardware. This intermediary pre-configures packet pathways and interface modes, mediating the context switching between VMs to minimize latency while preserving the energy benefits of server consolidation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of time

If packet pathways are dynamically determined and interfaces configured accordingly, then latency is reduced, but system complexity increases

Engineering Contradiction:
Improvepacket transmission latencyVSAvoidsystem configuration complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system segments the virtual network interface configuration into discrete, manageable units that can be independently controlled. Each virtual network interface can be configured separately based on its specific requirements, allowing the system to apply polling mode only where needed rather than globally. This segmentation reduces the overall system complexity while achieving low latency for critical packet pathways.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10356012B2Techniques for routing packets among virtual machines
Publication Date: 2019.07.16 INTEL CORP
  • US10356012B2 patent drawing
  • US10356012B2 patent drawing
  • US10356012B2 patent drawing

AI summary

Various embodiments are generally directed to techniques for improving the efficiency of exchanging packets among multiple VMs within a communications server, and between the communications server and other devices in a communications system. An apparatus may include a virtual switch to analyze contents of at least one packet of a set of packets to be exchanged between endpoint devices through a network, and to correlate the contents to a pathway to extend through one or more of the VMs that are each configured as virtual servers of multiple virtual servers; and an interface control component to select at least one virtual network interface of each of the one or more virtual servers along the pathway to operate in a polling mode, and to select a virtual network interface of at least one virtual server of the multiple virtual servers not along the pathway to operate in a non-polling mode.