NIC Data Flow Management via Virtual Queues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data center environments, managing data flows from virtual machines to ensure efficient communication and resource allocation is challenging due to the sharing of physical network resources, which limits individual data flow rate adjustments and recognition by network components.

Innovation Solution

A network interface card (NIC) partitions physical buffers into logical queues, associates data flows with these queues, and encapsulates packets with tunnel headers to enable individual data rate control and recognition by network components, allowing for differentiated Quality of Service (QoS) and congestion management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple virtual machines share one or more network interface controllers, then resource utilization is improved, but individual data flow rate control and recognition by network components deteriorates

Engineering Contradiction:
Improveresource utilizationVSAvoidindividual data flow rate control
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent segments the shared network interface controller resources by introducing virtual forwarding elements that create distinct virtual network interfaces for each virtual machine. Each virtual forwarding element maintains separate forwarding tables and state information, enabling individual data flow control while sharing the physical NIC hardware. This segmentation allows the system to simultaneously achieve high resource utilization through sharing and precise individual flow control through virtualization.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If physical network resources are shared among virtual machines, then device complexity is reduced, but measurement precision of individual data flows deteriorates

Engineering Contradiction:
Improvenetwork infrastructure complexityVSAvoiddata flow recognition
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces virtual forwarding elements as intermediary components between the virtual machines and the physical network interface controller. These intermediaries maintain detailed forwarding tables that precisely track individual data flows, including source and destination addresses, while presenting a unified interface to the physical network. This intermediary layer enables precise measurement and recognition of individual data flows without requiring separate physical network infrastructure for each virtual machine.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10103972B2Managing data flows in software-defined network using network interface card
Publication Date: 2018.10.16 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10103972B2 patent drawing
  • US10103972B2 patent drawing
  • US10103972B2 patent drawing

AI summary

Embodiments relate to managing data flows at a network interface card (NIC). A computer program product for managing data flows at a network interface card (NIC) of a host, the NIC comprising a port, includes a tangible storage medium readable by a processing circuit that stores instructions for execution by the processing circuit for performing a method. The method includes receiving, from a virtual forwarding element executing in the host, a packet that belongs to a data flow, identifying, at the NIC and by the processing circuit, one of a plurality of queues for storing data flows to be sent out of the host through the port based a mapping between the data flows, the queues, and a plurality of tunnels, and placing the packet in the identified queue in order to send the packet out of the host through the port.