Packet Processing Pipeline Accelerates InfiniBand Administrative Operations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
InfiniBand administrative operations in data centers consume a significant number of CPU cycles due to the rapid creation and deletion of thousands of queue pairs, which was unforeseen in the original design, leading to inefficiencies in microservice architectures.
Innovation Solution
A packet processing pipeline with a DMA output stage is used to create and manage InfiniBand RDMA administrative data structures directly in memory, offloading these operations from CPUs and prioritizing administrative operations to enhance efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If CPUs are used to create and manage InfiniBand queue pairs and administrative data structures, then administrative operations can be performed, but CPU cycles are consumed excessively leading to reduced productivity
Solution Approach 1:
The patent extracts the administrative operation processing function from the CPU by implementing a dedicated packet processing pipeline in the network interface card. This pipeline includes specialized hardware components (parser, match-action units, deparser, DMA engine) that specifically handle InfiniBand administrative operations, thereby removing the burden from the CPU and enabling parallel processing without consuming CPU cycles.
Solution Approach 2:
The patent introduces an intermediary packet processing pipeline as a mediator between the CPU and the InfiniBand administrative operations. This pipeline acts as a specialized processing layer that translates and handles administrative operations independently, preventing direct CPU involvement while maintaining system coordination through standardized interfaces.
2Productivity
If a packet processing pipeline is implemented to offload administrative operations from CPUs, then CPU overhead is reduced and productivity increases, but device complexity increases
Solution Approach 1:
The packet processing pipeline is designed with multi-functionality to handle various InfiniBand administrative operations (queue pair creation, modification, deletion, etc.) through a unified architecture. The match-action units and parser can be configured to process different operation types using the same hardware resources, reducing the need for separate dedicated circuits for each function.
Solution Approach 2:
The patent segments the packet processing pipeline into distinct functional stages (parser, match-action units, deparser, DMA engine) that can operate independently and be selectively activated. This modular segmentation allows the system to handle complexity through organized functional blocks rather than a monolithic complex structure, enabling easier management and potential selective activation based on operation requirements.
3Ease of operation
If administrative operations are prioritized in the packet processing pipeline, then operational efficiency improves, but queue management complexity increases
Solution Approach 1:
The patent applies local quality by assigning different priority levels to different types of administrative operations through the match-action units. Specific operation types (such as queue pair creation versus modification) can be assigned different priority treatments locally within the pipeline, allowing efficient prioritization without requiring complex global queue management mechanisms. This localized priority assignment simplifies the overall queue management while maintaining operational efficiency.
Data Source
AI summary
Data centers often run long lived services such as web servers that are intended to run for hours, days, or even longer before being torn down and replaced with another instance of the long-lived service. Currently, many applications are being implemented with microservice architectures that run short lived services that start up, implement an operation, and are then torn down. An aspect of starting up a service is creating administrative data structures such as InfiniBand queue pairs. A packet processing pipeline having a DMA output stage can be configured to create the administrative data structures, thereby increasing the rate at which the administrative data structures are created. As a result, services running in data centers can be started up more rapidly and efficiently.