QDMA Queue Traffic Management for FPGA Heterogeneous Accelerators

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current FPGA heterogeneous accelerators lack effective traffic management and control capabilities, leading to insufficient network traffic processing and management, which hampers performance.

Innovation Solution

A method and apparatus for traffic management and control that acquire data frames from heterogeneous accelerators, select appropriate traffic management modes, and allocate data to QDMA queues, using techniques like RSS hashing and bandwidth statistics to ensure efficient processing by corresponding CPU cores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a conventional DMA interface is used to map memory resource on FPGA accelerator to host CPU, then the system structure is simple, but the bandwidth for host to access onboard RAM is completely shared with all kernels and has no traffic management and control capability

Engineering Contradiction:
Improvesystem structureVSAvoidtraffic management and control capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent divides the shared memory bandwidth into multiple dedicated queues (QDMA queues), where each queue can be independently configured and managed. This segmentation allows different kernels to have dedicated bandwidth channels, eliminating the need for complex runtime arbitration while providing traffic management capabilities through queue-specific configuration parameters.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent pre-configures bandwidth allocation and queue parameters before runtime operation. By establishing traffic management rules and bandwidth limits in advance through programming, the system avoids complex runtime decision-making while maintaining adaptability through configurable parameters that can be set according to different application requirements.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If an improved shell uses QDMA interface with additional AXIS interface, then user data can be directly exchanged with CPU memory without caching via FPGA accelerator memory, but there is no management and control mechanism and bandwidth allocation mechanism for the queue

Engineering Contradiction:
Improvedata exchange efficiencyVSAvoidqueue management mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces configurable parameters for each QDMA queue including bandwidth limits, priority levels, and threshold values. These parameters can be adjusted to match different traffic patterns and performance requirements, providing management and control capabilities without requiring complex runtime mechanisms. The bandwidth allocation is controlled through programmable parameters that define queue behavior.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If multiple kernels share the same CPU core for processing, then the device complexity is reduced, but the processing capability becomes insufficient when bandwidth exceeds single CPU core processing capability

Engineering Contradiction:
ImproveCPU core allocationVSAvoidprocessing capability
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent segments the processing workload by associating different QDMA queues with different CPU cores. Each queue can be independently directed to specific CPU cores based on configuration, enabling parallel processing across multiple cores when bandwidth requirements exceed single-core capabilities, while maintaining simple many-to-one mapping when lower performance is sufficient.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240430210A1Traffic management and control method and apparatus, and device and readable storage medium
Publication Date: 2024.12.26 INSPUR SUZHOU INTELLIGENT TECH CO LTD
  • US20240430210A1 patent drawing
  • US20240430210A1 patent drawing
  • US20240430210A1 patent drawing

AI summary

The present disclosure provides a method and apparatus for traffic management and control method, device and readable storage medium. The method includes: acquiring a data frame sent from a heterogeneous accelerator; selecting a target traffic management and control mode corresponding to data in the data frame from a plurality of preset traffic management and control modes; and managing and controlling the data in the data frame according to the target traffic management and control mode, so as to allocate the data to a QDMA queue, and send the data by the QDMA queue, and process the data by a corresponding CPU core.