Multi-Stage Queue DMA Error Signaling for Transport Offload

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network interface cards (NICs) face challenges in handling host-facing DMA errors in multi-stage queue operations, leading to resource leaks, silent data corruption, and service disruptions due to the asynchronous nature of DMA error responses, which complicates resource reclamation and error handling.

Innovation Solution

Implementing error indicator bits in task pointers to asynchronously notify downstream queues or pipelines of DMA errors, allowing them to perform resource reclamation and error handling without synchronous feedback to firmware or software.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If synchronous feedback to firmware or software is used for DMA error handling, then error detection accuracy is improved, but system performance and response time deteriorate due to software intervention overhead

Engineering Contradiction:
Improveerror detection accuracyVSAvoidsystem performance
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The downstream queue is empowered to autonomously detect and handle DMA errors through the error indicator bit in task pointers, eliminating the need for synchronous software intervention. The queue independently performs resource reclamation and error handling, achieving self-service that maintains both accuracy and performance.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

An error indicator bit is embedded in task pointers to provide asynchronous feedback about DMA errors from the first pipeline to the second pipeline. This feedback mechanism enables the downstream queue to detect errors without synchronous software involvement, resolving the contradiction between detection accuracy and system performance.

Inventive Principle:
Principle #23Feedback

2Productivity

If asynchronous error handling in hardware is implemented, then system performance is improved, but error handling complexity increases due to resource reclamation challenges

Engineering Contradiction:
Improvesystem performanceVSAvoiderror handling complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The error indicator bit serves as an intermediary signal embedded in task pointers, conveying error status from the first pipeline to the second pipeline. This simple binary indicator simplifies asynchronous error handling by providing clear error notification without requiring complex error protocols or state management.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Error handling functionality is extracted from the firmware/software layer and embedded directly into the hardware queue operations. The downstream queue independently handles error detection and resource reclamation, removing the complexity of coordinated software-hardware error management while maintaining performance.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If multi-stage queue operations are used for transport offload, then processing efficiency is improved, but reliability deteriorates due to resource leaks and silent data corruption from undetected DMA errors

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The error indicator bit in task pointers provides feedback about DMA operation status from one pipeline stage to the next. This enables reliable error propagation through the multi-stage processing chain, ensuring that errors are detected and handled appropriately while maintaining processing efficiency.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the traditional software-based error detection mechanism with a hardware-level indicator bit in task pointers. This substitution enables automatic error propagation through the multi-stage queue operations, maintaining processing efficiency while improving reliability by preventing resource leaks and silent data corruption.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20260003713A1Host-facing DMA failure detection for transport offload with multi-stage queue operations
Publication Date: 2026.01.01 ADVANCED MICRO DEVICES INC
  • US20260003713A1 patent drawing
  • US20260003713A1 patent drawing
  • US20260003713A1 patent drawing

AI summary

Embodiments herein describe including one or more error indicating bits in a task pointer (e.g., a WQE) to tell a downstream queue or stage, such as a pipeline, that an upstream queue or stage detected a DMA error. The communication from each upstream stage or pipeline to the next is typically through posting WQEs into the next stage queue and ringing doorbells. The embodiments herein use one or more error indicator bits (e.g., color bits) in the WQE to inform a downstream queue (e.g., a downstream pipeline) that the upstream queue/pipeline detected a failed DMA operation. The downstream queue can then perform error handling where it reclaims the resources allocated for the WQE (such as an intermediate buffer).