NVMe Peripheral Device Dynamic Arbitration Queue Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current NVMe standard interfaces between peripheral devices and host systems with multiple cores or applications lack efficient arbitration and monitoring mechanisms, leading to suboptimal command processing and resource allocation.

Innovation Solution

Implementing dynamic arbitration parameter adjustment based on submission queue tail movement and priority, allowing for real-time modification of arbitration burst and queue priority for individual submission queues and queue groups, enhancing the NVMe device's ability to manage command processing and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If static arbitration parameters are used in NVMe standard, then device complexity is reduced, but command processing efficiency and resource allocation optimization deteriorate

Engineering Contradiction:
Improvecommand processing efficiencyVSAvoidarbitration mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic arbitration parameters that can be adjusted in real-time based on submission queue tail movement and priority levels. The arbitration mechanism transitions from static to dynamic, allowing burst quantities and priorities to be modified during operation to optimize command processing efficiency across multiple cores and applications.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes arbitration parameters such as burst quantity and priority based on monitored queue states. By detecting tail movement in submission queues and adjusting arbitration parameters accordingly, the system optimizes resource allocation without requiring complete redesign of the arbitration mechanism.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If real-time monitoring and dynamic adjustment of arbitration parameters is implemented, then resource allocation optimization improves, but device complexity and implementation difficulty increase

Engineering Contradiction:
Improveresource allocation optimizationVSAvoidmonitoring and adjustment mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the peripheral device monitors submission queue tail movement and uses this information to dynamically adjust arbitration parameters. The monitored queue states provide feedback that triggers parameter changes, enabling adaptive resource allocation based on actual system conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The arbitration mechanism performs self-adjustment based on monitored queue states without requiring external intervention. The system automatically detects tail movement, evaluates priority levels, and modifies arbitration parameters independently, reducing the need for complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

3Speed

If interruption-based command completion is used, then responsiveness to completed commands improves, but processing latency and overhead increase

Engineering Contradiction:
Improvecommand completion responsivenessVSAvoidprocessing latency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent implements periodic monitoring of queue states instead of continuous interruption-based notification. By monitoring queue tail movement at intervals and using this information for arbitration decisions, the system reduces the overhead and latency associated with frequent interruptions while maintaining responsive command processing.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS20220066954A1Host State Monitoring By A Peripheral Device
Publication Date: 2022.03.03 PETAIO MEMORY TECHNOLOGY (NANJING) CO LTD
  • US20220066954A1 patent drawing
  • US20220066954A1 patent drawing
  • US20220066954A1 patent drawing

AI summary

A peripheral device implements a plurality of queue sets each including a submission queue and a completion queue. Changes to the queues are monitored and arbitration parameters are adjusted, the arbitration parameters defining how submission queues are selected for retrieval of a command. An arbitration burst for a submission queue may be increased in response to tail movement for the submission queue being larger than for another submission queue. Priorities used for weighted round robin arbitration may also be adjusted based on tail movement. Arbitration burst quantities and priorities of groups of queues may also be adjusted. Head movement of the completion queues is monitored and may be used to lower priority, enable interrupt coalescing, or pause command retrieval where head movement does not meet a threshold condition.