Memory-Subsystem Notification Pacing to Reduce Host Interrupts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory sub-systems face inefficiencies due to frequent interrupts for command completion notifications, which disrupt host system operations and waste resources when the host system is busy, impacting overall performance.

Innovation Solution

Implementing command completion notification pacing by a memory sub-system controller that sends notifications only after a preconfigured threshold period of time has elapsed, based on command type or quality of service parameters, balancing processing of completed and new commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the memory sub-system sends command completion notifications immediately upon command completion, then the host system receives timely completion information, but the host system experiences frequent interrupts that disrupt operations and waste resources

Engineering Contradiction:
Improvecommand completion notification timelinessVSAvoidhost system operational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements periodic action by introducing a pacing mechanism that sends command completion notifications at controlled intervals rather than immediately upon each command completion. The memory sub-system controller monitors a pace counter and only generates interrupts when the counter reaches a threshold value, transforming continuous interrupt generation into periodic notification bursts. This resolves the contradiction by maintaining notification timeliness within acceptable bounds while dramatically reducing interrupt frequency and associated resource waste.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent introduces an intermediary pacing mechanism between the command completion event and the host system interrupt. The pace counter and notification logic act as a mediator that buffers and regulates the flow of completion notifications. This intermediary layer decouples the immediate command completion from the interrupt generation, allowing the system to smooth out notification delivery and prevent host system disruption while still conveying completion information reliably.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the memory sub-system sends command completion notifications for every completed command, then the host system has complete visibility of command status, but resources are wasted when the host system is busy and cannot process the notifications

Engineering Contradiction:
Improvecommand completion status visibilityVSAvoidresource wastage from unnecessary interrupts
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The patent applies partial action by sending only a subset of command completion notifications at any given time, rather than immediately notifying the host for every single completed command. The pacing mechanism selectively delays certain notifications until the pace counter threshold is reached or the host is ready to receive them. This partial notification approach maintains sufficient command status visibility for the host to track overall progress while eliminating wasteful interrupts during busy periods when the host cannot process notifications effectively.

Inventive Principle:
Principle #16Partial or excessive action

3Device complexity

If the memory sub-system uses a simple interrupt mechanism for command completion, then the implementation is straightforward, but the system performance deteriorates due to frequent interrupts disrupting host operations

Engineering Contradiction:
Improvenotification mechanism simplicityVSAvoidmemory sub-system performance
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent introduces dynamics into the notification mechanism by making the interrupt generation adaptive and controllable. The pace counter can be configured with different threshold values, and the pacing behavior can be adjusted based on system conditions. This dynamic approach transforms the static simple interrupt mechanism into a flexible system that can optimize between simplicity and performance by adjusting notification pacing parameters without fundamentally changing the interrupt architecture.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250265020A1Managing command completion notification pacing in a memory sub-system
Publication Date: 2025.08.21 MICRON TECHNOLOGY INC
  • US20250265020A1 patent drawing
  • US20250265020A1 patent drawing
  • US20250265020A1 patent drawing

AI summary

A system includes a memory device and a processing device, operatively coupled with the memory device, to perform operations including: receiving, from a host system, a memory access command; executing the memory access command; identifying a characteristic associated with the memory access command; identifying a threshold period of time corresponding to the characteristic associated with the memory access command; determining that a period of time associated with the memory access command satisfies the threshold period of time; and responsive to determining that the period of time associated with the memory access command satisfies the threshold period of time, notifying the host system of completion of execution of the memory access command.