Memory System Queue Refill Time Resource Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory systems face inefficiencies due to inaccurate resource allocation during queue refill times, leading to unused resources and reduced performance, as they struggle to align resource usage with memory system capabilities in terms of queue refill time, depth, and command queue resources.

Innovation Solution

The memory system measures queue refill time by performing benchmark tests and adjusts resources such as processing power, clock speeds, and queue depth in response to measured refill times, allowing for reallocation of resources during queue refill periods to improve efficiency and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the memory system allocates resources for command queue operations, then processing capability is improved, but resources remain unused during queue refill time reducing efficiency

Engineering Contradiction:
Improvecommand queue processing efficiencyVSAvoidunused resource consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent implements dynamic resource allocation by adjusting clock speeds and activating/deactivating processing components based on queue refill time measurements. The memory system transitions from static resource allocation to dynamic adjustment, where resources are scaled up during active command processing and scaled down during queue refill periods, resolving the contradiction between maintaining processing capability and reducing unused resource consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters (clock speed, resource allocation levels) based on measured queue refill time characteristics. By measuring the actual time required for queue refilling and adjusting resource allocation parameters accordingly, the system optimizes the balance between processing efficiency and energy consumption, allowing resources to be reallocated during periods when the queue is being refilled rather than remaining at full allocation.

Inventive Principle:
Principle #35Parameter changes

2Speed

If the memory system increases resource allocation for command processing, then processing speed is improved, but power consumption increases

Engineering Contradiction:
Improvecommand processing speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic measurement of queue refill time and periodic adjustment of resource allocation based on these measurements. The system operates in cycles where resources are allocated at higher levels during active processing periods and reduced during queue refill periods, creating a periodic pattern of resource usage that matches the actual workload demands, thereby reducing overall power consumption while maintaining processing speed when needed.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system employs feedback mechanisms by measuring queue refill time and using this measurement to adjust resource allocation. The measured refill time provides feedback about actual system workload characteristics, which then feeds back into resource allocation decisions. This closed-loop control allows the system to optimize the trade-off between processing speed and power consumption by allocating resources based on actual measured performance characteristics rather than fixed allocation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11768629B2Techniques for memory system configuration using queue refill time
Publication Date: 2023.09.26 MICRON TECHNOLOGY INC
  • US11768629B2 patent drawing
  • US11768629B2 patent drawing
  • US11768629B2 patent drawing

AI summary

Methods, systems, and devices supporting techniques for memory system configuration using a queue refill time are described. A memory system may receive a command from a host system and may add the command to a command queue including a set of commands to be executed by the memory system. The memory system may determine a queue refill time of the command queue using measurements for at least one queue tag of the command queue and may adjust at least one resource of the command queue in response to the determined queue refill time. In some examples, the memory system may reallocate processing or memory resources previously allocated to the command queue, deactivate processing or memory resources previously allocated to the command queue, adjust a threshold queue depth for the command queue, or any combination thereof, among other options, based on the queue refill time.