Memory Controller Queue Fetching Based on Resource Availability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The fetched commands in a memory system may not be suitable for the operation state, leading to decreased access performance from the host to the memory system.

Innovation Solution

A memory system with a controller that estimates the use of each command queue based on command types and resource usage, determining the next command queue to fetch from to optimize command fetching according to the system's resource availability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If commands are fetched from command queues without considering resource availability, then the command fetching process is simple, but access performance decreases

Engineering Contradiction:
Improveaccess performanceVSAvoidcontroller complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The controller estimates the use of each command queue in advance by counting command types (read, write, random access) before fetching commands. This preliminary estimation allows the controller to select appropriate command queues based on predicted resource needs, improving access performance without adding complex real-time decision-making during command execution.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts command queue selection based on estimated usage patterns and resource availability. The controller monitors and adapts its fetching strategy according to the current operational state, transitioning from static queue selection to dynamic, condition-based selection that optimizes performance under varying workloads.

Inventive Principle:
Principle #15Dynamics

2Productivity

If the controller monitors and estimates command queue usage, then command fetching becomes more efficient, but the monitoring and estimation process adds complexity

Engineering Contradiction:
Improvecommand fetching efficiencyVSAvoidtime for monitoring and estimation
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The controller performs command type counting and usage estimation as a preliminary action before the actual command fetching operation. By accumulating statistical data on command types (read, write, random access) in advance, the system prepares selection criteria that can be quickly applied during fetch operations, minimizing real-time computational overhead while maintaining high fetching efficiency.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If commands are fetched without considering command types, then the fetching process is fast, but the fetched commands may not be suitable for current operation state

Engineering Contradiction:
Improveaccess performanceVSAvoidcommand queue management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments command queues into distinct types based on command characteristics (read queues, write queues, random access queues). This segmentation allows the controller to manage different queue types with separate tracking mechanisms and selection strategies, improving command suitability for current operations while maintaining manageable complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller applies different monitoring and estimation methods to different command queue types. Each queue type (read, write, random access) receives tailored treatment in terms of counting specific command types and adjusting selection criteria, allowing optimized local management of each queue type while contributing to overall system performance.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12524181B2Memory system with controller configured to fetch commands
Publication Date: 2026.01.13 KIOXIA CORP
  • US12524181B2 patent drawing
  • US12524181B2 patent drawing
  • US12524181B2 patent drawing

AI summary

A controller of a memory system estimates a use of each of a plurality of command queues based on types of one or more commands fetched from each of the plurality of command queues. The controller determines a command queue from which a next command is to be fetched from the plurality of command queues based on the use of each of the plurality of command queues and a usage state of a resource in the memory system. The controller fetches a command from the determined command queue.