Memory Buffer Request Timing for Lower Communication Overhead

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing communication protocols for memory systems result in inefficient use of resources and increased power consumption due to unnecessary information requests that do not account for the memory sub-system's available capacity, leading to buffer overflow and suboptimal communication traffic.

Innovation Solution

Implementing an information request manager in the host system to adjust the frequency of requests based on statistical data of past requests, delaying requests when buffer capacity is sufficient or when a predetermined time interval has elapsed, thereby optimizing the allocation of buffer capacity and reducing unnecessary communications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the host system continuously requests information about buffer capacity from the memory sub-system, then the host system can always allocate buffer capacity efficiently, but the communication traffic increases and power consumption increases

Engineering Contradiction:
Improvebuffer capacity allocation efficiencyVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The host system transitions from continuous information requests to periodic requests based on statistical data of past requests. The information request manager delays requests until a predetermined time interval has elapsed since the last request, reducing communication frequency while maintaining adequate buffer capacity allocation efficiency.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The host system uses statistical data from past information requests and responses to dynamically adjust the timing of future requests. This feedback mechanism allows the host to learn when the memory sub-system is likely to have available buffer capacity, optimizing the balance between allocation efficiency and communication overhead.

Inventive Principle:
Principle #23Feedback

2Reliability

If the host system sends frequent information requests to ensure adequate buffer capacity, then buffer overflow is prevented, but communication resources are wasted on unnecessary requests

Engineering Contradiction:
Improvebuffer overflow preventionVSAvoidcommunication resource waste
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The host system performs preliminary analysis of statistical data from past requests to predict when buffer capacity will be available. This allows the host to time its information requests optimally, ensuring adequate buffer capacity is allocated without sending unnecessary requests that waste communication resources.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The host system dynamically adjusts the timing of information requests based on real-time conditions and statistical patterns. The information request manager modifies request intervals adaptively, sending requests only when necessary to maintain reliable buffer capacity allocation while avoiding redundant communications.

Inventive Principle:
Principle #15Dynamics

3Loss of energy

If the host system delays information requests to reduce communication traffic, then power consumption decreases, but the response time for buffer capacity information increases

Engineering Contradiction:
Improvepower consumptionVSAvoidresponse time
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The host system implements periodic information requests at optimally timed intervals. By using statistical data to determine the predetermined time interval, the system balances reduced power consumption from fewer requests with acceptable response times, ensuring buffer capacity information is available when needed.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The host system changes the timing parameter of information requests based on statistical analysis of past performance. This parameter adjustment optimizes the trade-off between power consumption (fewer requests) and response time (timely information availability), allowing the system to adapt to varying workload conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3834069B1Optimize information requests to a memory system
Publication Date: 2025.11.26 MICRON TECHNOLOGY INC
  • EP3834069B1 patent drawingFigure 1
  • EP3834069B1 patent drawingFigure 2
  • EP3834069B1 patent drawingFigure 3

AI summary

A system having a processing device and a controller, operatively connected to a memory sub-system via a communication channel, to: store information identifying an amount of available capacity of a buffer of the memory sub-system; transmit, through the communication channel to the memory sub-system, one or more write commands to store data in memory components of the memory sub-system, where the memory sub-system queues the one or more write commands in the buffer; update the information by deducting, from the amount of available capacity, an amount of buffer capacity used by the one or more write commands to generate a current amount of available capacity of the buffer; and determine whether to calculate an information request to the memory sub-system based at least in part on the current amount of available capacity.