Dynamic Buffer Partitioning for Memory Read Write Bottlenecks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory systems face communication bottlenecks due to predetermined order execution of read and write commands, leading to buffer overflow issues when buffers are full, restricting further command transmissions until previous commands are completed.

Innovation Solution

Implementing a buffer management system that dynamically partitions buffers for shared use between read and write requests, allowing flexible allocation of buffer capacity based on current needs, enabling the host system to track and manage available buffer capacity for efficient transmission of commands without causing buffer overflow.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If predetermined order execution of read and write commands is implemented, then command execution order is maintained, but communication bottlenecks and buffer overflow issues occur

Engineering Contradiction:
Improvecommand execution orderVSAvoidcommand transmission efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent divides the buffer into separate read buffer and write buffer regions, allowing independent management of read and write commands. This segmentation enables the system to track and manage buffer capacity for each command type separately, preventing buffer overflow while maintaining execution order within each buffer type.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic buffer capacity tracking where the host system monitors available buffer capacity in real-time and adjusts command transmission accordingly. The buffer manager dynamically allocates and releases buffer capacity based on command completion, allowing flexible adaptation to varying workload conditions while preventing overflow.

Inventive Principle:
Principle #15Dynamics

2Productivity

If buffer capacity is allocated for read commands, then read operations can proceed, but write commands may be restricted when buffer is full

Engineering Contradiction:
Improveread operation throughputVSAvoidbuffer allocation flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent creates a shared buffer structure that can serve both read and write operations. The same buffer resource is universally allocated to handle different command types, with the buffer manager dynamically determining capacity allocation based on current operational needs rather than fixed dedicated partitions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic adjustment of buffer capacity parameters for read and write commands based on real-time system state. The host system monitors buffer usage and adjusts the amount of buffer capacity allocated to each command type, changing allocation parameters adaptively to optimize both read throughput and write flexibility.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If host system waits for buffer capacity availability, then buffer overflow is prevented, but transmission delays occur

Engineering Contradiction:
Improvebuffer overflow preventionVSAvoidcommand transmission delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements a feedback mechanism where the host system continuously monitors buffer capacity status and receives notifications about available buffer space. The buffer manager provides feedback on buffer occupancy levels, enabling the host to adjust transmission timing dynamically - sending commands when capacity is available and waiting only when necessary - thus preventing overflow while minimizing delays.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent enables the host system to proactively track and anticipate buffer capacity availability rather than reactively waiting. By monitoring buffer usage patterns and command completion rates, the host can predict when buffer space will become available and prepare commands accordingly, reducing idle waiting time while maintaining overflow prevention.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11573700B2Buffer management in memory systems for read and write requests
Publication Date: 2023.02.07 MICRON TECHNOLOGY INC
  • US11573700B2 patent drawing
  • US11573700B2 patent drawing
  • US11573700B2 patent drawing

AI summary

A memory system having memory components and a processing device to: receive a write request from a host system; store data of the write request in a portion of a buffer of the memory system during a first time period in which the write request is pending in the memory system; receive a read request from the host system; and store data of the read request in a portion of the buffer during a second time period in which the read request is pending in the memory system. The portion of the buffer storing the data of the write request overlaps at least in part with the portion of the buffer storing the data of the read request.