Memory System Dual-Response Write Acknowledgment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory systems face challenges in reducing cache size and simplifying failure handling during data write operations, while also supporting host access to cached data before it is written to the memory system.

Innovation Solution

The proposed system and method involve a memory system that caches data and transmits a first response indicating caching success, followed by a second response confirming data storage in the memory device, allowing the host to manage data in a write buffer until storage is complete, thereby reducing cache size and simplifying failure handling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the memory system stores data in cache before writing to memory device, then write speed is improved, but cache size increases

Engineering Contradiction:
Improvewrite speedVSAvoidcache size
Core Design Contradiction:
SpeedVSVolume of stationary object

Solution Approach 1:

The patent segments the write operation into two distinct phases with separate response mechanisms: (1) cache write phase where data is stored in cache and a first response is immediately sent to host, and (2) memory device write phase where cached data is written to memory device with a second response confirming completion. This segmentation allows the system to provide fast write acknowledgment while using smaller cache capacity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by having the host delete data from its write buffer upon receiving the first response indicating successful cache write, before the actual memory device write is completed. This preliminary deletion of host buffer data reduces the overall data retention burden on the memory system cache, as the cache only needs to hold data until the memory device write is initiated.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the memory system waits for data to be written to memory device before confirming to host, then data reliability is improved, but write speed deteriorates

Engineering Contradiction:
Improvedata storage reliabilityVSAvoidwrite confirmation speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent divides the write confirmation process into two separate responses: a first response sent immediately upon successful cache write (providing fast acknowledgment), and a second response sent later upon successful memory device write (providing reliability confirmation). This segmentation resolves the contradiction by providing both fast initial acknowledgment and eventual reliability confirmation without requiring the host to wait for complete memory device write before receiving any acknowledgment.

Inventive Principle:
Principle #1Segmentation

3Reliability

If the host maintains data in write buffer until storage is complete, then data safety is improved, but system complexity increases

Engineering Contradiction:
Improvedata safetyVSAvoidsystem operational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by having the host delete data from its write buffer as soon as it receives the first response indicating successful cache write, rather than waiting for complete memory device write confirmation. The host's preliminary deletion is safe because the data is already safely cached in the memory system. This preliminary action simplifies the overall system by reducing the period during which data must be maintained in both host and memory system buffers.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses feedback mechanisms where the memory system provides structured responses to the host about the write operation status. The first response feedbacks that cache write is complete, enabling host buffer deletion. The second response feedbacks that memory device write is complete, enabling final cleanup. This feedback-driven approach simplifies host logic compared to implementing complex timeout-based or status-polling-based data retention strategies.

Inventive Principle:
Principle #23Feedback

4Ease of operation

If the memory system uses a single response for write completion, then communication simplicity is improved, but failure handling complexity increases

Engineering Contradiction:
Improvecommunication simplicityVSAvoidfailure handling complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the response communication into two distinct types: a first response indicating cache write completion and a second response indicating memory device write completion. This segmentation, while increasing the number of message types, actually simplifies failure handling by providing granular feedback. Each response type enables specific failure handling actions: upon first response, host can delete buffer data; upon second response, host knows the entire write operation is complete. This is simpler than using a single response that provides no information about intermediate failure states.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11561725B2System and operating method thereof
Publication Date: 2023.01.24 SK HYNIX INC
  • US11561725B2 patent drawing
  • US11561725B2 patent drawing
  • US11561725B2 patent drawing

AI summary

Embodiments of the present disclosure relate to a system and an operating method thereof. According to embodiments of the present disclosure, a memory system may transmit a first type response indicating that first data has been cached in a cache to the host when receiving a first command requesting to write the first data from the host, and may transmit a second type response indicating success or failure of an operation of storing the first data in the memory device to the host after transmitting the first type response to the host. Further, the host may delete the first data from a write buffer after the operation of storing the first data in the memory device succeeds.