Memory Access Broker Early Write Acknowledgement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory bus architectures face performance issues due to explicit write acknowledgement schemes, which lead to increased latency and impact the execution integrity of applications with write-intensive memory access patterns, particularly in systems with longer access delays like disaggregated memory systems.

Innovation Solution

A memory access broker system with application-controlled early write acknowledgment (EWACK) support is introduced, allowing for selective enabling of EWACK operations and notification of failed write requests, enabling faster write access and ensuring data integrity without affecting legacy applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If explicit write acknowledgement schemes are implemented to guarantee delivery of memory access requests, then reliability is improved, but productivity deteriorates due to increased latency in write-intensive applications

Engineering Contradiction:
Improvedelivery guarantee of memory access requestsVSAvoidexecution performance of write-intensive applications
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary action by sending an early write acknowledgement (EWACK) to the application before the write data is fully transferred to memory. The memory access broker issues EWACK immediately when the write request is received, allowing the application to proceed without waiting for actual memory completion, while still maintaining delivery guarantees through subsequent verification mechanisms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The memory access broker acts as an intermediary between the application and memory system. It manages the discrepancy between early acknowledgements and actual write completion by tracking write requests, comparing EWACK sequences with actual memory acknowledgements, and handling failures through retry mechanisms, thus resolving the contradiction between speed and reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If early write acknowledgement is enabled to reduce memory access latency, then productivity is improved, but reliability deteriorates due to potential failed write requests

Engineering Contradiction:
Improvememory access speedVSAvoiddata integrity of write operations
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system implements feedback mechanisms where the memory access broker continuously monitors write request sequences and compares EWACK issuance against actual memory write completion status. When discrepancies are detected (indicating failed writes), the system triggers retry operations to correct errors, thus maintaining reliability while enabling early acknowledgements for improved productivity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system prepares for potential failures by implementing beforehand cushioning through sequence number tracking and failure detection mechanisms. Before actual data loss can occur, the system detects missed EWACKs and initiates retry operations, cushioning against the reliability risks introduced by early acknowledgements.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

3Adaptability or versatility

If selective enabling of EWACK operations is implemented to serve specific applications, then adaptability is improved, but device complexity increases due to runtime control mechanisms

Engineering Contradiction:
Improveability to serve different application typesVSAvoidruntime control and monitoring mechanisms
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The memory access broker implements dynamic behavior by allowing runtime enabling and disabling of EWACK operations through control registers. Applications can selectively opt-in to EWACK mode when they can tolerate potential failures, while legacy applications continue to use traditional reliable write semantics, thus achieving adaptability without permanently increasing system complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10423563B2Memory access broker system with application-controlled early write acknowledgment support and identification of failed early write acknowledgment requests to guarantee in-order execution of memory requests of applications
Publication Date: 2019.09.24 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10423563B2 patent drawing
  • US10423563B2 patent drawing
  • US10423563B2 patent drawing

AI summary

Embodiments for a memory access broker system with application-controlled early write acknowledgment support. A memory access broker may be selectively enabled to facilitate early write acknowledgement (EWACK) operations and notification of failed EWACK write requests to one or more issuing applications such that the failed EWACK write requests are logged by the memory access broker for inspection by the one or more issuing applications.