Conditional Load Timeout Device for Memory Bus Traffic Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in serializing memory access requests from concurrently executing threads or processes, leading to inefficiencies and increased bus traffic, as they lack effective mechanisms to manage conditional load operations with time-outs.

Innovation Solution

A Conditional Load with Time-out (CLT) device is implemented in a memory controller, which receives memory load requests, checks conditions, and delays responses if conditions are not met, allowing store operations to satisfy conditions before exceeding a time-out threshold, thereby serializing access and reducing unnecessary load requests.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple threads concurrently execute memory load requests without conditional access control, then processor productivity is maintained, but memory access conflicts increase and bus traffic increases

Engineering Contradiction:
Improveprocessor efficiencyVSAvoidbus traffic
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The CLT device acts as an intermediary between threads and memory, receiving conditional load requests, evaluating conditions, and coordinating access. This mediator serializes access requests and manages wait periods, reducing direct conflicts and unnecessary bus traffic while maintaining thread productivity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary condition evaluation before allowing memory access. By checking conditions in advance and establishing wait periods, the system prevents redundant load requests and resolves access conflicts before they occur, reducing overall bus traffic.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If threads continuously poll memory addresses without time-out mechanism, then access completeness is ensured, but time is wasted and productivity decreases

Engineering Contradiction:
Improveaccess completenessVSAvoidwait period
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The CLT device implements a feedback mechanism where threads receive replies indicating whether their condition was satisfied or the wait period exceeded. This feedback allows threads to understand the outcome of their access attempts and adjust their behavior accordingly, eliminating endless polling while maintaining reliability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system provides self-service by automatically managing wait periods and condition evaluation. Threads initiate requests and receive appropriate responses without continuous intervention, allowing the system to handle timing and coordination autonomously while preserving thread productivity.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If conditional load operations are implemented without time-out feature, then access precision is improved, but device complexity increases

Engineering Contradiction:
Improvecondition satisfaction accuracyVSAvoidmemory controller structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system introduces a time-out parameter to the conditional load operation, transforming it from an indefinite wait to a bounded operation. This parameter change simplifies the device structure by providing a clear termination condition while maintaining precise condition evaluation through the CLT device.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9940128B2Conditional access with timeout
Publication Date: 2018.04.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US9940128B2 patent drawing
  • US9940128B2 patent drawing
  • US9940128B2 patent drawing

AI summary

A method can include receiving a first memory load request by a conditional load with time out (CLT) device at a first time. The first memory load request can specify a first condition. A first determination of whether the first condition is satisfied is performed. The CLT device determines a wait period when the first condition is not satisfied. A reply is issued. The reply indicates that the first condition is satisfied when the first condition is satisfied. The reply indicates that the first condition is not satisfied when the duration of the wait period exceeds a time-out threshold. When the first condition is not satisfied, a first memory store request can be received during the wait period and a second determination of whether the first condition satisfied performed. The reply indicates that the first condition is satisfied when the second determination is that the first condition is satisfied.