Epoch-Based Barrier Termination Circuitry for Memory Transaction Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data processing systems face challenges in balancing high performance and efficiency with circuit area and power consumption when handling memory access transactions and barrier termination commands, particularly in tracking the completion of transactions preceding a barrier point.

Innovation Solution

The system employs transaction handling circuitry that issues memory access transactions with epoch identifiers, transaction tracking circuitry to count outstanding transactions by epoch, and epoch changing circuitry to signal barrier termination completion without halting transaction issuance, thereby reducing circuit area overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system tracks all outstanding memory access transactions individually to accurately determine barrier termination completion, then the reliability of barrier termination signaling is improved, but the circuit area overhead and device complexity increase significantly

Engineering Contradiction:
Improvebarrier termination completion accuracyVSAvoidcircuit area overhead
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the tracking of memory access transactions by introducing epoch identifiers that divide transactions into discrete time periods. Instead of tracking all transactions individually, the system tracks transactions per epoch, which simplifies the circuit architecture while maintaining accurate barrier termination determination. The transaction tracking circuitry maintains counters for each epoch rather than individual transaction tracking.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by establishing epoch boundaries before barrier termination determination is needed. The epoch changing circuitry pre-defines epoch identifiers and boundaries, allowing the transaction tracking circuitry to use these pre-established epochs for counting outstanding transactions. This preliminary structuring eliminates the need for complex real-time individual transaction tracking.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system halts transaction issuance to ensure barrier termination completion, then the reliability of barrier signaling is improved, but the productivity and performance of the memory access system deteriorates

Engineering Contradiction:
Improvebarrier termination completion accuracyVSAvoidmemory access transaction throughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent introduces dynamic epoch management where the current epoch can be changed without halting transaction issuance. The epoch changing circuitry dynamically updates the current epoch identifier based on barrier point signals, allowing the system to maintain continuous transaction throughput while accurately tracking completion status. This dynamic approach eliminates the need to halt transactions for barrier synchronization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary epoch establishment and transaction tagging before barrier termination determination is needed. By pre-assigning epoch identifiers to transactions and maintaining counters that track outstanding transactions per epoch, the system can determine barrier completion without interrupting ongoing transaction issuance, thus maintaining productivity.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the system uses detailed transaction tracking mechanisms to determine barrier completion, then the measurement precision of transaction completion status is improved, but the use of energy and circuit overhead increase

Engineering Contradiction:
Improvetransaction completion status accuracyVSAvoidcircuit power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the measurement task by tracking transactions in discrete epoch intervals rather than continuously monitoring all transactions. The transaction tracking circuitry uses simple counters for each epoch to determine completion status, which requires significantly less circuit area and power consumption compared to detailed individual transaction tracking, while maintaining precise barrier termination determination.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses disposable epoch identifiers and temporary counters that are reset with each epoch change. Instead of maintaining permanent detailed transaction records, the system uses short-lived epoch-based counting structures that are inexpensive to implement and reset, reducing both circuit area overhead and power consumption while achieving the required measurement precision for barrier termination.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS11379152B2Epoch-based determination of completion of barrier termination command
Publication Date: 2022.07.05 ARM LTD
  • US11379152B2 patent drawing
  • US11379152B2 patent drawing
  • US11379152B2 patent drawing

AI summary

An apparatus comprises transaction handling circuitry to issue memory access transactions, each memory access transaction specifying an epoch identifier indicative of a current epoch in which the memory access transaction is issued; transaction tracking circuitry to track, for each of at least two epochs, a number of outstanding memory access transactions issued in that epoch; barrier termination circuitry to signal completion of a barrier termination command when the transaction tracking circuitry indicates that there are no outstanding memory access transactions remaining which were issued in one or more epochs preceding a barrier point; and epoch changing circuitry to change the current epoch to a next epoch, in response to a barrier point signal representing said barrier point. This helps to reduce the circuit area overhead for tracking completion of memory access transactions preceding a barrier point.