Transaction Regulator Circuitry for Dynamic Outstanding Limits

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Data processing systems face inefficiencies due to imbalances in outstanding transactions, leading to either low throughput or increased latency, as existing methods struggle to dynamically regulate the number of outstanding transactions across initiator and downstream devices in a way that optimizes resource utilization and prevents bottlenecks.

Innovation Solution

Incorporating transaction regulator circuitry that allows initiator devices to issue transactions subject to a limit on the maximum number of outstanding transactions, with downstream devices authorizing changes to these limits based on occupancy and demand, enabling dynamic adjustment of transaction limits to maintain system efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the number of outstanding transactions is increased to improve throughput, then bandwidth utilization is improved, but latency increases due to longer queue delays

Engineering Contradiction:

ImprovethroughputVSAvoidlatency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent implements dynamic regulation of the outstanding transaction limit through transaction regulator circuitry that automatically adjusts the limit based on real-time system conditions. The regulator monitors the number of outstanding transactions and dynamically modifies the limit to optimize the balance between throughput and latency, preventing both underutilization and excessive queuing delays.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms where the transaction regulator circuitry continuously monitors transaction flow and system state, then adjusts the outstanding transaction limit accordingly. This closed-loop control ensures the system maintains optimal performance by responding to actual workload conditions rather than using fixed parameters.

Inventive Principle:

Principle #23Feedback

2Productivity

If the outstanding transaction limit is set high to prevent bottlenecks, then resource utilization is improved, but system complexity increases due to difficulty in regulating transactions

Engineering Contradiction:

Improveresource utilizationVSAvoidtransaction regulation complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The transaction regulator circuitry operates autonomously to manage outstanding transaction limits without requiring external intervention or complex external control mechanisms. The regulator self-adjusts based on monitored system conditions, simplifying the overall control architecture while maintaining effective transaction regulation.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent introduces transaction regulator circuitry as an intermediary component between the initiator device and the transaction flow. This intermediary automatically manages the outstanding transaction limit, shielding higher-level system components from the complexity of direct transaction regulation while maintaining optimal resource utilization.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Device complexity

If the outstanding transaction limit is fixed to simplify regulation, then device complexity is reduced, but adaptability decreases when system demand changes

Engineering Contradiction:

Improveregulation mechanism simplicityVSAvoidsystem adaptability

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The system transitions from static to dynamic limit management by implementing regulator circuitry that automatically adjusts the outstanding transaction limit based on real-time conditions. This dynamic approach maintains regulatory simplicity while achieving adaptability, as the regulator handles complexity internally without requiring complex external control logic.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent implements automatic parameter adjustment where the outstanding transaction limit is modified based on system state changes. The regulator circuitry monitors workload conditions and dynamically changes the limit parameter to match demand, providing adaptability without requiring manual intervention or complex external control systems.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS10956205B2Data processing

Publication Date: 2021.03.23 ARM LTD

AI summary

Data processing apparatus comprises one or more transaction issuing devices configured to issue data processing transactions to be handled by a downstream device and to receive a completion acknowledgement in respect of each completed transaction; each transaction issuing device having associated transaction regulator circuitry configured to allow that transaction issuing device to issue transactions subject to a limit on a maximum number of outstanding transactions, an outstanding transaction being a transaction which has been issued but for which a completion acknowledgement has not yet been received; in which the downstream device is configured to issue an indication to a transaction issuing device, to authorize a change by the transaction regulator circuitry of the limit applicable to outstanding transactions by that transaction issuing device.