Memory Port Arbitration with Dynamic Traffic Stream Priorities

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing memory systems fail to distinguish between different traffic streams, leading to inefficient resource allocation and potential delays in processing critical transactions due to static policies like round-robin arbitration.

Innovation Solution

Implementing dynamic port arbitration circuitry that differentiates between traffic streams based on user-defined parameters, applying backpressure to lower-priority streams when resource thresholds are met, ensuring higher-priority transactions receive adequate bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If static round-robin arbitration is used, then device complexity is reduced, but productivity deteriorates due to inefficient resource allocation and delays in processing critical transactions

Engineering Contradiction:

Improvetransaction processing efficiencyVSAvoidarbitration circuitry complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic port arbitration that adapts traffic stream priorities based on user-defined parameters and system state, transitioning from static round-robin to dynamic priority-based scheduling. This allows the system to optimize transaction processing efficiency by allocating bandwidth according to actual needs while maintaining manageable complexity through parameterized control logic.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system uses user-defined parameters to configure arbitration behavior, allowing flexibility in prioritizing different traffic streams without changing the fundamental arbitration structure. This enables productivity improvement through parameter adjustment rather than structural complexity increase.

Inventive Principle:

Principle #35Parameter changes

2Loss of time

If traffic streams are not distinguished, then device complexity is reduced, but loss of time increases due to delays in processing critical transactions

Engineering Contradiction:

Improvetransaction delayVSAvoidtraffic stream differentiation

Core Design Contradiction:

Loss of timeVSDevice complexity

Solution Approach 1:

The patent segments traffic into distinct traffic streams with different priorities, allowing critical transactions to be identified and processed separately from non-critical ones. This segmentation reduces transaction delays for time-sensitive operations while maintaining clear differentiation logic through port-based classification.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The arbitration circuitry acts as an intermediary that classifies and routes different traffic streams to appropriate processing queues based on user-defined parameters. This intermediary layer enables time-critical transactions to receive preferential treatment without requiring complex end-to-end system modifications.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Productivity

If dynamic port arbitration is implemented, then productivity is improved through optimized resource allocation, but device complexity increases due to additional arbitration circuitry

Engineering Contradiction:

Improveresource utilizationVSAvoidarbitration circuitry structure

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The arbitration circuitry is designed to handle multiple traffic stream priorities and user-defined parameters within a single unified structure. This multi-functional design achieves optimized resource allocation for different traffic patterns without requiring separate arbitration logic for each scenario, thereby improving productivity while controlling complexity growth.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Productivity

If backpressure is not applied to lower-priority streams, then ease of operation is maintained, but productivity deteriorates due to insufficient bandwidth for higher-priority transactions

Engineering Contradiction:

Improvebandwidth allocationVSAvoidtraffic stream control

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The dynamic port arbitration system implements feedback mechanisms that monitor traffic stream characteristics and adjust bandwidth allocation accordingly. When lower-priority streams consume excessive resources, the system applies backpressure automatically based on user-defined parameters, ensuring higher-priority transactions receive adequate bandwidth while maintaining operational simplicity through automated control.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS20260003529A1Port arbitration

Publication Date: 2026.01.01 MICRON TECHNOLOGY INC

AI summary

Apparatuses and methods related to port arbitration of a memory system are described. A memory system can receive a first number of transactions and a second transaction from a first traffic stream and a third number of transactions and a fourth transaction from a second traffic stream. The memory system can process the first number of transactions at least partially concurrently with the third number of transactions. Responsive to a total quantity of transactions of the first number of transactions and the second transaction being at least a threshold quantity of transactions, the second transaction can be processed by the memory system and, subsequent to processing the second transaction, the fourth transaction can be processed by the memory system.