Dynamic Memory Connection Direction for Asymmetric Traffic

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional composable systems experience static data connections that lead to excessive burden on some connections and underutilization of others due to asymmetric memory operation traffic patterns, resulting in high access latencies and inefficient resource utilization.

Innovation Solution

Implement dynamic direction adjustment of connections between a host and memory based on observed traffic patterns, reallocating resources to accommodate fluctuating data traffic loads by configuring subsets of connections for downstream and upstream traffic.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If static data connections are used between host and memory, then connection configuration is simple and stable, but some connections experience excessive burden while others are underutilized due to asymmetric traffic patterns

Engineering Contradiction:
Improveconnection configurationVSAvoidconnection utilization efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements dynamic connection direction adjustment where the controller monitors traffic patterns and modifies connection directions in real-time based on observed asymmetries. This transforms static connections into dynamic ones that adapt to workload characteristics, resolving the contradiction between configuration simplicity and utilization efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the directional parameter of connections dynamically based on traffic pattern analysis. By monitoring read/write asymmetries and adjusting connection directions accordingly, the system optimizes bandwidth allocation without requiring complex manual configuration, thus improving productivity while maintaining manageable complexity.

Inventive Principle:
Principle #35Parameter changes

2Stability of the object's composition

If static connection directions are maintained, then system stability is preserved, but high access latencies occur due to excessive queueing delays on saturated connections

Engineering Contradiction:
Improvesystem stabilityVSAvoidaccess latency
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The controller implements feedback mechanisms by continuously monitoring traffic patterns on connections and using this information to dynamically adjust connection directions. This closed-loop control system maintains stability through controlled adaptations while reducing access latencies by preventing queueing delays on saturated connections.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system introduces dynamic adjustment of connection directions while maintaining overall system stability through controlled, monitored changes. The dynamic reconfiguration allows the system to adapt to varying workload conditions, reducing access latencies without compromising system stability.

Inventive Principle:
Principle #15Dynamics

3Productivity

If connection direction is dynamically adjusted based on traffic patterns, then bandwidth allocation is optimized and access latency is reduced, but system complexity increases

Engineering Contradiction:
Improvebandwidth allocation efficiencyVSAvoidconnection management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service through automated traffic pattern monitoring and autonomous connection direction adjustment. The controller automatically detects asymmetries and reconfigures connections without external intervention, optimizing bandwidth allocation while managing complexity through automation rather than manual processes.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The feedback-driven automated control system optimizes bandwidth allocation by continuously monitoring traffic patterns and adjusting connection directions accordingly. This self-regulating mechanism improves productivity while containing complexity through automated decision-making rather than manual management.

Inventive Principle:
Principle #23Feedback

4Reliability

If more connections are allocated to handle peak traffic in one direction, then traffic capacity is sufficient, but connections in the opposite direction become underutilized

Engineering Contradiction:
Improvetraffic capacity sufficiencyVSAvoidconnection utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies dynamic reconfiguration of connection directions based on real-time traffic pattern monitoring. During peak read traffic, connections are dynamically switched to support read operations, and vice versa for write operations. This dynamic adaptation ensures sufficient traffic capacity in the dominant direction while maintaining the ability to utilize all connections efficiently as traffic patterns change.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250377796A1Connection Modification based on Traffic Pattern
Publication Date: 2025.12.11 ADVANCED MICRO DEVICES INC
  • US20250377796A1 patent drawing
  • US20250377796A1 patent drawing
  • US20250377796A1 patent drawing

AI summary

Connection modification based on traffic pattern is described. In accordance with the described techniques, a traffic pattern of memory operations across a set of connections between at least one device and at least one memory is monitored. The traffic pattern is then compared to a threshold traffic pattern condition, such as an amount of data traffic in different directions across the connections. A traffic direction of at least one connection of the set of connections is modified based on the traffic pattern corresponding to the threshold traffic pattern condition.