CXL Interconnect Congestion Monitoring for Dynamic Memory Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing systems experience increased latency and decreased interface bandwidth efficiency during data transfer due to memory congestion and inefficient signal transfer paths.

Innovation Solution

Implementing a computing system with a CXL interconnect device and congestion monitors that monitor signal transfers in real time, allowing for dynamic memory region allocation and signal path adjustment based on congestion information to reduce delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If memory devices are shared by multiple host devices, then resource utilization is improved, but signal transfer delay increases due to congestion

Engineering Contradiction:
Improvememory sharing capabilityVSAvoidsignal transfer delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements dynamic memory region allocation where the interconnect device adjusts the mapping between host devices and memory regions based on real-time congestion information. This dynamic reconfiguration allows the system to adapt to changing load conditions, redirecting traffic away from congested memory regions to reduce signal transfer delay while maintaining high memory sharing utilization.

Inventive Principle:
Principle #15Dynamics

2Productivity

If data transfer operations are increased, then productivity is improved, but interface bandwidth efficiency decreases due to congestion

Engineering Contradiction:
Improvedata transfer throughputVSAvoidinterface bandwidth efficiency
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent employs a feedback mechanism where congestion monitors continuously detect congestion levels in memory regions and provide this information to the interconnect device. The interconnect device uses this feedback to dynamically adjust memory region allocation, ensuring that data transfer operations are routed through non-congested paths. This maintains high productivity while optimizing interface bandwidth efficiency by avoiding redundant transfers through congested regions.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12561271B2Computing systems having congestion monitors therein and methods of controlling operation of same
Publication Date: 2026.02.24 SAMSUNG ELECTRONICS CO LTD
  • US12561271B2 patent drawing
  • US12561271B2 patent drawing
  • US12561271B2 patent drawing

AI summary

A computing system includes an interconnect device, a plurality of memory devices electrically coupled to communicate with the interconnect device, a plurality of host devices electrically coupled to communicate with the interconnect device and configured to generate requests for access to the plurality of memory devices via the interconnect device, and a plurality of congestion monitors. These congestion monitors are configured to generate congestion information by monitoring a congestion degree of signal transfers with respect to at least one of the plurality of memory devices and the interconnect device in real time. The computing system is also configured to control at least one of: a memory region allocation of the plurality of host devices to the plurality of memory devices, and a signal transfer path inside the interconnect device, based on the congestion information.