CXL Memory Sharing With Switch Arbitration for Multi-Host Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computing systems where multiple host devices share a memory device, data transmission efficiency decreases as the number of host devices increases.

Innovation Solution

Implementing a compute express link (CXL) switch or fabric manager to arbitrate communication between host devices and a memory device, using directory information to generate encoding data based on requests from multiple hosts, and transmitting this data efficiently through a CXL interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a memory device is shared by multiple host devices using sequential data transmission, then the system can support multiple hosts, but data transmission efficiency decreases as the number of hosts increases

Engineering Contradiction:
Improvenumber of host devicesVSAvoiddata transmission efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the data transmission process by introducing a CXL switch that divides the arbitration function into separate handling paths for different host devices. The switch segments the data requests and routes them through dedicated paths to the memory device, allowing parallel processing of multiple host requests rather than sequential handling, thus improving data transmission efficiency while supporting multiple hosts.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The CXL switch acts as an intermediary device between multiple host devices and the memory device. It mediates the communication by receiving data requests from multiple hosts, arbitrating their access to the memory device, and managing data transmission through directory information and encoding data generation. This intermediary function enables efficient multi-host support without degrading transmission efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If sequential data transmission is used to support multiple host devices, then system complexity remains manageable, but transmission efficiency deteriorates with more hosts

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidcommunication arbitration system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The CXL switch implements a universal arbitration mechanism that handles data requests from multiple host devices through a unified directory information structure. The switch uses a common encoding data generation process that works across different host devices and memory configurations, providing multi-functional capability without proportionally increasing system complexity. This universal approach allows efficient handling of multiple hosts through a standardized interface and protocol.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12536107B2Memory device and computing system including memory device
Publication Date: 2026.01.27 SAMSUNG ELECTRONICS CO LTD
  • US12536107B2 patent drawing
  • US12536107B2 patent drawing
  • US12536107B2 patent drawing

AI summary

Disclosed is a system which includes a first memory device that stores a first data set, and a compute express link (CXL) switch that arbitrates communication of a first host device and a second host device with the first memory device based on a CXL interface. The first memory device receives a first data request and a second data request from the first and second host devices, respectively, through the CXL switch, obtains first directory information and second directory information from the first and second host devices through the CXL switch, generates first encoding data based on the first and second directory information, and outputs the first encoding data to each of the first and second host devices through the CXL switch in response to the first and second data requests.