CXL Memory Data Redistribution for Lower Access Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing demand for heterogeneous computing due to specialized workloads like compression, encryption, and artificial intelligence requires high-performance connections between processors and accelerators, necessitating efficient memory management and reduced latency through chip-to-chip interconnect protocols.
Innovation Solution
A CXL device with a memory and control logic that calculates a use ratio and distributes data across multiple CXL devices based on reference values, optimizing data storage and reducing latency through data dispersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a single CXL device, then memory capacity is sufficient, but data skew increases and access latency increases
Solution Approach 1:
The patent segments data storage across multiple CXL devices based on usage ratios. When a CXL device's usage ratio exceeds a threshold, it transfers portions of its data to other CXL devices with lower usage ratios. This segmentation distributes data storage responsibilities, preventing any single device from becoming a bottleneck and thereby reducing access latency while maintaining reliable memory access across the distributed system.
Solution Approach 2:
The patent introduces a new dimension of data distribution by utilizing multiple CXL devices instead of relying on a single device. By calculating usage ratios and dynamically redistributing data across multiple devices, the system transforms from a centralized storage model to a distributed multi-dimensional storage architecture, which reduces data access latency and improves overall system reliability.
2Device complexity
If data is concentrated in one CXL device, then memory management is simple, but data skew increases
Solution Approach 1:
The patent implements dynamic data distribution by continuously calculating usage ratios of CXL devices and automatically transferring data from high-usage devices to low-usage devices. This dynamic adjustment mechanism maintains balanced data distribution across the system, preventing data skew without requiring complex manual management. The system adapts to changing data access patterns in real-time, maintaining both simplicity and uniformity.
Solution Approach 2:
The patent employs a feedback mechanism where the system continuously monitors usage ratios of CXL devices and triggers data transfer operations when thresholds are exceeded. This feedback loop automatically corrects data skew by redistributing data from overloaded devices to underutilized devices, maintaining stable and uniform data distribution across the system without requiring complex external management.
3Stability of the object's composition
If data is transferred between CXL devices, then data skew is reduced, but device complexity increases
Solution Approach 1:
The patent implements self-service data transfer where CXL devices automatically monitor their own usage ratios and initiate data transfer operations when thresholds are exceeded. Each device independently calculates its usage ratio and autonomously transfers data to appropriate target devices, eliminating the need for complex external control mechanisms. This self-service approach reduces data skew while keeping the control architecture relatively simple.
Data Source
AI summary
A CXL device according to an example embodiment may include: a memory configured to storing first data; and a control logic configured to calculate a first use ratio of the CXL device, and configured to output second data that are part of first data, stored in the CXL device, to an external share memory through a CXL interface in response to the first use ratio being greater than a reference value.