Virtual Addressing Across CXL Memory Domains
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing memory systems, such as those using the Compute Express Link (CXL) interface, are limited by a single-host domain in terms of accessible memory, which restricts the global address space and hinders efficient interaction between multiple operating system (OS) domains.
Innovation Solution
Implementing a system that utilizes virtual addresses across multiple memory systems and domains, enabling a global virtual address space. This system includes data packets with specific fields, such as a destination ID, to facilitate communication between CXL devices without host interaction, allowing for address translations on a per-device basis and reducing the need for host involvement in memory access operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single-host domain memory system is used, then the system structure is simple, but the accessible address space is limited
Solution Approach 1:
The patent segments the memory system into multiple independent memory devices, each with its own address space. Memory devices are organized into different host domains (first host domain, second host domain), allowing each domain to access its own memory devices independently. This segmentation enables the system to overcome the address space limitation of a single-host domain while maintaining manageable complexity through modular organization.
Solution Approach 2:
The patent introduces a new dimension by adding host domain identification to the traditional memory address structure. Instead of only device addresses within a single host, the system now includes host domain identifiers that enable addressing across multiple host domains. This dimensional extension transforms the address space from a single-dimensional device address to a multi-dimensional address including host domain and device address components.
2Quantity of substance
If multiple memory devices are accessed across different host domains, then the global address space increases, but the latency for memory access operations increases
Solution Approach 1:
The patent implements preliminary action by pre-establishing address translation mechanisms and data packet structures that include host domain identifiers. Memory devices are pre-configured with the ability to recognize and process requests from different host domains using standardized data packet formats. This preliminary setup enables direct peer-to-peer communication between memory devices across host domains without requiring real-time host intervention, thereby reducing access latency.
Solution Approach 2:
The patent introduces data packets as intermediaries that carry both the host domain identifier and the device address. These standardized data packets serve as a communication medium that enables memory devices in different host domains to exchange information efficiently. The data packet structure acts as an intermediary layer that abstracts the complexity of cross-domain communication, allowing memory devices to interact directly without host mediation while maintaining proper address translation and domain identification.
3Ease of operation
If host interaction is required for memory access, then address translation can be performed, but the communication efficiency between memory devices decreases
Solution Approach 1:
The patent implements self-service by enabling memory devices to perform address translation and communication independently without host intervention. Each memory device is equipped with the capability to process data packets containing host domain identifiers and device addresses, perform necessary address translations using its own resources, and respond directly to requests from other memory devices. This self-service approach eliminates the communication overhead of host involvement while maintaining proper address management.
Solution Approach 2:
The patent creates a universal data packet structure that can be used for various types of memory access operations across different host domains. The standardized packet format with host domain identifier and device address fields serves multiple functions: identifying the source and destination domains, routing the request appropriately, enabling address translation, and facilitating the actual data transfer. This multi-functional universal structure improves communication efficiency by eliminating the need for different protocols or host-specific handling for different operation types.
Data Source
AI summary
Methods, systems, and devices for virtual addresses for a memory system are described. In some examples, a virtual address space may be shared across a plurality of memory devices that are included in one or more domains. The memory devices may be able to communicate with each other directly. For example, a first memory device may be configured to generate a data packet that includes an identifier and an address that is included in the shared virtual address space. The data packet may be transmitted to a second memory device based on the identifier, and the second memory device may access a physical address based on the address.