CXL Peer-to-Peer Snapshot Copying for Database Memory and Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The input/output performance of disk storage devices has become a bottleneck in database systems, even with the use of solid-state disks, limiting the performance of database operations in real-time processing and high-performance scenarios.
Innovation Solution
A computer communication device utilizing Compute Express Link (CXL)-based connectivity for peer-to-peer data transfer between a host, memory device, and storage device, enabling direct memory access (DMA) to copy data directly between these components without host intervention, supporting in-memory databases with improved snapshot operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If disk input/output interfaces are used for database operations, then data can be stored on disk, but the input/output performance becomes a bottleneck limiting database performance
Solution Approach 1:
The patent introduces a computing unit with a DMA engine as an intermediary between the host and the storage/memory devices. This intermediary enables direct data transfer between devices without requiring host CPU intervention for each I/O operation, effectively decoupling the host from the I/O bottleneck and improving both database performance and transfer speed
Solution Approach 2:
The patent replaces the traditional host-mediated data transfer mechanism with a hardware-based DMA (Direct Memory Access) system. This substitution eliminates the need for software-based I/O operations that constrain speed, allowing parallel data transfers to occur at hardware-level speeds without CPU involvement
2Productivity
If host intervention is used for data copying between memory and storage, then data can be transferred, but the snapshot cycle time increases and host resources are consumed
Solution Approach 1:
The patent implements self-service data transfer where the DMA engine autonomously performs data copying between memory devices and storage devices without requiring host CPU intervention. The computing unit independently manages snapshot operations, reducing snapshot cycle time and freeing host resources for other database operations
3Speed
If traditional I/O interfaces are used, then data can be accessed, but the transmission path is long and transmission efficiency is limited
Solution Approach 1:
The patent extracts the data transfer function from the host CPU and implements it directly in the computing unit's DMA engine. This extraction creates a direct transmission path between memory and storage devices, eliminating the long I/O path through the host and significantly improving data transmission efficiency
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A computer networking device includes a plurality of ports, a memory, and a computing unit. The computing unit receives source information and destination information for a snapshot from the host; obtains a read-value of a memory area corresponding to the source information in a memory device through a port identified based on mapping information and the source information; and transmit, to a storage device, the read-value based on peer-to-peer communication for a write operation of writing in a memory area corresponding to the destination information in the storage device through a port identified based on the mapping information and the destination information.