CXL Memory Subsystem Tracking Database Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current memory sub-systems, such as solid-state drives, face inefficiencies in tracking and storing small changes to database records due to the need to partially modify or fully utilize block-sized storage, leading to resource wastage and inefficiencies in data management.
Innovation Solution
Implementing a memory sub-system that provides both memory and storage services via a Compute Express Link (CXL) connection, allowing for cache-coherent memory services and efficient tracking of changes using write-ahead logs and simple sorted tables, with volatile memory backed by a backup power source to ensure data persistence during power disruptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If block-sized storage is used to track changes to database records, then storage capacity is provided, but resource wastage occurs when only small changes need to be stored
Solution Approach 1:
The storage space is segmented into two distinct portions: a first portion for storing database records and a second portion for storing changes to those records. This segmentation allows the change tracking function to use only the necessary space without requiring full block-sized allocations, thereby reducing resource wastage while maintaining storage capacity for the database records.
2Speed
If volatile memory is used to track changes, then fast access is achieved, but data persistence during power disruptions is lost
Solution Approach 1:
A backup power source is provided that activates in advance or upon detection of power disruption to preserve changes in the second storage portion. This preliminary protective action ensures that even though volatile memory is used for fast access, the data persistence requirement is met by having a backup mechanism ready before data loss can occur.
3Reliability
If frequent data retransmission is used to ensure consistency, then data integrity is maintained, but productivity decreases due to repeated transmissions
Solution Approach 1:
A copy of the database records is maintained in the second storage portion alongside the original records. This copy mechanism allows the system to track changes efficiently without requiring frequent retransmission of entire datasets, thereby maintaining data integrity while improving productivity by reducing redundant transmission operations.
Data Source
AI summary
A computing device having a computer express link (CXL) connection between a memory sub-system and a host system to write records of a database into a storage portion of the memory sub-system and store data identifying changes to the database into a memory portion of the memory sub-system. The records can be written to the storage portion using a storage access protocol of the CXL connection; and the change data can be stored to the memory portion using a cache coherent memory access protocol of the CXL connection. The change data can be written from the memory portion to a file in the storage portion.