Redis Memory Management via Host and CXL Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Redis memory databases often face insufficient memory space, leading to inefficient memory usage and potential data loss due to the lack of consideration for the length of values in key-value pairs during memory management.
Innovation Solution
The proposed solution involves a method and device for data access that utilizes both host memory and Computing Express Link (CXL) memory. This approach writes keys to host memory and determines whether to write values to host memory or CXL memory based on the value's length, optimizing storage space and access efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If all key-value pairs are stored in host memory, then data access speed is fast, but memory space is insufficient when large amounts of data are written continuously
Solution Approach 1:
The patent segments the memory storage system into two parts: hot data (frequently accessed) stored in host memory and cold data (less frequently accessed) stored in CXL memory. This segmentation allows the system to maintain fast access for frequently used data while expanding total storage capacity to handle large volumes of data writes without being constrained by host memory limits.
2Quantity of substance
If CXL memory is used to expand storage capacity, then memory space is sufficient, but data access efficiency may be reduced
Solution Approach 1:
The patent applies local quality by assigning different storage locations based on data characteristics: frequently accessed keys and their corresponding values remain in host memory for fast access, while less frequently accessed data is placed in CXL memory. This ensures that the most performance-critical data operations maintain high speed while utilizing expanded storage capacity for less time-sensitive data.
3Device complexity
If memory management does not consider value length, then management is simple, but memory usage efficiency is poor and data loss may occur
Solution Approach 1:
The patent introduces value length as a key parameter in the memory management decision-making process. By evaluating the length of key-value pairs, the system can make informed decisions about whether to store data in host memory or CXL memory, and determine appropriate eviction strategies when memory is full. This parameter-based approach significantly improves memory usage efficiency and prevents data loss while maintaining manageable complexity through standardized evaluation criteria.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A method and device for data access, electronic apparatus and storage medium are provided. The method for data access includes: writing a key of a first key-value pair to a host memory in response to a write request to write the first key-value pair to the memory database; determining whether to write a value of the first key-value pair to the host memory or a Computing Express Link (CXL) memory based on a length of the value of the first key-value pair; and writing the value of the first key-value pair to the host memory or the CXL memory, based on a result of the determination.