Data processing method and device of kv SSD
A technology of data processing and compression processing, which is used in electrical digital data processing, special data processing applications, database indexing, etc. Amplifies, increases the effect of durability
Active Publication Date: 2022-07-15
南京得瑞芯存科技有限公司
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The non-compression scheme has the following problems: a) the data of each key-value pair is stored in the storage medium in its original size, and the utilization rate of the medium is low; b) the write amplification of user data is greater than or equal to 1, and the write amplification is the The ratio of the amount of data to the user's original data; c) The service life (durability) of the entire SSD is not high
In addition, there are two data writing schemes of block storage data compression and object storage compression in the existing technology, but the block storage data compression scheme is only applicable to the block storage direction, and has little significance for the use direction of KV SSD
The main idea of the object storage compression scheme is to use the characteristics of the LSM database, use the logical relationship between KV to deduplicate data, and reduce the impact of write amplification caused by garbage collection. This scheme is mainly aimed at the database direction of the LSM number in the object storage Optimization, its use direction is relatively targeted, and it does not compress the variable-length Value itself in a single KV
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.
[0037] It will be understood by those skilled in the art that the singular forms "a", "an", "the" and "the" as used herein can include the plural forms as well, unless expressly stated otherwise. It should be further understood that the word "comprising" used in the description of the present invention refers to the presence of stated features, integers, steps, operations, elements and / or components, but does not exclude the...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the technical field of data storage, and provides a KV SSD data processing method and device. The method includes: when the KV SSD receives a data write request from a host, adopting a hardware compression engine to write data corresponding to the KV key value Perform compression processing on the Value value in, and the hardware compression engine is provided between the PCIe interface and the encryption / decryption engine of the KV SSD; write the KV key-value pair whose Value value has been compressed into the storage medium. The invention compresses the Value values with strong correlation in the data in the KV key-value pair, and stores the compressed KV key-value pair in the storage medium, so that the space consumption is smaller than the KV key-value pair before compression. The space consumption of the KV SSD significantly reduces the write amplification of the KV SSD, thereby increasing the durability of the KV SSD.
Description
technical field [0001] The invention relates to the technical field of data storage, and in particular, to a data processing method and device of a KV SSD. Background technique [0002] Key Value is often used for object storage, and currently it usually exists in the host-side system as a database storage system. In Key Value storage, the minimum access unit is a key (Key) value (Value) pair, and the length of each key-value pair varies. [0003] In May 2021, the NVMe International Standards Organization released a protocol update for NVMe version 2.0. In this new version of the protocol, two new command sets are added on the basis of the original NVM command set, namely the Zone Namespace command set and the KeyValue command set (KV command set for short). The NVMe protocol is usually widely used as an interface protocol for SSD firmware hard disks. The newly added KV command set in NVMe2.0 will realize that the storage hard disk directly supports the data interaction o...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F21/60
CPCG06F16/2272G06F21/602
Inventor 褚敏刘晓健
Owner 南京得瑞芯存科技有限公司