A data storage method and device
A data storage and data technology, applied in the field of communication, can solve problems such as reducing the performance of the storage system, and achieve the effect of reducing overhead and increasing the probability
Active Publication Date: 2018-06-19
HUAWEI TECH CO LTD +1
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
When performing large-grained input / output (IO, Input / Output) operations, it is necessary to split the large-grained IO into multiple small-grained IOs, which seriously reduces the performance of the storage system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0034] Embodiments of the present invention provide a data storage method and device, which are used to reduce the overhead of garbage collection and increase the probability of forming a large block of free space in the storage space.
[0035] The data storage method provided in the embodiment of the present invention is described by taking the implementation of the two storage technologies of copy-on-write and log structure as examples. -layout) as an example.
[0036] see figure 1 , an embodiment of the data storage method in the embodiment of the present invention includes:
[0037] 101. According to the update frequency of the data, the data is divided into types;
[0038] In the storage system, the update frequency of different data will be different due to the number of read and write operations and the content. According to the update frequency of the data, the data is classified, and the data with the same or similar update frequency is divided into the same type. ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A data storage method and apparatus. Data is divided into different types according to the update frequency of the data; a storage space is divided into multiple types of clusters, and multiple types of clusters are divided in such a manner that the types of the clusters are at least identical in quantity to the types of the data; the same type of data is stored in the same type of clusters according to a preset storage correspondence relationship; in each cluster, the original data is turned into junk data every time the data is updated; in the clusters with a high data update frequency, there is a higher possibility of generating a large block of junk data within a short period of time and the proportion of relatively effective data is small, therefore, when the junk data is recycled by the system, a small amount of effective data is read and written, and thus there is a higher possibility of forming large blocks of free space in the storage space, thus the overhead of junk recycling can be reduced, and also, the possibility of forming large blocks of free space can be increased.
Description
technical field [0001] The invention relates to the field of communication technology, in particular to a data storage method and device. Background technique [0002] There are two technologies in the space management method of the storage system. One is the copy-on-write (COW, copy-on-write) technology. When a visitor wants to modify data, it needs to copy the data and operate on the copied data, which is transparent to other visitors. The other is log-structured. The basic idea is to use the storage space as a log (log), and write data to the storage space in the form of appending. Log-structured aggregates small-grained writes into large-grained writes and sequentially writes them into the storage space. [0003] In the prior art, in a storage system using the COW technology, when updating data, the entire path from the root directory to the file requiring updated data is copied and relocated. In a storage system using log-structured technology, when updating file dat...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/1727
Inventor 张子刚熊劲刘扬宽岳银亮
Owner HUAWEI TECH CO LTD