Compact processing speed adjusting method and device, electronic equipment and medium

Abstract

The invention provides a compact processing speed adjusting method and device, electronic equipment and a medium, the method is applied to the electronic equipment of a management database, and the method comprises the following steps: recording the starting time of a current compact operation when the current combined compact operation is started to be executed, and obtaining the execution condition of a previous compact operation; determining the file size of a file generated by the current user service on the current layer of the database; and adjusting the compact processing speed based onthe start time, the execution condition of the previous compact operation and the file size of the file generated by the current layer, the adjustment of the compact processing speed being realized by adjusting the size of the single read / write data of disk IO. Therefore, the compact processing speed can be adaptively adjusted to ensure normal reading and writing of the disk and avoid influence on user services.

Description

technical field [0001] The present application relates to the field of storage technology, and in particular to a method, device, electronic device and medium for adjusting a compact processing speed. Background technique [0002] The K-V database provides data storage services for K-V format entry entries, and supports operations such as insertion, query, modification, and deletion of the K-V database. When K-V data is archived and stored permanently, the data will be organized in an orderly manner and written to disk in the form of files. With the continuous writing of new data, the file size continues to increase, resulting in significantly longer processing time for data to be solidified to the disk in an orderly manner, which has a greater impact on performance; based on this, a type of K-V database (such as leveldb, rocksdb) proposes Hierarchical organization of disk files is used to control the size of archive files. Each layer sets a threshold of data size that can ...

AI Technical Summary

Problems solved by technology

Since the file size of each layer has a maximum limit, if the efficiency of the compact operation is too low and the file size grows too fast, it will cause the file size to reach the maximum threshold and cannot continue to write, resulting in blocking, which will result in the inability to accept any write access

[0004] The current processing flow of the compact operation is to use a fixed compact processing speed (fixed disk IO size) to read and write files, resulting in a compact processing speed that cannot adapt to various user business scenarios, resulting in affecting customer business perception or affecting the normality of user business deal with

Images