A local storage method and system based on redirection and log mixing

Abstract

The present invention proposes a local storage method and system based on redirection and log mixing. The method includes three scenarios: 1) initial write or data block unit alignment overwrite scenario, data is asynchronously written to a storage device data disk, and after writing is returned The metadata is encapsulated into an entry of the local log, and then the local log is written asynchronously by sharding. After the log is successfully placed on the disk, it is synchronized to the memory cache of the KV database, and then the response of the write operation is returned to the upper layer; 2) Non-data block unit alignment coverage In the writing scenario, first encapsulate the data and metadata into an entry of the local log, then write the local log in shards, and then write the memory cache after writing the local log, and then the write operation can return; 3) In the mixed scenario, write the data block first The unit-aligned part of the data, and then write the metadata and the data of the non-data block unit-aligned part to the local log, and then return the response of the write operation, and then write the non-data block unit-aligned overwrite part of the data to the storage device data disk.

Description

technical field [0001] The invention relates to the field of distributed storage, in particular to a local storage method and system based on redirection and log mixing. Background technique [0002] When distributed storage writes local transactions, the atomicity of local transactions needs to be guaranteed. The atomicity of local transactions means that a transaction is either completely executed or not executed, which means that all tasks of the transaction must be executed correctly. If there is a task If the execution fails, the entire transaction will be terminated, and the previous changes made to the transaction will not take effect. If the changes in the transaction are successfully executed, the entire transaction will be completed, and the changes made to the data by the transaction are permanent. , Overwriting is generally guaranteed by redirecting writing or writing pre-logs. Currently, there are two main approaches: [0003] (1) The approach of FileStore (a l...

AI Technical Summary

Problems solved by technology

[0006] In order to solve the technical problem in the prior art that in order to ensure the atomicity of local transactions, the performance of the storage system will be greatly affected, the present invention proposes a local storage method and system based on redirection and log mixing

Images