Data storage method and system, electronic equipment and storage medium

Abstract

The invention discloses a data storage method and system, electronic equipment and a computer readable storage medium. The method comprises the steps of acquiring parameter values used for representing the stored data volume of a current storage system; determining the size of a target fragment positively related to the parameter value; determining the number of target fragments based on the sizeof the to-be-written data and the size of the target fragments; and creating a target fragment in the target disk according to the target fragment size and the target fragment number, and storing theto-be-written data by using the target fragment. The size of the target fragment positively related to the current storage system is determined based on the parameter value representing the stored data size of the current storage system, it is guaranteed that when the stored data size is large, the large fragment size is determined, the fragment number is relatively reduced, the expenditure of metadata operation is effectively reduced, and the performance of the system is improved; and when the stored data volume is small, the relatively small fragment size is determined, so that the large data management granularity caused by the large fragment is avoided, and the flexibility of the system and data management is improved.

Description

technical field [0001] The present application relates to the field of storage technologies, and more specifically, to a data storage method and system, an electronic device, and a computer-readable storage medium. Background technique [0002] Fragmentation refers to fixed-size data blocks obtained by dividing a file with a fixed size. How many fragments a file consists of depends on two aspects, one is the size of the file itself, and the other is the split size of the file, that is, the size of the fragments. [0003] In the prior art solution, a file is divided with a fixed size, so when the data volume of the file is larger, the number of fragments increases, and the number of corresponding files in the system also increases accordingly. For a distributed storage system, too many files will increase the overhead of metadata operations, resulting in a decline in system performance; and if the size of the fragments is increased in order to reduce the number of fragments,...

AI Technical Summary

Problems solved by technology

For a distributed storage system, too many files will increase the overhead of metadata operations, resulting in a decline in system performance; and if the size of the fragments is increased in order to reduce the number of fragments, it will make the data management The granularity increases, reducing the flexibility of the system

Images