Distributed storage system capacity information monitoring method, device and equipment

Abstract

The embodiment of the invention discloses a distributed storage system capacity information monitoring method, device and equipment and a computer readable storage medium. The method comprises the steps that whether pre-authorized quotas corresponding to a subdirectory are sufficient or not is judged according to capacity values of current to-be-stored data; if not, whether the number of threads executing write data exceeds one or not is judged; if yes, multiple write data threads are packaged to be an atomic operation by means of thread locks, so that the first target thread sends a request for applying for target authorized quotas to a metadata server; actual authorized quotas returned by the metadata server are received, and the pre-authorized quotas of the subdirectory are updated; to-be-stored data is written into the subdirectory, and a difference value of a current pre-authorized quota value of the subdirectory and a newly added data capacity value is calculated; a first final pre-authorized quota of the subdirectory is updated according to the difference value, and the first final authorized quota is sent to the metadata server. According to the technical scheme, the statistical accuracy of distributed storage system capacity information is improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of distributed storage, and in particular, relate to a capacity information monitoring method, device, device, and computer-readable storage medium of a distributed storage system. Background technique [0002] Distributed storage system stores data dispersedly on multiple independent devices. The traditional network storage system uses a centralized storage server to store all data. The storage server becomes the bottleneck of the system performance, and there are reliability and security risks at the same time, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses location servers to locate and store information, which can not only improve the reliability, availability and access efficiency of the system, but also facilitate expansion....

AI Technical Summary

Problems solved by technology

[0004] Although the self-simplification mechanism has the above advantages, with the increase of staff or departments, there will be more and more concurrent reads and writes to the storage. In the application scenario of multiple concurrent reads and writes, the existing self-reduction mechanism is difficult to achieve Real-time monitoring or overall allocation of information such as available capacity and used capacity of each subspace, resulting in deviations in the statistical capacity information after the distributed storage system has been running for a period of time, for example, the amount of written data exceeds the upper limit of the allocated space, or If the subspace is not full, it will prompt that there is no available space. In this case, the relevant staff needs to make manual adjustments, which will bring a lot of inconvenience and reduce the work efficiency of the entire distributed storage system.

Images