Metadata management method of distributed file system in power grid dispatching control system

Abstract

The invention discloses a metadata management method of a distributed file system in a power grid dispatching control system. The method comprises steps of dividing system metadata of the distributedfile system into multiple types of data such as basic attributes and file names; and managing all files and subdirectories under a directory by adopting a linked list, keeping a hierarchical relationship of a file system, and establishing a mapping relationship between file names and basic attributes of the files, so that basic attribute data of the files can be quickly positioned through completepaths of the file names. And when the file is accessed, the searching process can be completed under the O (1) complexity, so that the file metadata access performance is improved. Therefore, the distributed file access performance in the power grid dispatching control system can be improved, the data access time consumption and excessive occupation of the metadata on the memory are reduced, thereal-time requirement of file access of the power grid dispatching control system is met, and the distributed file access method and system can well adapt to the use environment with limited memory resources.

Description

technical field [0001] The invention relates to the technical field of data processing in a power grid dispatching control system, in particular to a metadata flat management method of a distributed file system in a power grid dispatching control system. Background technique [0002] Distributed file system is to connect scattered storage nodes to form a shared file system that far exceeds the capacity of a single storage node. It allows file data and storage space stored on multiple nodes to be shared through the network, greatly improving storage capacity and file access throughput. volume, and has high reliability and elastic expansion capabilities. [0003] The distributed file system is used in the power grid dispatching control automation system to store graphics files, grid section files, report files, and operation mode data. The distributed file system mainly includes two parts: metadata management and file data management. The metadata management part mainly manag...

AI Technical Summary

Problems solved by technology

[0005] The power grid dispatching control system has very high requirements for real-time performance and stability of the system, but the existing open source distributed file system HDFS puts all the metadata of the entire file system in the memory, which obviously does not consider the application scenarios of the power grid dispatching control system , there are mainly two shortcomings: one is that it takes a long time to search for files level by level, especially when the level of the file is deep and the number of files is large, the metadata search will take a lot of time, reduce the concurrency of the system, and increase the number of files. Access delay time; second, all metadata are stored in memory. When the number of system files is large, it will occupy a lot of memory resources and affect the operation of other functional modules in the system.

Images