Distributed storage and parallel mining method for state monitoring data

Abstract

A distributed storage and parallel mining method for state monitoring data includes the steps: defining function service models of a remote substation state monitoring unit and a state monitoring communication front-end processor by means of Web service description language, and exchanging the state monitoring data of electric power equipment in an electric power wide area network environment by a simple object access protocol; storing large-scale state monitoring data redundancy in a distributed file system, creating an index table for a state monitoring data file, inserting the index table into a large-scale structural data table and querying the state monitoring data according to a query request; and generating basic data and multi-dimensional analytical data by extracting, converting and loading to built a data warehouse, and parallelly executing association rules, classification and clustered data mining algorithm by means of MapReduce task decomposition and result summary. The distributed storage and parallel mining method can be used for effectively realizing distributed data exchange, redundant storage and rapid parallel processing for state monitoring information of the mass electric power equipment in an intelligent power network environment.

Description

technical field [0001] The invention relates to a method for distributed storage and parallel mining of massive state monitoring data of a smart grid, belonging to the technical field of data processing. Background technique [0002] With the large-scale access of large-scale fluctuating energy generation and high-penetration distributed power generation, and the increasingly complex load characteristics, the scale of the power grid is becoming larger and larger, and the pressure on the safe and stable operation of the power grid is also increasing. From the development strategy and construction progress of smart grid, it can be seen that although the functional characteristics, key technologies and construction priorities of smart grids in different countries are not the same, the realization of grid informatization, that is, the comprehensive integration of grid steady-state, dynamic and transient operation information, Building an analysis and computing platform based on ...

AI Technical Summary

Problems solved by technology

Grid computing was once considered to be an effective technology for improving power system analysis and computing capabilities. However, grid computing mainly focuses on the aggregation and distribution of loosely coupled resources, emphasizing resource sharing, and is suitable for computing-intensive applications. It is difficult to automatically expand. Most grids are constructed to complete a specific task or support challenging applications. They are usually used to solve computationally sensitive scientific research, mathematics, and academic problems. The support for enterprise applications is insufficient, which limits its application in power grid enterprises. large scale application

Images