Hybrid storage system and method for mass intelligent power utilization data

Abstract

The invention discloses a hybrid storage system and method for mass intelligent power utilization data. The hybrid storage system comprises a front communication server cluster, wherein the front communication server cluster receives an original data frame uploaded by a terminal and stores an original data film obtained after data analysis is carried out into a local disk; the front communication server cluster unloads the original data frame and the original data file to a MongoDB private cloud storage platform; a collection data unloading calculation platform reads the data of the MongoDB private cloud storage platform to process the data, and then the processed data is stored in a production library and an analysis library of the collection data unloading calculation platform; the production library stores service data, and the analysis library analyzes and processes the service data of the production library; and an analysis result is written back to the production library for query. The invention can cope with challenges brought for the storage capability of a front master station for collecting mass data, the collected data is stored in a local cache, the requirements of quick storage and uniform management of the mass data are met, and the storage pressure of a production database is lowered.

Description

technical field [0001] The invention relates to a hybrid storage system and method for mass intelligent electricity consumption data. Background technique [0002] As an important part of intelligent electricity consumption, the electricity consumption information collection system can realize the collection of electricity consumption data, and manage, analyze and make decisions based on the collected electricity consumption data. my country's energy-saving emission reduction and step-level electricity price policy are important starting points and are important contents of smart electricity construction. The State Grid Corporation further promotes the "two transformations", actively builds the "three collections and five majors" system, and puts forward the construction goal of "full coverage, full collection, and full control" of electricity consumption information collection during the "Twelfth Five-Year Plan" period, and realizes the goal of "full coverage, full collectio...

AI Technical Summary

Problems solved by technology

[0004] However, on the one hand, the electricity consumption information collection system has the characteristics of centralized collection task execution period and high concurrency, which leads to high pressure for data storage in some time periods, and I / O bottlenecks in the database, which make the statistical analysis of relevant data in the system possible. If it is not carried out in time, it seriously affects the query efficiency of relevant data;

[0005] On the other hand, source code data is the basic data of the electricity consumption information collection system, which plays a vital role in communication traffic statistics, communication log records, power calculation, fault analysis, etc. Long-term storage of source code data hinders the in-depth application of data

Images