HBase-based intelligent power grid acquisition and monitoring data storage system and storage method

Abstract

The invention provides an HBase-based intelligent power grid collection monitoring data storage system and storage method, and the system is provided with a plurality of storage units, and the data format of data stored in each storage unit comprises a table name, a row key, a column family, a column name, and a collection detection point sampling value; wherein the row key is composed of an equipment code and acquired monitoring point type data; wherein the single-column family is composed of single characters ' I '; wherein the column name is composed of day-hour-minute-second data. Partialinformation of the row key and the column family is transferred and stored, the length of the row key and the column family is shortened, unnecessary information is simplified, redundancy is reduced,the space utilization rate is increased, and the loading and access performance of collected monitoring data is improved. And meanwhile, the distribution of RowKey is reasonably and fully considered,and a pre-partitioning mode is adopted, so that the loading performance of the acquired monitoring data is improved.

Description

technical field [0001] The application relates to the field of database technology, in particular to a storage system and a storage method for collecting and monitoring data of a smart grid. Background technique [0002] Smart grid collection and monitoring data is very important data in power grid applications. As an important part of the four major data types of smart grid, it is an important basis for smart grid power consumption information collection, equipment status monitoring, auxiliary decision analysis, and offline mining analysis. At present, the main characteristics of smart grid collection and monitoring data storage: (1) The collection and monitoring data volume is large, and the storage cycle span is long; (2) The data format is fixed; (3) The data loading throughput is high; (4) The access mode is section-based Query and batch query are the main ones; (5) The scale of historical data continues to increase, the richness and interactivity of applications contin...

AI Technical Summary

Problems solved by technology

[0006] The above-mentioned existing HBase-based smart grid collection and monitoring data storage model has redundant information storage, stores a lot of unnecessary information, and does not perform reasonable pre-partitioning, and the space utilization rate and resource utilization rate are low. The performance of data loading and access cannot adapt to the situation where the data scale of the system continues to increase and the richness and interactivity of applications continue to increase. The performance of data loading and access cannot meet the actual needs of the business

Images