Secondary equipment big data storage and processing method by utilizing cloud computing technology

A technology of big data storage and secondary equipment, applied in the research field of computer technology and electric power specialty, can solve the problem of query efficiency, time-consuming tens of minutes or even hours, and performance deterioration.

Inactive Publication Date: 2016-02-24
CHINA SOUTHERN POWER GRID COMPANY
View PDF4 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For data that is relatively long from the current time, it is often backed up as a file and stored offline, which has a great impact on the availability of historical data
[0006] 3) Query efficiency issues under large-scale data
In the experiment, it is found that in the query of large-scale data, the performance of relational database will deteriorate with the increase of data size
Thousands of measuring points will generate tens of millions of records in a day's operation. If you record all the data of several months and years in the database and execute conditional query, the query will take tens of minutes or even hours. This kind of query performance Unacceptable in advanced application scenarios especially related to ad hoc queries
[0007] At present, there is no information storage and processing system for power systems covering various professional secondary equipment in China. It is urgent to establish a scalable, large-capacity, high-performance comprehensive information storage and processing system for the massive historical monitoring data of secondary equipment. platform

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Secondary equipment big data storage and processing method by utilizing cloud computing technology
  • Secondary equipment big data storage and processing method by utilizing cloud computing technology
  • Secondary equipment big data storage and processing method by utilizing cloud computing technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention provides a secondary equipment large data storage and processing method based on cloud computing technology, which mainly includes two parts: constructing a storage mode of secondary equipment historical monitoring data, and related query based on a parallel processing framework;

[0031] (1) Storage mode design of secondary equipment historical data

[0032] The data objects stored and processed by the power system for secondary equipment are long-period, large-capacity historical time series data. The time series data mainly includes the data information processed by the SCADA integrated automation system in major substations, and the operating status information of various secondary equipment in the system. This part needs to be stored in the historical data platform in real time, and occupies a large proportion in the form of a long period.

[0033] The non-relational database (HBase) is used to store monitoring data, and its essence is to sto...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention is to provide a mass historical data storage and processing method for carrying out centralized storage, unified management and parallel computing on mass process monitoring data generated by secondary equipment of an electric power system protection device, a fault filter, an automatic safety device, an integrated automation system and an operational power supply system and the like by utilizing the cloud computing technology. A unified storage standard is formed for the data of process inspection data, equipment defect data, equipment state log and patrol inspection data and the like by utilizing the cloud computing technology; and condition query and parallel processing under the large-scale data are realized by adopting a distributed computation frame. The method realizes storage of whole database-oriented long-period and structured secondary equipment historical data, meets the requirements of an electric system for the aspects of storage capacity, data writing speed, query efficiency and system expansibility, and provides powerful support for analysis and excavation of the mass historical data of the secondary equipment.

Description

technical field [0001] The invention relates to the interdisciplinary research field of computer technology and electric power, and specifically proposes a storage and processing method for secondary equipment historical monitoring big data for electric power systems. Background technique [0002] With the development of microcomputer and communication technology, traditional metering equipment has gradually faded out of the power system. At present, most power companies still adopt a professional division of labor system for the management of secondary equipment, such as protection devices, fault filters, safety automatic The device is managed by the protection team, the comprehensive automatic system is managed by the telecontrol team, and the operating power system is managed by the DC team. The management of equipment data and information cannot be shared, which makes the operation and maintenance personnel only familiar with their own professional aspects, but they know...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/1097
Inventor 李金陶文伟张喜铭许丹莉梁寿愚赵化时赵旋宇
Owner CHINA SOUTHERN POWER GRID COMPANY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products