Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and system for storing and analyzing massive wave recording data based on hadoop

A technology of wave recording data and analysis method, which is applied in the field of massive wave recording data storage and analysis, can solve the problems of data storage, analysis, and analysis difficulties, and achieves the effect of easy calculation steps and improved analysis and query speed.

Active Publication Date: 2020-06-23
SHANGHAI MUNICIPAL ELECTRIC POWER CO
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the face of these wave recording data with a large amount of data and high reliability and real-time requirements, conventional data storage, analysis, and analysis will encounter great difficulties

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for storing and analyzing massive wave recording data based on hadoop
  • A method and system for storing and analyzing massive wave recording data based on hadoop
  • A method and system for storing and analyzing massive wave recording data based on hadoop

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to enable those skilled in the art to better understand the technical solution of the present invention, its specific implementation will be described in detail below in conjunction with the accompanying drawings:

[0036] The present invention is further described by taking the fault recording data of 5 substations A, B, C, D, and E obtained by simulation as an example. The implementation of the present invention needs to configure the Hadoop cloud computing platform first, and arrange it by a Lenovo workstation, which configures 8-core Intel i7 CPU and 8G internal memory. Since the Hadoop fully distributed computing platform requires at least 3 nodes, use VMware Workstation 11.0 to virtualize 3 virtual machines on the workstation, each virtual machine occupies 2 cores, 2G memory, and installs the Ubuntu 14.0 system, and then installs Hadoop and HBase makes it work. The three nodes are just an example, and are not used to limit the scope of application of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a Hadoop-based massive recording data storage and analysis method. The method comprises a preprocessing step, a fault recorder data decompression step, a configuration file analysis and storage step and a data file analysis and storage step. The problems about storage, rapid analysis and query of massive fault recorder data can be solved; all calculation steps are easy to implement; the speed of analysis and query is significantly increased; and technical support is provided for further carrying out fault analysis by using massive fault recorder data. The present invention further discloses a Hadoop-based massive recording data storage and analysis system. The system comprises a preprocessing module, a data decompression module, a recording data analysis module, a data output module, a node allocation scheduling module and a data storage and query module.

Description

technical field [0001] The invention relates to a method and system for storing and analyzing massive wave recording data based on Hadoop, belonging to the field of power system fault diagnosis. Background technique [0002] The fault recording system has become an essential part of the smart grid. The fault recording device monitors the operation status of the power grid, and the recorded data can provide transient data under fault conditions, which provides the main basis for power system fault analysis and analysis and evaluation of various protection actions. The fault recording devices produced by different manufacturers under the current standard all provide the recording data generation interface in the COMTRADE format for storage and transmission, so the present invention mainly analyzes the fault recording data in the COMTRADE format. COMTRADE format files mainly include header files (*.HDR), configuration files (*.CFG), data files (*.DAT), and information files (*...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/25
CPCG06F16/2282G06F16/25
Inventor 卢圣财戴人杰廖旻沈良金明雨吴旭鹏王俊豪周平陈俊
Owner SHANGHAI MUNICIPAL ELECTRIC POWER CO