Method and system for cleaning mass data of energy storage power station

An energy storage power station and mass data technology, which is applied in the direction of electrical digital data processing, data processing applications, special data processing applications, etc., can solve problems such as the inability to deal with massive data parallel processing, the small number of mathematical statistical analysis, and the complex causes of abnormal data, etc. , to achieve the effect of ensuring high-efficiency parallel processing of data and scalability, increasing processing nodes, and improving preprocessing and utilization effects

Active Publication Date: 2015-07-01
CHINA ELECTRIC POWER RES INST +4
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(2) The reasons for abnormal data are complex: due to the large number of monitoring equipment, which are affected by various objective and unpredictable factors such as accuracy and network signals, there are abnormal data in the data
[0005] 1. The range of single-batch processing is limited, resulting in a small number of mathematical statistical analysis each time and low cleaning accuracy;
[0006] 2. It cannot cope with the parallel processing of massive data, and single-line cleaning takes a long time, is slow, and is not efficient
[0007] 3. There are many types of data, and various situations need to be considered in a single batch, and the processing is more complicated, which increases the difficulty of calculation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for cleaning mass data of energy storage power station
  • Method and system for cleaning mass data of energy storage power station
  • Method and system for cleaning mass data of energy storage power station

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The specific embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0046] Such as figure 1 as shown, figure 1 A flow chart of a method for cleaning massive battery data of an energy storage power station provided by the present invention; the method includes the following steps:

[0047] I. Locate and replace the default value in the energy storage power station dataset;

[0048] II. Locating and replacing outliers in said data set;

[0049] III. According to the characteristics of different categories of the energy storage battery data, determine unreasonable data in the data set obtained after replacement, and replace them.

[0050] Step I, use statistical processing method to locate the default value; use K-nearest neighbor algorithm to determine the normal value next to the default value, and replace the default value with the normal value. Implement data cleansing.

[0051] S101. The raw...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for cleaning mass data of an energy storage power station and a system for cleaning mass data of the energy storage power station. The method for cleaning mass data of the energy storage power station comprises the following steps: I, positioning and replacing default value of data concentration of the energy storage power station; II, positioning and replacing abnormal value of data concentration; III, determining unreasonable data from the data concentration obtained after replacing according to different types and characteristics of the energy storage battery data, and replacing it. The method and the system can clean the mass battery data, guarantee the mass data distribution processing requirement, realize the mass battery data optimization cleaning and pretreatment purposes of the energy storage power station after comprehensively considering about K neighbor algorithm, Pauta criterion method, distributed processing, and others; besides, the pretreatment and using effects of the mass data of the large-capacity battery energy storage power station are improved.

Description

technical field [0001] The present invention relates to a method and system in the technical field of energy storage, in particular to a method and system for cleaning massive data of an energy storage power station. Background technique [0002] At present, the data collection, storage and management methods of energy storage power stations are not yet standardized, and further research on massive data management and mining technologies for energy storage power stations is needed. The massive data of the energy storage power station mainly has the following characteristics: (1) Large amount of data: due to the large number of batteries in the energy storage power station, each battery has a lot of monitoring equipment, and the amount of data collected per second is huge, so it is required to be able to clean it correctly and quickly These data. (2) The reasons for abnormal data are complicated: due to the large number of monitoring equipment, which are affected by various ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06Q50/06
CPCG06Q50/06G06F16/00Y02D10/00
Inventor 李相俊郑昊姚继锋惠东王向前徐琛王立业董文琦岳巍澎郭光朝贾学翠张亮汪奂伶郑高
Owner CHINA ELECTRIC POWER RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products