A method and system for cleaning mass data of an energy storage power station

An energy storage power station, massive data technology, applied in the field of energy storage, can solve the problems of inability to deal with massive data parallel processing, a small number of mathematical statistical analysis, complex reasons for abnormal data, etc., to ensure high-efficiency parallel processing of data and scalability. , Add processing nodes, improve the effect of preprocessing and utilization

Active Publication Date: 2019-05-21
CHINA ELECTRIC POWER RES INST +4
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

(2) The reasons for abnormal data are complex: due to the large number of monitoring equipment, which are affected by various objective and unpredictable factors such as accuracy and network signals, there are abnormal data in the data
[0005] 1. The range of single-batch processing is limited, resulting in a small number of mathematical statistical analysis each time and low cleaning accuracy;
[0006] 2. It cannot cope with the parallel processing of massive data, and single-line cleaning takes a long time, is slow, and is not efficient
[0007] 3. There are many types of data, and various situations need to be considered in a single batch, and the processing is more complicated, which increases the difficulty of calculation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for cleaning mass data of an energy storage power station
  • A method and system for cleaning mass data of an energy storage power station
  • A method and system for cleaning mass data of an energy storage power station

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The specific embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0046] Such as figure 1 as shown, figure 1 A flow chart of a method for cleaning massive battery data of an energy storage power station provided by the present invention; the method includes the following steps:

[0047] I. Locate and replace the default value in the energy storage power station dataset;

[0048] II. Locating and replacing outliers in said data set;

[0049] III. According to the characteristics of different categories of the energy storage battery data, determine unreasonable data in the data set obtained after replacement, and replace them.

[0050] Step I, use statistical processing method to locate the default value; use K nearest neighbor algorithm to determine the normal value near the default value, and replace the default value with the normal value. Implement data cleansing.

[0051] S101. The raw da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method and system for cleaning mass data of an energy storage power station, the method comprising the following steps: I, locating and replacing the default value in the data set of the energy storage power station; II, locating and replacing the abnormal value in the data set; III. According to the characteristics of different categories of the energy storage battery data, determine unreasonable data in the data set obtained after replacement, and replace them. The method and system of the present invention can not only realize the cleaning of massive battery data, but also ensure the distributed processing requirements of massive data, and realize the optimal cleaning of massive battery data of energy storage power stations with comprehensive consideration of K-nearest neighbor algorithm, Raida criterion method, distributed processing, etc. The purpose of preprocessing is to improve the effect of preprocessing and utilization of massive data of large-capacity battery energy storage power stations.

Description

technical field [0001] The present invention relates to a method and system in the technical field of energy storage, in particular to a method and system for cleaning massive data of an energy storage power station. Background technique [0002] At present, the data collection, storage and management methods of energy storage power stations are not yet standardized, and further research on massive data management and mining technologies for energy storage power stations is needed. The massive data of the energy storage power station mainly has the following characteristics: (1) Large amount of data: due to the large number of batteries in the energy storage power station, each battery has a lot of monitoring equipment, and the amount of data collected per second is huge, so it is required to be able to clean it correctly and quickly These data. (2) The reasons for abnormal data are complicated: due to the large number of monitoring equipment, which are affected by various ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21G06Q50/06
CPCG06Q50/06G06F16/00Y02D10/00
Inventor 李相俊郑昊姚继锋惠东王向前徐琛王立业董文琦岳巍澎郭光朝贾学翠张亮汪奂伶郑高
Owner CHINA ELECTRIC POWER RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products