Data cleaning method, device and server

A technology for data cleaning and measured data, which is applied in the fields of electronic digital data processing, digital data information retrieval, special data processing applications, etc. Guaranteed effectiveness and data volume

Active Publication Date: 2020-11-24
NORTH CHINA ELECTRIC POWER UNIV (BAODING)
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the identification of wind power anomaly data is mostly carried out for accumulated anomaly data, but there are few recognition algorithms for sparse anomaly data, which makes it difficult to process sparse anomaly data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cleaning method, device and server
  • Data cleaning method, device and server
  • Data cleaning method, device and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] An embodiment of the present invention provides a data cleaning method, which can be applied to a computing server to perform data cleaning on sparse data of a wind farm. Such as figure 1 Shown is a flow chart of a data cleaning method, the method comprising the following steps:

[0031] Step S102, obtaining measured data samples, wherein the measured data samples are measured operating data of wind speed and power of wind turbines in the wind farm;

[0032]Considering that the data cleaning method provided by the embodiment of the present invention is mainly for data cleaning of sparse data, the measured data samples obtained above are usually wind speed and power data without significant accumulation abnormal data.

[0033] Step S104, establishing a joint probability distribution of wind speed and power in Copula space;

[0034] Wherein, the value range of the above-mentioned joint probability distribution is [0, 1] interval;

[0035] In actual use, the above-menti...

Embodiment 2

[0058] On the basis of the above embodiments, the embodiment of the present invention also provides a data cleaning device, such as image 3 A schematic diagram of the structure of a data cleaning device shown, the device includes:

[0059] An acquisition module 30, configured to acquire measured data samples, wherein the measured data samples are measured operating data of wind speed and power of wind turbines in the wind farm;

[0060] Build module 32, be used for establishing the joint probability distribution of wind speed and power in Copula space, wherein, the value range of joint probability distribution is [0,1] interval;

[0061]A division module 34, configured to evenly divide the value range of the joint probability distribution into a plurality of probability intervals;

[0062] The cleaning module 36 is configured to perform data cleaning on the measured data samples in each probability interval along the dimensions of wind speed and power respectively.

[0063]...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data cleaning method and device and a server, and relates to the technical field of wind power plant data processing, and the method comprises the steps: obtaining an actual measurement data sample; establishing joint probability distribution of wind speed and power in the Copula space; uniformly dividing the value range of the joint probability distribution into a plurality of probability intervals; and performing data cleaning on the actually measured data sample in each probability interval along the dimensions of the wind speed and the power. According to the datacleaning method and device and the server provided by the invention, the actually measured sample data can be cleaned based on the probability space to obtain a finer data cleaning result, meanwhile,the effectiveness and the data size of the remaining data can be ensured, and a solid foundation is laid for subsequent data analysis.

Description

technical field [0001] The invention relates to the technical field of wind farm data processing, in particular to a data cleaning method, device and server. Background technique [0002] For the operation data of the SCADA (Supervisory Control And Data Acquisition, data acquisition and monitoring control system) system of the wind farm, abnormal data widely exists. From the perspective of the formation reasons and scale of abnormal data, it is mainly divided into accumulation abnormal data and sparse abnormal data. The former is usually caused by long-term abnormal operation, such as long-term power operation, sudden or slow-changing faults, and performance degradation. The latter is usually caused by environmental interference, measurement noise and operation control, such as transmission signal interference, fan mechanical vibration, fan controller switching, etc. In addition, the distortion of SCADA system data records will also form some abnormal data. Therefore, fro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/215G06K9/62
Inventor 胡阳奚芸华潘晨阳
Owner NORTH CHINA ELECTRIC POWER UNIV (BAODING)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products