A Preprocessing Method of Power Data Based on Mathematical Statistics
A technology of power data and mathematical statistics, applied in data processing applications, calculations, instruments, etc., can solve the problems of data extraction and analysis work interference, the total amount of data cannot be ignored, and mixed in, so as to reduce interference, improve efficiency, reduce time wasting effect
Active Publication Date: 2021-09-21
SHANGHAI MUNICIPAL ELECTRIC POWER CO
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, due to factors such as signal interference, some polluted "dirty data" is inevitably mixed into the currently running collection system. Due to the huge amount of data collected in the power system, the total amount of these polluted data cannot be ignored, and it will affect the future. Data extraction and analysis work caused a lot of disruption
Traditional outlier detection methods mostly rely on the intuitive judgment of experienced staff
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0024] In order to enable those skilled in the art to better understand the technical solution of the present invention, its specific implementation will be described in detail below in conjunction with the accompanying drawings:
[0025] see Figure 1 to Figure 4 , the preferred embodiment of the present invention, a kind of electric power data preprocessing method based on mathematical statistics, comprises the following steps:
[0026] S1, the original data set input step, input the original data set containing the user power data;
[0027] S2, the step of extracting data, extracting the required table items and data fields from the original data set, processing them into required structured data, and generating a two-dimensional power consumption matrix;
[0028] S3, negative value and null value screening step, through mathematical logic to filter out negative values, null values and some unreasonable data table items in the data set;
[0029] S4, the abnormal large v...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a method for preprocessing electric power data based on mathematical statistics, which includes an original data set input step, a data extraction step, a negative value and null value screening step, an abnormally large value screening step, a preliminary data pre-classification step and a label Add steps. The power data preprocessing method based on mathematical statistics of the present invention combines the quartile detection and standard score detection methods in mathematical statistics, which can help power grid staff improve the efficiency of reviewing original abnormal data and optimize the original data set. data quality.
Description
technical field [0001] The invention relates to a method for preprocessing power data based on mathematical statistics, and belongs to the technical field of smart grids. Background technique [0002] Due to the large number of user groups, the differences in the collection environment of smart meters, and various uncontrollable factors such as equipment terminal failures and data transmission interference, in the actual operation process, the power data collected by the power grid collection system is very complicated. The abnormal data in the data set has negative value, missing value (None value), abnormal zero value, abnormal large value, wrong relationship data, redundant data and so on. In the existing data analysis and decision-making work, many models and conclusions are based on idealized data sets, and various abnormal data in the actual collected data sets will interfere with or even destructively mislead these follow-up work. [0003] With the comprehensive pro...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06Q10/06G06Q50/06
CPCG06Q10/06395G06Q50/06
Inventor 陈明曹袖毛迪林毛苇严童周清华唐啸宣庐峰熊博越徐伟侯昀黄增瑞
Owner SHANGHAI MUNICIPAL ELECTRIC POWER CO