Data cleaning and repairing method

A technology of data cleaning and repairing method, which is applied in the direction of electronic digital data processing, structured data retrieval, database management system, etc., and can solve problems such as inaccurate results of auxiliary decision-making advanced applications, different time scales, measurement residual pollution, etc. To achieve the effect of ensuring high concurrency, preventing data leakage, and ensuring rapidity
CN109783552APending Publication Date: 2019-05-21CHINA ELECTRIC POWER RES INST +2
0 Cites 14 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
CHINA ELECTRIC POWER RES INST
Publication Date
2019-05-21

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to a data cleaning and repairing method, which comprises the following steps of: for data errors generated in acquisition and data transmission generated by power distribution network terminal equipment, setting an access module to carry out data cleaning and repairing; For data errors generated by information equipment in the power distribution network information system, setting a conversion module for data cleaning and repairing; For data interaction among a plurality of business information systems of the power distribution network, data badness generated in data processing, setting a rule base cleaning module; For cleaning of historical data stored in a warehouse, setting an offline module for data cleaning and repairing, and carrying out logic checking on the whole historical data. According to the method, data errors and bad data conditions can be efficiently judged, data missed judgment and wrong judgment are prevented, the repair efficiency is ensured, and the upper-layer business application data requirement is met.
Need to check novelty before this filing date? Find Prior Art

Description

【Technical field】

[0001] The invention belongs to the technical field of distributed data processing, and in particular relates to a data cleaning and repairing method. 【Background technique】

[0002] The quality of data is related to the stable operation of the distribution network. If there is no certain data quality improvement method for massive low-value density data, even the most accurate processing logic and the most efficient parallel strategy will not obtain correct results. At present, many data preprocessing and cleaning systems in the field of information science have been introduced into the field of distribution network big data research, but these systems can only be applied to large-scale data with simple Internet logic or regular application scenarios such as image audio and video. It cannot handle the high-speed real-time data of the whole process generated by the continuous and highly automated production process of the power system and the high-dimension...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More