Unlock instant, AI-driven research and patent intelligence for your innovation.

Data cleaning method and system

A data cleaning and noise data technology, applied in the field of data processing, can solve the problem that the data cannot reflect the real situation of the monitoring point, and achieve the effect of high accuracy, convenient processing, and smooth sensing data curve

Inactive Publication Date: 2018-11-16
广东华智数据科技有限公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Aiming at the problem that the mutation data existing in the prior art cannot reflect the real situation of the monitoring point, the present invention provides a data cleaning method and system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cleaning method and system
  • Data cleaning method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0020] see figure 1 , one A data cleaning method, including:

[0021] S11, identifying the sensing data to obtain noise data; step S11 includes: identifying a sudden change in the value of the sensing data at a certain moment, and the value after the mutation is noise data; the sudden change includes a value relative to a certain moment The va...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data cleaning method and system. The data cleaning method comprises the steps that sensing data is identified to obtain noise data; an average value of current noise data before a preset time interval is calculated; the average value is adopted to replace a current noise value of the noise data. According to the data cleaning method, the sensing data is identified to obtain the noise data; the average value of the current noise data before the preset time interval is calculated; the average value is adopted to replace the current noise value of the noise data; therefore, the noise data generated due to surrounding environment change or human causes in the sensing data can be cleaned away, a sensing data curve can become smooth, and processing of sequential sensing data is facilitated; besides, the average value before the preset time interval is adopted to replace the current noise value in the noise data, and the data cleaning method and system are simple and convenient to use, and the accuracy is high.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data cleaning method and system. Background technique [0002] In the environmental quality monitoring system, the sensing data is obtained from the sensor, and the sensor is a highly sensitive device. During the operation, it is easy to change the value of the sensor at a certain moment due to changes in the surrounding environment or human factors (abnormal High or abnormally low, etc.), the data of these mutations cannot reflect the real situation of the monitoring point, so such data cannot be directly used for business analysis. In the field of big data mining, this kind of data is called noise data. Therefore, in order to obtain more accurate analysis results, the industry needs a method for identifying and cleaning noise data before analysis. Contents of the invention [0003] Aiming at the problem that the mutational data in the prior art cannot reflect the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 韩站伟杨智强
Owner 广东华智数据科技有限公司