Similar distance discrimination-based single index data quality control method

A quality control method and index data technology, applied in the field of single index data quality control based on similarity distance discrimination, which can solve problems such as omission or misjudgment, and increase of human resources.

Active Publication Date: 2017-12-05
SUN YAT SEN UNIV +1
View PDF6 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method adds a lot of human resources, and manual review on the basis of massive data often leads to omissions or misjudgments.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Similar distance discrimination-based single index data quality control method
  • Similar distance discrimination-based single index data quality control method
  • Similar distance discrimination-based single index data quality control method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0034] according to figure 1 The flow chart shown is to perform quality control on the CO concentration at the Beijing Olympic Sports Center site in the first quarter of 2016. The main steps are as follows:

[0035] Step 1: According to the data shown in Table 1, the concentrations of PM2.5 and PM10 were first tested, and the final result found that there were some inversions. Table 1 shows the value of PM2.5 concentration minus PM10 concentration at the same time: it can be seen in 2016 On March 1, 20, 21, 22, and 23 o'clock, there was an upside-down phenomenon, which was shown in bold and underlined parts in Table 1, so it was judged as abnormal detection.

[0036] Steps 2 and 3: Import detection data from different sites in the same city by season in the time series format. In this example, the monitored object CO is used as an analysis case, as shown in Table 2.

[0037] Step 4: First calculate the distance matrix corresponding to the Olympic Sports Center, where NA mean...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a similar distance discrimination-based single index data quality control method. The above single index is an atmosphere environment single index. The method includes the following steps: S1, comparing the PM2.5 concentration with the PM10 concentration in each station, judging whether the concentrations are abnormal detection values or not, and carrying out next step calculation if not; S2, introducing detection data in a timed sequence; S3, screening normal values through the outlier degree P, and judging the remaining detection values as suspected abnormal values; S4, judging the suspected abnormal values screened in step S3 as normal monitoring values when the suspected abnormal values are in a 1 standard deviation range, and confirming the suspected abnormal values if the suspected abnormal values are not in the above range; S5, calculating the fluctuation degree q of the suspected abnormal values determined in S4, judging whether the suspected abnormal values are normal monitoring values or not, and confirming the suspected abnormal values if not; S6, calculating the volatility w of the detection data in each station at the suspected abnormal value confirmation time, and judging whether the detection data are abnormal or not through the w95% value; and S7, finally judging the values confirmed in step 1 and step 6 as abnormal values. The existence or not of the abnormal phenomenon of the data is judged from the data distance, the data fluctuation and the correlation among the stations. The method achieves the automatic auditing mechanism of the data, and effectively guarantees the data quality.

Description

technical field [0001] The invention relates to the technical field of quality control of monitored objects, in particular to a single-index data quality control method based on similarity distance discrimination. Background technique [0002] In view of the lack of automatic quality control means for atmospheric monitoring data, an algorithm is designed based on the data monitoring and compound adoption of the environmental monitoring station to realize the automatic intelligent quality control technology of atmospheric environmental monitoring data and solve the problem of lack of automatic quality control means for multi-source monitoring data To solve the problem, make the quality control of atmospheric monitoring equipment follow the same method system, and promote the development of remote automatic quality control technology for monitoring equipment. [0003] At this stage, due to the inconsistent data structure, type, and quality of various environmental observation ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G01N15/06G01D1/14
CPCG01D1/14G01N15/06
Inventor 徐伟嘉刘永红冯梦思黄建彰卢志想王家恒
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products