Water environment monitoring and quality-control data analysis method

A data analysis and environmental monitoring technology, applied in the field of data analysis, can solve the problem that monitoring quality control data is difficult to meet the requirements of scientific management

Active Publication Date: 2013-04-03
JIANGSU ENVIRONMENTAL MONITORING CENT
View PDF1 Cites 62 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It is difficult to meet the requirements of scientific management if the traditional manual processing and auditing m...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Water environment monitoring and quality-control data analysis method
  • Water environment monitoring and quality-control data analysis method
  • Water environment monitoring and quality-control data analysis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] a. Obtain the water environment quality control data to be audited, and use conventional and traditional methods to process the data. Conventional methods refer to the data logic judgment method and Dixon test method, remove obviously unreasonable abnormal data, and use unsupervised learning algorithms to identify hidden contains outlier data;

[0110] b. Establish a water environment quality control data analysis model using supervised learning algorithms, and identify the reliability of monitoring data;

[0111] c. Compare the output of quality control data with the quality control data in the historical data of the same analytical method and instrument type to obtain the deviation;

[0112] d. To determine whether the data is approved or not, the specific determination steps are: if the deviation is not large, the data is reasonable, pass the review, and add it to the historical data set; otherwise, the deviation is too large, the data will be listed as suspicious da...

Embodiment 2

[0114] k-means clustering

[0115] K-means clustering (k-means) algorithm takes k as a parameter and divides n objects into k classes, so that the elements within a class have a high similarity, while the similarity between classes is low. The calculation of similarity is based on the average value of objects in a class (which is regarded as the center of gravity of the class).

[0116] The k-means clustering algorithm iterates as follows:

[0117] (a) Randomly select k objects, each initially representing the mean or center of a class:

[0118] (b) For each remaining object, assign it to the nearest class according to its distance from the center of each class.

[0119] For the regrouped k class, judge whether the criterion function converges: if it converges, the algorithm terminates;

[0120] Otherwise, go to (c);

[0121] (c) Recalculate the center of each class, go to (b).

[0122] Usually, we adopt the squared error criterion, which is defined as follows:

[0123] ...

Embodiment 3

[0127] particle swarm optimization

[0128] Particle Swarm Optimization (PSO) simulates the group behavior of birds in nature, applies the idea of ​​information sharing in biological populations to the algorithm process, and guides population evolution with individual cognition and social experience. As a new intelligent optimization algorithm, particle swarm optimization has the characteristics of both evolutionary algorithm and swarm intelligence algorithm, and has been widely used to solve various nonlinear, non-differentiable and multi-peak complex optimization problems. Compared with genetic algorithm, particle swarm optimization is not easy to produce premature convergence, and has the advantages of simple structure, less control parameters, and faster operation speed.

[0129] The particle swarm optimization algorithm is initialized as a group of random particles (random solutions), each particle represents a candidate solution in the solution space (d dimension), and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of data analysis, and in particular relates to a water environment monitoring and quality-control data analysis method. The method is characterized by comprising the following steps of: a, acquiring water environment quality-control data to be verified; b, establishing a support vector machine water environment quality-control data forecasting module; c, comparing the quality-control data output with quality-control data in historical data which is identical in analysis method and instrument type, to obtain a deviation; and d, determining whether the verification of the data passes or not by the following specific steps of: judging that the data is rational and the verification passes if the deviation is not high, and adding into a historical dataset; or if the deviation is excessively high, classifying the data as suspect data. According to analysis research method disclosed by the invention, in analysis of the water environment monitoring and quality-control data, the problem on processing, verification and analysis of various rapid increasing and nonlinear multivariable monitoring and quality-control data is solved, and the demand of scientific management is met.

Description

technical field [0001] The invention belongs to the field of data analysis, and in particular relates to a water environment monitoring quality control analysis method. Background technique [0002] In the process of monitoring organic pollutants in the water environment of the basin, data acquisition includes multiple technologies such as point layout, sampling, on-site testing, sample transportation, sample handover, sample preparation, laboratory analysis and testing, data processing, data review, comprehensive analysis and evaluation, etc. links. Due to the limitations of analysis methods, the technical level of monitoring analysts and various interference factors, monitoring data distortion and abnormal phenomena occur from time to time. In order to make the monitoring data accurately reflect the current situation of the water environment quality in the basin, quality control must be implemented for the entire environmental monitoring process, and at the same time, a c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/02
Inventor 赵永刚汪晓东穆肃胡冠九张蓓蓓章勇
Owner JIANGSU ENVIRONMENTAL MONITORING CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products