The invention relates to a
pollutant detection method and
system based on
machine learning, and relates to the technical field of
pollutant detection.The method comprises the steps that original
spectral data are collected and denoised through a Savitz-golay
smoothing filter, parameters are dynamically adjusted, and stable
spectral data with
pollutant core characteristics reserved are obtained; the method can effectively solve the technical problem that low-concentration interval heterovariance
noise masks weak features of left censored data, and avoids the defect of excessive smoothness or insufficient denoising of a traditional denoising method. Secondly, in combination with a blank spectrum
noise optimization
detection limit and a quantification limit, effective features are extracted by utilizing
machine learning, and incomplete observation characteristics of left-censored data can be adapted, so that the problem of systematic bias caused by data distribution
hypothesis distortion of an existing
algorithm is solved, and the defect that a low-concentration risk early warning window is neglected in a traditional method is overcome; finally, filter parameters are analyzed and optimized through a
loss function, a detection result is finally output, and
detection limit heterogeneity caused by instrument drifting and working condition fluctuation can be dealt with.