A real-time wavelet threshold denoising method for processing SCADA system data
By using the wavelet threshold denoising method of sliding window and the adaptive threshold function to process the wavelet coefficients in the SCADA system, the data noise interference problem is solved, and the accuracy and real-timeness of the pipeline online simulation are improved.
Patent Information
- Application Number
- CN202111621664.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-28
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2041-12-28
AI Technical Summary
The prior art is difficult to effectively handle noise interference in data collected by SCADA systems, resulting in reduced accuracy of pipeline online simulation.
The wavelet threshold denoising method based on OLMS is used to realize real-time processing of SCADA system data through sliding windows, the wavelet coefficients are processed using the adaptive threshold function, and wavelet decomposition at different levels is performed to adapt to different signal lengths.
It realizes effective noise reduction processing of SCADA system data, improving the accuracy and real-time performance of online pipeline simulation.
Smart Images

Figure CN114298103B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the field of online simulation and relates to a method for performing noise reduction processing on data collected by a SCADA system by adopting an OLMS-based wavelet threshold denoising method. Background Art
[0002] At present, the existing operation control means of long-distance pipelines in my country mainly rely on the SCADA system to monitor the operation process parameters of some monitoring points such as stations along the line. It is difficult for dispatching and operating personnel to obtain the operation parameters of the entire line and accurately grasp and predict the operation status of the pipeline. Online simulation technology plays an irreplaceable and important role in process operation and management. Online simulation is a dynamic simulation that uses the SCADA system as a real-time shared database platform. SCADA automatically receives the measured data from the remote measurement and control system and stores the data in the historical database and the real-time common database. The online simulation software relies on these data to perform online prediction and trend analysis on the pipeline status, thereby improving the safety, reliability and economic applicability of pipeline operation. With the development of science and technology, the requirements for the accuracy of information collected in real-time online simulation of pipelines have become higher and higher, but the online simulation of pipeline networks is always full of various noise interferences, which will reduce the accuracy of the online simulation results of pipeline networks.
[0003] The wavelet threshold denoising method is simple to calculate and has a fast operation speed, but it can only be used for offline data processing. By adding a sliding window, online data processing can be realized, and the SCADA system data can be processed in real time, providing basic data for long-distance pipeline online simulation technology. Summary of the invention
[0004] In view of the above shortcomings in the prior art, the present invention proposes a real-time wavelet threshold denoising method for processing SCADA system data, which solves the problem of real-time processing of SCADA system data.
[0005] The present invention is achieved through the following technical solutions:
[0006] The above-mentioned real-time wavelet threshold denoising method for processing SCADA system data comprises the following steps:
[0007] Step 1: Collect SCADA system data in real time. If SCADA system data is collected, determine the number of SCADA system data collected. The collected data is recorded as x. i , i is the number of collected data; and determine the sliding window size and position, when i<2 3 When i<2, the window size is 1; when i<2 p When the window size is 2 p-1 , p=4,5,…,10; when i≥2 10 When the window size is 2 10; The end data of the window is the position of the newly read data each time; if no SCADA system data is collected, stop;
[0008] Step 2, performing wavelet threshold denoising on the data within the window range;
[0009] (1) When the window size is 1, wavelet threshold denoising is not performed and the data is output directly;
[0010] (2) The window size is 2 p When p = 3, 4, or 5, the sym4 wavelet is used to perform a 1-layer wavelet decomposition on the window range data to obtain the scale coefficient v j,k and wavelet coefficients w j,k , use the following threshold function for each wavelet coefficient w j,k To process:
[0011]
[0012] In the formula, w j,k is the processed wavelet coefficient, n is 2, j is the number of decomposition layers, λ is the set threshold, and λ is calculated using the following formula:
[0013]
[0014] N is the number of data in the window range, σ is the noise standard deviation, and is calculated using the following formula:
[0015]
[0016] (3) The window size is 2 p When p = 6, 7, or 8, the sym4 wavelet is used to perform a two-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0017] (4) Window size is 2 p When p = 9, 10, the sym4 wavelet is used to perform a three-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0018] (5) Reconstructing the signal of the scale coefficients and wavelet coefficients processed in the above steps;
[0019] Step 3, output the data at the last position of the window and return to step 1.
[0020] The present invention provides a real-time wavelet threshold denoising method for processing SCADA system data, which uses a sliding window to realize online wavelet threshold denoising, uses an adaptive function threshold to process wavelet coefficients, and performs wavelet decomposition at different levels under different signal lengths. Simulations show that the real-time wavelet threshold denoising method for processing SCADA system data provided by the present invention can better perform noise reduction processing on data collected by the SCADA system. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 is a step diagram of the method of the present invention;
[0022] Figure 2 1500 traffic data collected in real time;
[0023] Figure 3 1500 flow data processed in real time by the method of the present invention;
[0024] Figure 4 1500 pump speed data collected in real time;
[0025] Figure 5 These are 1500 pump speed data processed in real time using the method of the present invention. DETAILED DESCRIPTION
[0026] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with the accompanying drawings in the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0027] like Figure 1 As shown, a real-time wavelet threshold denoising method for processing SCADA system data includes the following steps:
[0028] Step 1: Collect SCADA system data in real time. If SCADA system data is collected, determine the number of SCADA system data collected. The collected data is recorded as x. i , i is the number of collected data; and determine the sliding window size and position, when i<2 3 When i<2, the window size is 1; when i<2 p When the window size is 2 p-1 , p=4,5,…,10; when i≥2 10 When the window size is 2 10 ; The end data of the window is the position of the newly read data each time; if no SCADA system data is collected, stop;
[0029] Step 2, performing wavelet threshold denoising on the data within the window range;
[0030] (1) When the window size is 1, wavelet threshold denoising is not performed and the data is output directly;
[0031] (2) The window size is 2 p When p = 3, 4, or 5, the sym4 wavelet is used to perform a 1-layer wavelet decomposition on the window range data to obtain the scale coefficient v j,k and wavelet coefficients w j,k , use the following threshold function for each wavelet coefficient w j,k To process:
[0032]
[0033] In the formula, w j,k is the processed wavelet coefficient, n is 2, j is the number of decomposition layers, λ is the set threshold, and λ is calculated using the following formula:
[0034]
[0035] N is the number of data in the window range, σ is the noise standard deviation, and is calculated using the following formula:
[0036]
[0037] (3) The window size is 2 p When p = 6, 7, or 8, the sym4 wavelet is used to perform a two-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0038] (4) Window size is 2 p When p = 9, 10, the sym4 wavelet is used to perform a three-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0039] (5) Reconstructing the signal of the scale coefficients and wavelet coefficients processed in the above steps;
[0040] Step 3, output the data at the last position of the window and return to step 1.
[0041] Specific embodiment At present, a total of 1500 flow data collected continuously from 15:56 on December 19, 2021 to 15:44 on December 20, 2021 by a pipeline SCADA system and a total of 1500 pump speed data collected continuously from 1:46 on December 20, 2021 to 10:32 on December 20, 2021 have been collected. Now, according to the method of the present invention, the collected flow is denoised online, and the implementation steps are as follows:
[0042] Step 1: Collect the above 1500 flow data and pump speed data one by one to simulate the real-time collection process, and determine the sliding window size and position until all 1500 flow data and pump speed data are collected and then stop collecting:
[0043] Step 2: Perform wavelet threshold denoising on the data in the window after each acquisition. The method is as follows:
[0044] (1) When the window size is 1, wavelet threshold denoising is not performed and the data is output directly;
[0045] (2) The window size is 2 p When p = 3, 4, or 5, the sym4 wavelet is used to perform a 1-layer wavelet decomposition on the window range data to obtain the scale coefficient v j,k and wavelet coefficients w j,k , use the following threshold function for each wavelet coefficient w j,k To process:
[0046]
[0047] In the formula, w j,k is the processed wavelet coefficient, n is 2, j is the number of decomposition layers, λ is the set threshold, and λ is calculated using the following formula:
[0048]
[0049] N is the number of data in the window range, σ is the noise standard deviation, and is calculated using the following formula:
[0050]
[0051] (3) The window size is 2 p When p = 6, 7, or 8, the sym4 wavelet is used to perform a two-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0052] (4) Window size is 2 p When p = 9, 10, the sym4 wavelet is used to perform a three-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process;
[0053] (5) Reconstruct the signal based on the scaling coefficients and wavelet coefficients processed in the above steps.
[0054] Step 3, output the data at the last position of the window and return to step 1.
[0055] Figure 21500 traffic data collected in real time, Figure 3 These are 1500 flow data processed in real time using the method of the present invention. Figure 4 1500 pump speed data collected in real time, Figure 5 1500 pump speed data after real-time processing by the method of the present invention. It can be seen that the flow data and pump speed data after real-time processing by the method of the present invention can better remove noise and retain the real signal.
[0056] The invention provides a real-time wavelet threshold denoising method for processing SCADA system data. The method has simple calculation, fast calculation speed and good denoising effect.
[0057] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A real-time wavelet threshold denoising method for processing SCADA system data, characterized in that: The following steps are involved: Step 1: Collect SCADA system data in real time. If SCADA system data is collected, determine the number of SCADA system data collected. The collected data is recorded as x. i , i is the number of collected data; and determine the sliding window size and position, when i<2 3 When i<2, the window size is 1; when i<2 p When the window size is 2 p-1 , p = 4, 5, ..., 10; When i ≥ 2 10 When the window size is 2 10 ; The end data of the window is the position of the newly read data each time; if no SCADA system data is collected, stop; Step 2, performing wavelet threshold denoising on the data within the window range; (1) When the window size is 1, wavelet threshold denoising is not performed and the data is output directly; (2) The window size is 2 p When p = 3, 4, or 5, the sym4 wavelet is used to perform a 1-layer wavelet decomposition on the window range data to obtain the scale coefficient v j,k and wavelet coefficients w j,k , use the following threshold function for each wavelet coefficient w j,k To process: In the formula, w j,k is the processed wavelet coefficient, n is 2, j is the number of decomposition layers, λ is the set threshold, and λ is calculated using the following formula: N is the number of data in the window range, σ is the noise standard deviation, and is calculated using the following formula: (3) The window size is 2 p When p = 6, 7, or 8, the sym4 wavelet is used to perform a two-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process; (4) Window size is 2 p When p = 9, 10, the sym4 wavelet is used to perform a three-layer wavelet decomposition on the data in the window range, and the threshold function shown in (2) is used to decompose each wavelet coefficient w j,k to process; (5) Reconstructing the signal of the scale coefficients and wavelet coefficients processed in the above steps; Step 3, output the data at the last position of the window and return to step 1.
