Noise reduction processing method for mass hoisting data of cable crane real-time monitoring system

By using low-pass digital filters to perform differential screening and FFT conversion processing on lifting weight data in the real-time monitoring system of massive cable machines, the problems of incomplete noise data processing and time shift in the existing technology are solved, and efficient and automated reduction is achieved The noise effect improves the accuracy of data analysis.

CN119088794AActive Publication Date: 2024-12-06HUBEI UNIV OF TECH
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411201598.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-29
Publication Date
2024-12-06
Estimated Expiration
2044-08-29

AI Technical Summary

Technical Problem

The existing technology is difficult to effectively reduce noise and process the lifting weight data in the massive cable machine real-time monitoring system, especially the inability to completely filter out the noise data caused by wind, acceleration, deceleration and other factors, resulting in inaccurate data analysis and the existence of sliding filters Time shift phenomenon.

Method used

Using a low-pass digital filter method, differential processing of cable machine lifting data, filtering stable stage data, and using Python Scipy library to build a low-pass filter for FFT and IFFT transformation, perform low-pass filtering and noise reduction Then import the data into the database.

Benefits of technology

It realizes efficient and automated noise reduction processing of massive cable machine lifting data, avoids incomplete filtering and time shifting of sliding filtering, and improves the accuracy of data analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088794A_ABST
    Figure CN119088794A_ABST
Patent Text Reader

Abstract

The invention belongs to the field of data processing, and relates to a noise reduction processing method for massive hoisting data of a cable crane real-time monitoring system, which comprises the following steps: 1) acquiring a hoisting database of the cable crane real-time monitoring system; (2) grouping the hoisting weight databases, and extracting real-time operation data of the cable crane from each group of databases; 3) screening the extracted data to obtain data of the cable crane in the hoisting stability stage of the transported object; (4) noise reduction is conducted on the obtained data of the cable crane transported object in the hoisting stability stage, and the data obtained after noise reduction are obtained; 5, the obtained noise-reduced data are imported into a hoisting data base of the cable crane real-time monitoring system, and noise reduction processing of the hoisting data of the mass cable crane real-time monitoring system.The noise reduction method for the hoisting data of the mass cable crane real-time monitoring system has the advantage that efficient and automatic noise reduction processing of the hoisting data of the mass cable crane real-time monitoring system can be achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the field of data processing, and relates to a method for denoising massive data, and in particular to a method for denoising massive weight data of a real-time monitoring system for a cable crane based on a low-pass digital filter. Background Art

[0002] With the practice and development of the theory of intelligent construction of dams, in order to realize the standardized, refined and intelligent management of cable cranes, and to grasp the actual operation of cable cranes. A real-time monitoring system for cable cranes has been developed, which has the characteristics of real-time, accurate and high refresh rate. However, due to the high sampling rate of the monitoring system, a large amount of data with complex content is generated. In actual engineering, only the data is collected and simply processed. However, since the cable crane is affected by factors such as wind, acceleration, deceleration and avoidance during actual operation, these interference factors are reflected in the real-time monitoring system of the cable crane, which will cause noise data in the cable crane operation data. The noise of the cable crane operation data is mainly distributed in the hoisting weight value. When the cable crane is affected by the above factors during operation, it may appear in a short-term fluctuation in the stable operation state. This fluctuation is more obvious during the transportation of the cable crane, and has little effect during loading and unloading. For this kind of hoisting weight change caused by noise data, it is not conducive to the analysis of the cable crane operation data. If the noise data in the operation of the cable crane can be effectively reduced by designing a corresponding digital filter, the accuracy of the analysis of the cable crane operation data can be greatly improved.

[0003] Among the existing noise reduction methods, Ning Wuting et al. (Ning Wuting, Identification and Efficiency Analysis of Cable Crane Operation Mode of Baihetan Arch Dam [D]. Three Gorges University, 2021) proposed using the median filter method to reduce the noise of the cable crane hoisting data. This method can effectively reduce the noise of the data without destroying the original trend of the data, and has certain engineering practicality. However, the noise data in the cable crane hoisting data is not entirely caused by accidental factors, so the median filter cannot completely filter out the noise data. At the same time, the median filter belongs to a sliding filter, and the filtered data will have a time shift phenomenon, which will affect the data analysis of the cable crane operation. This is an inevitable disadvantage of this method. Summary of the invention

[0004] In order to solve the above problems existing in the background technology, the present invention provides a method for realizing efficient and automatic noise reduction processing of the hoisting weight data of a massive cable crane real-time monitoring system.

[0005] In order to achieve the above object, the present invention adopts the following technical solution:

[0006] A method for reducing the noise of hoisting weight data in a massive cable crane real-time monitoring system, characterized in that the method for reducing the noise of hoisting weight data in a massive cable crane real-time monitoring system comprises the following steps:

[0007] 1) Obtain the lifting weight database of the cable crane real-time monitoring system;

[0008] 2) The lifting weight database obtained in step 1) is grouped according to the lifting weight range, and the real-time operation data of the cable crane is extracted from the database according to the lifting weight range of each group;

[0009] 3) Screening the data extracted in step 2) to obtain data of the stable stage of hoisting weight of the object transported by the cable car;

[0010] 4) De-noising the data of the stable stage of the lifting weight of the object transported by the cable car obtained in step 3) to obtain de-noised data;

[0011] 5) The de-noised data obtained in step 4) is imported into the cable crane real-time monitoring system weight database of step 1) to complete the de-noising process of the massive cable crane real-time monitoring system weight data.

[0012] Preferably, the specific implementation method of step 2) provided by the present invention is:

[0013] 2.1) Draw a cable crane hoisting weight histogram based on the hoisting weight database obtained in step 1);

[0014] 2.2) Determine the lifting weight range based on the cable crane lifting weight histogram;

[0015] 2.3) grouping the lifting weight database obtained in step 1) according to the lifting weight range to form a grouped database;

[0016] 2.4) Use SQL statements to extract the real-time operation data of the cable machine in the group database.

[0017] Preferably, in step 2.2) provided by the present invention, the range of the hoisting weight is 0.5t≤W≤8t, 8t<W<26t and 26t≤W, wherein W is the hoisting weight.

[0018] Preferably, the specific implementation method of step 3) provided by the present invention is:

[0019] 3.1) Using SQL statements to perform differential processing on the data extracted in step 2);

[0020] 3.2) judging the working stage of the data extracted in step 2) by the difference value, wherein the working stage includes a rising stage, a falling stage and a stable stage;

[0021] 3.3) Use SQL statements to mark the data at each work stage;

[0022] 3.4) Use SQL statements to filter out the data in the non-stable lifting stage and obtain the data in the stable lifting stage of the cable car transport object.

[0023] Preferably, the specific implementation method of step 4) provided by the present invention is:

[0024] 4.1) Using SQL statements to extract the data of the stable stage of the lifting weight of the object transported by the cable car obtained in step 3);

[0025] 4.2) Use Python's Scipy library to construct a low-pass digital filter;

[0026] 4.3) The data extracted in step 4.1) is input into the low-pass digital filter constructed in step 4.2) for filtering to obtain the noise-reduced data.

[0027] Preferably, the specific implementation of step 4.3) provided by the present invention is:

[0028] 4.3.1) performing FFT transformation on the data extracted in step 4.1);

[0029] 4.3.2) Perform low-pass filtering on the data after FFT transformation;

[0030] 4.3.3) Perform IFFT transformation on the data after low-pass filtering to obtain the denoised data.

[0031] Preferably, the method of performing discrete FFT transformation in step 4.3.1) provided by the present invention is:

[0032]

[0033] in:

[0034] x(n) is a finite data sequence with a length of N;

[0035] X(k) is a finite length sequence after the discrete FFT transformation of x(n), with a length of N;

[0036] Where j represents the imaginary unit.

[0037] Preferably, the method of performing discrete IFFT transformation in step 4.3.3) provided by the present invention is:

[0038]

[0039] Preferably, the specific implementation of step 5) provided by the present invention is:

[0040] The denoised data obtained in step 4) is imported into the cable crane real-time monitoring system weight database of step 1) by using SQL statements, replacing the unfiltered data in the original cable crane real-time monitoring system weight database, and completing the denoising process of the massive cable crane real-time monitoring system weight data.

[0041] Compared with the prior art, the present invention has the following significant advantages:

[0042] The present invention discloses a method for denoising the weight data of a massive cable crane real-time monitoring system. First, the data of the real-time operation of the cable crane is extracted from the database by grouping according to the weight range; then the data of the lifting weight rising and falling stages in the extracted data are screened out, and only the data of the stable weight stage of the cable crane transport object is retained; then the screened data is imported into a low-pass digital filter for noise reduction; finally, the noise-reduced data is imported into the database. The present invention fully considers the characteristics of the cable crane weight noise data, and adopts corresponding filtering technology to efficiently, quickly and low-costly perform noise reduction on the cable crane weight data, avoiding the phenomenon of incomplete filtering in sliding filtering and time shift of the filtered data. At the same time, the method for denoising the weight data of the massive cable crane real-time monitoring system provided by the present invention can not only efficiently reduce the noise data of the cable crane in the actual operation process of the cable crane, which is affected by factors such as wind speed, acceleration, deceleration and avoidance, but also realize the automation of denoising the massive cable crane weight data, which is conducive to improving the accuracy of the cable crane operation data analysis. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 It is a flow chart of the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system provided by the present invention;

[0044] Figure 2 It is a graph of some original lifting data in the database;

[0045] Figure 3 is the histogram of cable crane hoisting weight data;

[0046] Figure 4 It is a schematic diagram of screening steady phase data adopted by the present invention;

[0047] Figure 5 It is the amplitude-frequency diagram of the unfiltered data of some packets larger than 26t;

[0048] Figure 6 It is the amplitude-frequency diagram of the data after filtering for some packets larger than 26t;

[0049] Figure 7 This is a comparison chart of the data before and after filtering for some packets larger than 26t;

[0050] Figure 8This is a comparison chart of the lifting weight data of some database raw data after low-pass filtering and before filtering. DETAILED DESCRIPTION

[0051] See also Figure 1 , the present invention proposes a method for denoising the weight data of a massive cable crane real-time monitoring system. The core idea of ​​the method is: first, the weight range is divided into three groups: 0.5-8t, 8-26t and greater than 26t, and the three groups of data are extracted from the database respectively; then the lifting weight rising and falling stages in the extracted data are screened out, and only the data in the stable lifting weight stage are retained; then the extracted data is imported into the low-pass digital filter constructed by the Python Scipy library for noise reduction processing; finally, the noise-reduced data is imported into the database to replace the original lifting weight data. The present invention comprehensively considers the characteristics of the cable crane lifting weight noise data, and uses the PyhonScipy library to construct a low-pass digital filter to perform noise reduction processing on the cable crane lifting weight data, which can achieve efficient, automatic and scientific noise reduction processing. Some of the original data in the database are as follows Figure 2 shown.

[0052] Specifically, the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system provided by the present invention comprises the following steps:

[0053] Step 1: Extract the real-time operation data of the cable crane from the database by grouping by lifting weight range.

[0054] The present invention first divides the lifting weight range into three groups of data: 0.5-8t, 8-26t and greater than 26t, and then extracts the three groups of data from the database in sequence. The division of the lifting weight range is mainly based on the cable crane lifting weight histogram as shown in Figure 3 As shown in the figure, the cable crane weight data is roughly divided into three distributions: 0-0.5t, 5-8t and 26-30t. The first group of weight ranges is divided into 0.5-8t because when the cable crane weight data is less than 0.5t, the cable crane is mostly in an unloaded state, that is, no objects are hoisted, so the 0.5-8t grouping can ensure that there is no large amount of invalid data in the extracted range. The second group of weight ranges is divided into 8-26t groups to ensure that the middle segment data is extracted. The third group of weight ranges is divided into more than 26t to extract the remaining data.

[0055] Step 2: Filter out the data in the lifting and descending stages of the extracted data, and only retain the data in the stable lifting stage of the cable car transporting objects.

[0056] 2.1) The present invention uses SQL statements to perform differential processing on the cable crane hoisting weight data, and the calculation method is:

[0057]

[0058] in:

[0059] is the first-order difference value of the hoisting weight, that is, the rate of change of the hoisting weight;

[0060] W n is the weight of the nth row;

[0061] W n+1 It is the lifting weight of the n+1th row;

[0062] t n is the acquisition time of the nth row;

[0063] t n+1 is the acquisition time of the n+1th row;

[0064] Δt is the time difference between the previous and next two lines.

[0065] 2.2) Then use the difference value to judge whether the cable crane hoisting weight data is in the rising, falling and stable stages, and use SQL statements to mark the data in each stage. The judgment criteria are shown in Table 1 below.

[0066] Table 1 Judgment table of cable crane hoisting rising, descending, stable and no-load stages

[0067] stage mark DW≥0.2 Lifting weight 1 DW≤-0.2 Lowering the load 3 -0.2<DW<0.2 The load is in a stable stage 0 W<0.5 No-load stage /

[0068] 2.3) Finally, use SQL statements to filter out the data in the non-steady-weight phase, that is, the data in the lifting and lowering phases that are divided into three groups according to the lifting range in step 1. The following will specifically explain how to exclude the data in the lifting and lowering phases.

[0069] like Figure 4 As shown, most of the data divided by the lifting weight range greater than 26t are data in the stable lifting weight stage marked as 0. The data marked as 1 for the lifting weight increase and 3 for the lifting weight decrease stage are not very obvious. In order to prevent the screening out of valid data, the data of the third group is actually extracted based on data greater than 20t. The purpose is to ensure that there are obvious lifting weight increase and lifting weight decrease stages in the third group of data, so as to avoid the screening out of the data to be extracted in step 2. Finally, the SQL statement is used to filter out the data marked as 0, and then the filtered data is limited to a lifting weight range greater than 26t, which can ensure that the extracted data will not be repeated with the second group of data. The data screening process for the other two groups is to extract data according to the lifting weight division range. The data screening method is similar to the above process. The specific process is as follows Figure 4 shown.

[0070] Step 3: Import the filtered data into the constructed low-pass digital filter for noise reduction.

[0071] The present invention uses the fast Fourier transform and inverse transform functions in the Python Scipy library to construct a low-pass data filter. The specific calculation method is as follows:

[0072]

[0073] in:

[0074] x(n) is a finite data sequence with a length of N;

[0075] X(k) is a finite length sequence after the discrete FFT transformation of x(n), and its length is also N;

[0076] Where j represents the imaginary unit.

[0077] Taking the group with a weight greater than 26t as an example, the data of the stable stage of the reorganized weight is extracted from the database, and the discrete FFT transformation is performed using formula (1). The amplitude of the reorganized data can be calculated and plotted as an amplitude-frequency diagram as shown in Figure 5 Then select the lower frequency part, retain the lower frequency part and filter out the higher frequency part, that is, the spectrum obtained after low-pass filtering the data is as follows Figure 6 shown.

[0078]

[0079] Then, the filtered data is subjected to discrete IFFT transformation using formula (2) to obtain the filtered lifting weight data. Figure 7 shown.

[0080] Step 4: Import the denoised data into the original database. The filtered data is imported into the original database using SQL statements, and the original unfiltered data is replaced to achieve denoising of the mass cable crane real-time monitoring system hoisting data. The original cable crane hoisting data, the data after low-pass filter filtering, is as follows: Figure 8 shown.

[0081] In order to further illustrate the noise reduction effect of the method of the present invention on cable crane hoisting data, some data were extracted from the database and compared and verified using three sliding filters, namely mean filtering, median filtering and Gaussian filtering, and a low-pass filter (the method provided by the present invention).

[0082] Numerical experiment: In order to verify the filtering effect of the method of the present invention, the number of windows of the sliding filter is set to 5, and the first-order Gaussian kernel of the Gaussian filter is 0.053991, 0.241971, 0.398942, 0.241971, 0.053991. The lowest frequency part of the low-pass filter is selected for filtering. About 500 rows of data from 2018-10-01 0:00:00 to 2018-10-01 0:45:15 are extracted from the data as a data set for testing the filtering effects of different filters. Table 2 shows the filtering effects of different filtering methods on the original lifting weight data.

[0083] Table 2 Comparison of filtering effects of different filters

[0084] Raw data Mean filter Median filter Gaussian filter Low pass filter Error rate 18.6% 10.4% 7.4% 4.8% 0.6% RMSE / 3.14 1.92 0.64 0.32 SNR / 15.69 19.956 29.52 35.40 Lifting weight 1 4 6 0 3 Stable lifting 92 45 23 24 0 Lowering the load 0 3 8 0 0

[0085] From the results of numerical experiments, the Gaussian filter has the best performance among the sliding filters (Gaussian filter, mean filter and median filter). The error rate and RMSE of the filtered data are the lowest, and its SNR value is also greater than that of the other two sliding filters, indicating that the Gaussian filter can preserve the trend of the original data to the maximum extent while filtering out the noise data. Although the filtering effect of the Gaussian filter is good in the sliding filter, it is better than the Gaussian filter compared with the low-pass filter used in the present invention. The error rate and RMSE of the filtered data are reduced by 87.5% and 50% respectively compared with the Gaussian filter, and the SNR is improved by 19.91% compared with the Gaussian filter. It shows that the low-pass filter can retain the information of the original data as much as possible while filtering out a large amount of noise data, thus achieving scientific and effective noise reduction.

Claims

1. A method for noise reduction of hoisting weight data in a massive cable crane real-time monitoring system. Features: The method for denoising the weight data of a massive cable crane real-time monitoring system comprises the following steps: 1) Obtain the lifting weight database of the cable crane real-time monitoring system; 2) The lifting weight database obtained in step 1) is grouped according to the lifting weight range, and the real-time operation data of the cable crane is extracted from the database according to the lifting weight range of each group; 3) Screening the data extracted in step 2) to obtain data of the stable stage of hoisting weight of the object transported by the cable car; 4) De-noising the data of the stable stage of the lifting weight of the object transported by the cable car obtained in step 3) to obtain de-noised data; 5) The de-noised data obtained in step 4) is imported into the cable crane real-time monitoring system weight database of step 1) to complete the de-noising process of the massive cable crane real-time monitoring system weight data.

2. According to the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to claim 1, Features: The specific implementation method of step 2) is: 2.1) Draw a cable crane hoisting weight histogram based on the hoisting weight database obtained in step 1); 2.2) Determine the lifting weight range based on the cable crane lifting weight histogram; 2.3) grouping the lifting weight database obtained in step 1) according to the lifting weight range to form a grouped database; 2.4) Use SQL statements to extract the real-time operation data of the cable machine in the group database.

3. According to the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to claim 2, Features: In the step 2.2), the lifting weight range is 0.5t≤W≤8t, 8t<W<26t and 26t≤W, where W is the lifting weight.

4. According to the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to claim 3, Features: The specific implementation method of step 3) is: 3.1) Using SQL statements to perform differential processing on the data extracted in step 2); 3.2) judging the working stage of the data extracted in step 2) by the difference value, wherein the working stage includes a rising stage, a falling stage and a stable stage; 3.3) Use SQL statements to mark the data at each work stage; 3.4) Use SQL statements to filter out the data in the non-stable lifting stage and obtain the data in the stable lifting stage of the cable car transport object.

5. According to the method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to claim 4, Features: The specific implementation method of step 4) is: 4.1) Using SQL statements to extract the data of the stable stage of the lifting weight of the object transported by the cable car obtained in step 3); 4.2) Use Python's Scipy library to construct a low-pass digital filter; 4.3) The data extracted in step 4.1) is input into the low-pass digital filter constructed in step 4.2) for filtering to obtain the noise-reduced data.

6. The method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to claim 5, Features: The specific implementation method of step 4.3) is: 4.3.1) performing FFT transformation on the data extracted in step 4.1); 4.3.2) Perform low-pass filtering on the data after FFT transformation; 4.3.3) Perform IFFT transformation on the data after low-pass filtering to obtain the denoised data.

7. The method for denoising the weight data of a massive cableway real-time monitoring system according to claim 6, Features: The method of performing discrete FFT transformation in step 4.3.1) is: in: x(n) is a finite data sequence with a length of N; X(k) is a finite length sequence after the discrete FFT transformation of x(n), with a length of N; Where j represents the imaginary unit.

8. The method for denoising the weight data of a massive cableway real-time monitoring system according to claim 7, Features: The method of performing discrete IFFT transformation in step 4.3.3) is:

9. The method for denoising the hoisting weight data of a massive cable crane real-time monitoring system according to any one of claims 1 to 8, Features: The specific implementation method of step 5) is: The denoised data obtained in step 4) is imported into the cable crane real-time monitoring system weight database of step 1) by using SQL statements, replacing the unfiltered data in the original cable crane real-time monitoring system weight database, and completing the denoising process of the massive cable crane real-time monitoring system weight data.

Citation Information

Patent Citations

  • Dynamic compensation of a robot arm mounted on a flexible arm

    CA3030764A1

  • Combined positioning cable machine operation monitoring system and cable machine anti-collision regulation and control method

    CN108427134A

  • Signal filtering method, moment limiter and limiting method and crane

    CN111268573A

  • Gantry crane collision simulation detection method

    CN115258962A

  • Fast low-pass filtering method and system for GRACE time-varying gravity data

    CN116260426A