Belt conveyor carrier roller fault sound detection method and system

Abstract

The invention provides a belt conveyor carrier roller fault sound detection method and system, and relates to the field of nondestructive fault detection, and the method comprises the steps: obtaining a time-frequency domain characteristic pattern X of a sound signal; performing feature extraction on the X through a plurality of convolutional layers with different sizes to obtain a multi-scale feature map # imgabs0 #; performing deeper-level fault feature mapping of the spatial dimension and the channel dimension on the # imgabs1 # through a first Ghost module, a deep convolutional layer, a spatial channel collaborative attention module and a second Ghost module in sequence to obtain a high-level semantic feature map # imgabs2 #; inputting # imgabs3 # into a classifier module to obtain a classification result, and completing model training by using a cross entropy loss function and a re-parameterization training method to obtain a fault detection model; and performing short-time Fourier transform on a sound signal to be detected, and inputting the sound signal to the trained fault detection model to obtain a fault diagnosis result. According to the invention, the accuracy and real-time performance of belt conveyor carrier roller fault detection are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of non-destructive fault detection, and in particular to a method and system for detecting fault sound of a belt conveyor roller. Background Art

[0002] Belt conveyors are widely used in industrial and agricultural production, logistics and transportation due to their advantages of long transportation distance, large transportation volume, low freight and stable operation. Rollers are an important part of belt conveyors and play a key role in carrying conveyor belts and materials. However, due to the harsh working environment, rollers often suffer from some damage and failure problems. If these potential faults are not detected and diagnosed in a timely and effective manner, the equipment operation performance will decline, production efficiency will be reduced, and serious consequences such as economic losses and casualties will be caused. At present, the detection method for belt conveyor roller faults generally focuses on vibration signals and thermal imaging signals, and signal processing methods are used for fault analysis. Traditional signal processing methods have poor accuracy and robustness. As an important non-contact detection method, sound signals have the advantages of convenient signal acquisition, no interference with machines, and low cost. Therefore, they have great application potential in fault diagnosis. However, under actual working conditions, when the belt conveyor is running, the surrounding noise easily drowns out the sound of the roller operation, and the bearing sound characteristics are not obvious, which affects the fault detection performance. Therefore, how to improve the accuracy and real-time performance of belt conveyor roller fault detection has become a technical problem that needs to be solved. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art or related art, and discloses a belt conveyor roller fault sound detection method and system, which improves the accuracy and real-time performance of belt conveyor roller fault detection.

[0004] The first aspect of the present invention discloses a belt conveyor roller fault sound detection method, comprising: signal acquisition: collecting the sound signal of the belt conveyor roller when it is running; time-frequency domain transformation: performing short-time Fourier transform on the sound signal to obtain a time-frequency domain feature map X of the sound signal; multi-scale feature extraction: extracting features from the time-frequency domain feature map X through multiple convolutional layers of different sizes to obtain feature maps of multiple scales. , the feature map Splicing is performed on the channel dimension to obtain a multi-scale feature map ; High-level semantic extraction: multi-scale feature maps The first Ghost module, deep convolution layer, spatial channel collaborative attention module and the second Ghost module are used to perform deeper fault feature mapping in spatial and channel dimensions to obtain a high-level semantic feature map. ; Feature classification: high-level semantic feature maps Input it into the classifier module to obtain the classification result, and use the cross entropy loss function and reparameterization training method to complete the model training to obtain the fault detection model; Fault detection: After performing short-time Fourier transform on the sound signal to be detected, input it into the trained fault detection model to obtain the fault diagnosis result.

[0005] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the time-frequency domain transformation step specifically includes: performing short-time Fourier transform on the one-dimensional sound signal to obtain a two-dimensional time-frequency domain feature graph X, and the time-frequency domain feature graph X is input as a fault sample into a subsequent fault detection model for analysis, wherein the calculation process of the short-time Fourier transform includes:

[0006]

[0007] in, is the window function, is the input signal, express In time and frequency The window function is a Hamming window, the window size is set to 2048, and the step size is set to 512.

[0008] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the multi-scale feature extraction step specifically includes: the time-frequency domain feature map X passes through 3×3 convolution layers, 5×5 convolution layers and 7×7 convolution layers in parallel, and the number of output channels of each convolution layer is 16; the output feature map after the i-th convolution layer is recorded as , then Splicing is performed on the channel dimension to obtain a fused multi-scale feature map .

[0009] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the step of high-level semantic extraction specifically includes: multi-scale feature map Enter the residual connection branch and the first Ghost module respectively. The first Ghost module performs multi-scale feature map Perform channel expansion and preliminary feature extraction to obtain a compact feature map ; Compact feature map Enter the deep convolution layer to further extract local features and obtain enhanced feature maps ; Enhanced feature map Entering the spatial channel collaborative attention module, based on the synergy of spatial attention and channel attention, the network's attention to important features is strengthened, the feature expression ability is improved, and the spatial channel collaborative attention feature map is obtained. ; The second Ghost module focuses on the spatial channel collaborative attention feature map Compress the number of channels to obtain fusion features ; Multi-scale feature map With fusion features Add together to obtain a high-level semantic feature map .

[0010] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the calculation process of the spatial channel collaborative attention module specifically includes: the spatial channel collaborative attention is composed of two parts: shared multi-semantic spatial attention and progressive channel attention;

[0011] The calculation process of shared multi-semantic spatial attention includes:

[0012] Enhanced feature map Perform global average pooling along the height and width dimensions to obtain two unidirectional one-dimensional sequences; decompose the two one-dimensional sequences separately to obtain four sub-features of the same size; use four one-dimensional depth-shared convolutions to extract features from each sub-feature to obtain sub-feature spatial structure information; splice the sub-feature spatial structure information along the channel direction, perform group normalization, and calculate the spatial attention weight through the Sigmoid activation function; use the spatial attention weight to enhance the feature map Weighted, we get a shared multi-semantic spatial attention feature map ;

[0013] The calculation process of progressive channel attention includes:

[0014] Attention feature map for shared multi-semantic space Perform global average pooling and obtain the downsampled feature map after downsampling; perform group normalization on the downsampled feature map, and then use 1×1 deep convolution to generate three sets of corresponding values; input the three sets of values ​​into the channel-based attention to calculate the attention weights, and use global average pooling and sigmoid activation to generate channel weights; according to the channel weights, the shared multi-semantic spatial attention feature map is Weighted, we get the spatial channel collaborative attention feature map .

[0015] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the calculation process of the first Ghost module or the second Ghost module specifically includes: the input feature map is convolved by 1×1 main branch to generate the main branch feature map. ; Use 3×3 deep convolution to perform feature extraction on the main branch Perform cheap operations and generate redundant features ; The main branch feature and redundant features The concatenation is performed in the channel dimension to obtain the final output of the Ghost module.

[0016] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the enhanced characteristic map The calculation process includes: compact feature map Input into the deep convolution layer, the calculation process of the deep convolution layer is expressed as:

[0017]

[0018] Among them, K represents the depth convolution kernel size, Represented in the enhanced feature map The value of the Cth channel position (i, j) in, represents the weight of the depth convolution kernel of the Cth channel at position (m,n), Represents a compact feature map The value of the Cth channel after downsampling with a step size of S.

[0019] According to the belt conveyor roller fault sound detection method disclosed in the present invention, preferably, the signal collection step specifically includes: collecting sound signals using distributed auscultation optical fibers or microphone arrays.

[0020] The second aspect of the present invention discloses a belt conveyor roller fault sound detection system, comprising: a memory for storing program instructions; a processor for calling the program instructions stored in the memory to implement a belt conveyor roller fault sound detection method such as any of the above technical solutions.

[0021] The beneficial effects of the present invention include at least: the present invention can fully learn the feature information between features of different scales, enhance the input feature expression, improve the modeling ability of local features and global context information, reduce the complexity of calculation, improve the fitting performance of the model, and achieve accurate and real-time detection of typical faults of belt conveyor rollers and bearings, and the accuracy and robustness of fault diagnosis under noise interference are better. In addition, the present invention has a small number of parameters and can be deployed in embedded and mobile devices, laying the foundation for intelligent diagnosis of belt conveyor roller faults in actual industrial applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A schematic flow chart of a belt conveyor roller fault sound detection method according to an embodiment of the present invention is shown.

[0023] Figure 2 A schematic diagram of the network structure of a multi-scale convolution module according to an embodiment of the present invention is shown.

[0024] Figure 3 A schematic diagram of the network structure of a Ghost bottleneck module according to an embodiment of the present invention is shown.

[0025] Figure 4 A schematic diagram of the network structure of a classifier module according to an embodiment of the present invention is shown.

[0026] Figure 5 A schematic diagram of the network structure of a Ghost module according to an embodiment of the present invention is shown.

[0027] Figure 6 A schematic diagram of a network structure for sharing multi-semantic spatial attention according to an embodiment of the present invention is shown.

[0028] Figure 7 A schematic diagram of a network structure of progressive channel attention according to an embodiment of the present invention is shown.

[0029] Figure 8 A confusion matrix result diagram of a roller sound dataset according to an embodiment of the present invention is shown.

[0030] Fig. 9 A schematic block diagram of a belt conveyor roller fault sound detection system according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0031] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention can also be implemented in other ways different from those described herein, and therefore, the present invention is not limited to the limitations of the specific embodiments disclosed below.

[0032] like Figure 1 As shown, according to one embodiment of the present invention, a belt conveyor roller fault sound detection method is disclosed, comprising:

[0033] Step S1, signal acquisition: using a microphone array to collect the sound signal of the rotating belt conveyor roller when it is running, and capturing the spatial distribution and phase characteristics of the sound signal.

[0034] Step S2, time-frequency domain transformation: Perform short-time Fourier transform on the one-dimensional sound signal to obtain a two-dimensional time-frequency domain feature map X, which is used as a fault sample and input into the fault detection model for analysis. The definition of short-time Fourier transform (STFT) is:

[0035]

[0036] in, is the window function, is the input signal, the output Reflection signal In time and frequency The signal component is used, the window function used is the Hamming window, the window size is set to 2048, and the step size is set to 512.

[0037] Step S3, multi-scale feature extraction: input the time-frequency domain feature map X into the multi-scale convolution module for feature extraction; the network structure of the multi-scale convolution module is as follows: Figure 2 As shown, C represents splicing:

[0038] First, the time-frequency domain feature map X passes through a 3×3 convolutional layer, a 5×5 convolutional layer, and a 7×7 convolutional layer in parallel. The number of output channels of each convolutional layer is 16. The output feature map after the i-th convolutional layer is recorded as ;

[0039] Then, Splicing is performed on the channel dimension to obtain a fused multi-scale feature map :

[0040]

[0041]

[0042] Among them, B represents the batch size, C represents the number of input channels, H and W represent the height and width of the feature map, Indicates that the convolution kernel size is The convolution operation, Indicates splicing along the channel direction. Represents the Rectified Linear Unit (ReLU) activation function operation.

[0043] Step S4, high-level semantic extraction: multi-scale feature map The input is sent to the Ghost bottleneck module to further extract high-level semantic information. The Ghost bottleneck module consists of 2 Ghost modules, 1 deep convolutional layer and 1 spatial channel collaborative attention module;

[0044] The network structure of Ghost bottleneck module is as follows Figure 3 As shown:

[0045] First, the multi-scale feature map Enter the residual connection branch and the first Ghost module respectively. The first Ghost module performs multi-scale feature map Perform channel expansion and preliminary feature extraction to obtain a compact feature map ;

[0046] Then, the compact feature map Enter the deep convolution layer for empty transformation to further extract local features and obtain enhanced feature maps ;

[0047] Next, enhance the feature map Entering the spatial channel collaborative attention module, through the synergy of spatial attention and channel attention, the network's attention to important features is strengthened, the feature expression ability is improved, and the spatial channel collaborative attention feature map is obtained. ;

[0048] Then, the second Ghost module coordinates the attention feature map of the spatial channel Compress the number of channels to obtain fusion features ;

[0049] Finally, the multi-scale feature map With fusion features Add together to obtain a high-level semantic feature map , realize the skip connection of features, enhance feature reuse, and alleviate the gradient disappearance problem.

[0050] Step S5, feature classification: classify the high-level semantic feature map The input is into the classifier module, feature classification is performed, and the model training is completed using the cross entropy loss function and reparameterization training method to obtain the fault detection model.

[0051] The network structure of the classifier module is as follows Figure 4 As shown: First, the high-level semantic feature map The input is sent to the adaptive average pooling layer, and then the number of channels is converted through a 1×1 convolution operation. Finally, the fully connected layer maps the feature vector to the number of output categories:

[0052]

[0053] in, represents a full connection operation, represents the global average pooling operation, and Cls represents the output of the classifier module.

[0054] Using the cross entropy loss function to optimize model training: The loss function is a tool to measure the difference between the probability distribution of the model predicted label and the probability distribution of the true label. In the core process of network training, the essence of model optimization is to use the back propagation algorithm to continuously reduce the value of the loss function. This embodiment uses the cross entropy loss function as a means of optimizing network parameters. The calculation formula is:

[0055]

[0056] in, represents the true fault category of the i-th element, represents the probability that the model predicts that x belongs to the i-th fault category.

[0057] The reparameterized training method is used to train the optimized model: the linear parallel branches are introduced in the depth convolution and 1×1 convolution, which does not bring additional cost during inference; since the convolution and BN normalization operations are linear during inference, they can be folded into a single convolution layer, and the weight matrix of each convolution layer is , the bias is , Indicates the number of output channels, Represents the number of input channels, k represents the convolution kernel size; the weight matrix and bias are reparameterized as the sum of the weights and biases of all branches; during inference, duplicate branches are deleted through the inverse reparameterization process; this process involves reparameterizing the folded weights and biases in all branches, thereby achieving the purpose of reducing the amount of calculation during inference; specifically, the inverse reparameterization of weights and biases is shown in the following formula:

[0058]

[0059]

[0060] where i is the index of the repeated branch, is the reparameterized weight, is the reparameterized bias.

[0061] Step S6, fault detection: After performing short-time Fourier transform on the sound signal to be detected, it is input into the trained fault detection model to obtain the fault diagnosis result. The fault detection model is implemented based on the above steps S3, S4 and S5. The time-frequency domain feature map X of the input model is extracted through the multi-scale convolution module to obtain a multi-scale feature map , and then multiple GBNM modules are used to extract high-level semantics to obtain a high-level semantic feature map , and finally obtain the classification results through the classifier module.

[0062] like Figures 3 to 6 As shown, according to the above embodiment, further, step S4 specifically includes:

[0063] S4.1, through the first Ghost module in the Ghost bottleneck module (the first Ghost module) for multi-scale feature maps Perform channel expansion and preliminary feature extraction to obtain a compact feature map ; The specific steps are as follows:

[0064] like Figure 5 As shown, first, the input feature map is convolved with a 1×1 main branch to generate a part of the feature map, and the main branch output is recorded as , the number of channels is ; Next, the Ghost module uses 3×3 depth convolution to Perform cheap operations to generate redundant feature maps ;Finally, the main branch features and cheap branching features Splicing is performed on the channel dimension to obtain the final compact feature map output by the Ghost module :

[0065]

[0066]

[0067]

[0068] in, Indicates the number of output channels, represents a convolution operation with a convolution kernel size of 1×1. Represents a depthwise convolution operation with a kernel size of 3×3.

[0069] S4.2, compact feature maps are constructed through deep convolutional layers (DW Conv) Perform empty transformation to further extract local features and obtain enhanced feature maps ; The specific steps are as follows:

[0070] The compact feature map processed by the first Ghost module Input to the deep convolution layer, C represents the number of channels, H and W represent the height and width of the feature map; the output feature map is Y, where S represents the stride. When the stride Stride>1, the deep convolution downsamples the multi-scale feature map, and K represents the size of the deep convolution kernel:

[0071]

[0072] in, Represented in the enhanced feature map The value of the Cth channel position (i, j) in, represents the weight of the depth convolution kernel of the Cth channel at (m,n), Represents the input compact feature map The value of the Cth channel after downsampling with a step size of S.

[0073] S4.3, enhance the feature map through the spatial channel collaborative attention module (SCSA) Based on the synergy of spatial attention and channel attention, the network's attention to important features is strengthened, the feature expression ability is improved, and the spatial channel synergy attention feature map is obtained. ; Among them, spatial channel collaborative attention consists of two parts: shared multi-semantic spatial attention and progressive channel attention. The specific implementation steps are as follows:

[0074] like Figure 6 As shown in Figure 2, the calculation process of shared multi-semantic spatial attention includes:

[0075] Enhanced feature map After inputting into the spatial channel collaborative attention, the multi-semantic spatial attention is first shared to enhance the feature map Perform global average pooling along the height and width dimensions to obtain two unidirectional one-dimensional sequences and Next, the shared multi-semantic spatial attention is used to reduce the number of parameters and computational cost, and to meet the purpose of learning different spatial distributions and contextual relationships. The two one-dimensional sequences are decomposed and divided into K independent sub-features of the same size. and ; The number of channels of each sub-feature is C / K, K=4:

[0076]

[0077]

[0078]

[0079]

[0080] Among them, B represents the batch size, C represents the number of input channels, H and W represent the height and width of the feature map, Indicates that the global average pooling operation is performed in the horizontal direction. Indicates that the global average pooling operation is performed along the vertical direction. Represents the first sub-feature, which is composed of local features in the height dimension and global features of three different scales in the height dimension , , composition, Represents the second sub-feature, which is composed of local features on the width dimension Global features of three different scales in the width dimension , , composition;

[0081] Then use four convolution kernel sizes The one-dimensional deep shared convolutions of 3, 5, 7, and 9 are respectively used for each sub-feature and Feature extraction is performed by learning consistent features in the horizontal and vertical dimensions, implicitly establishing the dependency between the two dimensions:

[0082]

[0083]

[0084] in, and Represents the spatial structure information of the i-th sub-feature obtained after the deep shared convolution operation; Indicates that the convolution kernel size is One-dimensional depth-shared convolution operation;

[0085] The extracted sub-feature spatial structure information is spliced ​​along the channel direction and processed using group normalization GN; the spatial attention weight is calculated using the Sigmoid activation function and ; Finally, the spatial attention weights are used to enhance the feature map Weighting is performed to enhance the features of key areas:

[0086]

[0087]

[0088] X s =Attn H ×Attn W ×F E

[0089] in, Represents the Sigmoid activation function operation, and denotes K groups of normalized GN operations along the horizontal and vertical directions, respectively. Represents the final output of the shared multi-semantic spatial attention module.

[0090] like Figure 7 As shown in the figure, the calculation process of progressive channel attention includes: first, the feature map after shared multi-semantic space attention processing Perform global average pooling operation and obtain the downsampled feature map after downsampling , in order to reduce the computational complexity while aggregating local features and improving the receptive field:

[0091]

[0092] Among them, B represents the batch size, C represents the number of input channels, H and W represent feature maps The height and width of and Representation feature map The height and width of represents a pooling operation with a kernel size of 7×7;

[0093] Then, the downsampled feature map Perform group normalization GN processing, then use 1×1 depth convolution to generate three sets of corresponding values, and then input the three sets of values ​​into the channel-based attention to calculate the attention weights , use global average pooling and Sigmoid activation to generate channel weights; finally, the channel weights are combined with Weighted, improve the network's perception ability, and obtain the spatial channel collaborative attention feature map :

[0094]

[0095] Among them, B represents the batch size, C represents the number of input channels, H and W represent the height and width of the feature map, represents the global average pooling operation, It represents the final output of the progressive channel attention and also the final output of the coordinated attention of the entire spatial channel.

[0096] S4.4, through the second Ghost module to the spatial channel collaborative attention feature map Compress the number of channels to obtain fusion features , the multi-scale feature map With the fusion feature Add together to obtain a high-level semantic feature map .

[0097] According to the above embodiment, further, the neural network training parameters are set: batch size 32, number of iterations 1200, initial learning rate 0.01, cross entropy loss function is used and stochastic gradient descent algorithm SGD is adopted as the optimizer of the network, the learning rate adopts fixed epoch decay, the learning rate is halved every 300 epochs, the momentum coefficient is 0.9, and the weight decay coefficient is 5e-4.

[0098] like Figure 8As shown in the figure, in order to intuitively explain the results of various fault diagnosis, a confusion matrix is ​​drawn. The horizontal axis represents the classification result, and the vertical axis represents the actual fault category. The data set size is 5400 time-frequency graphs, with a total of 17 types of typical roller faults and 1 intact roller as reference, which are divided into training set and test set in a ratio of 7:3. Figure 8 It can be seen that the above embodiments of the present invention realize belt conveyor roller fault detection and improve the accuracy and reliability of fault detection.

[0099] like Fig. 9 As shown, according to another embodiment of the present invention, a belt conveyor roller fault sound detection system 900 is also disclosed, including: a memory 901, used to store program instructions; a processor 902, used to call the program instructions stored in the memory to implement the belt conveyor roller fault sound detection method as described in the above embodiment.

[0100] In summary, the present invention uses distributed auscultation optical fiber or microphone array to collect sound signals when the belt conveyor roller is running, and captures the spatial distribution and phase characteristics of the sound signal; uses short-time Fourier transform to obtain the time-frequency domain feature map of the sound signal, and improves the ability to express fault characteristics; inputs the time-frequency domain feature map into a multi-scale convolution module composed of a multi-scale convolution parallel structure to obtain a multi-scale feature map containing multi-scale information, and at the same time improves the model's ability to capture features of different scales; inputs the multi-scale feature map into a Ghost bottleneck module composed of a Ghost module, a deep convolution layer, and a spatial channel collaborative attention module to perform a deeper fault feature mapping of the spatial dimension and the channel dimension, obtain a high-level semantic feature map, and improve the accuracy of model fault recognition; inputs the high-level semantic feature map into the classifier module to output the number of categories, and uses the cross entropy loss function and the re-parameterization training method to complete the model training; performs short-time Fourier transform on the sound signal to be detected and inputs it into the trained model to determine whether the roller has a fault. Thus, a more accurate and intelligent fault detection solution is achieved.

[0101] All or part of the steps in the various methods of the above embodiments can be completed by controlling the relevant hardware through a program, and the program can be stored in a readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other readable medium that can be used to carry or store data.

[0102] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A belt conveyor roller fault sound detection method, characterized in that: include: Signal collection: collect the sound signals of belt conveyor rollers when they are running; Time-frequency domain transformation: performing short-time Fourier transform on the sound signal to obtain a time-frequency domain feature map X of the sound signal; Multi-scale feature extraction: extract features from the time-frequency domain feature map X through multiple convolutional layers of different sizes to obtain feature maps of multiple scales. , the feature map Splicing is performed on the channel dimension to obtain a multi-scale feature map ; High-level semantic extraction: The multi-scale feature map The first Ghost module, deep convolution layer, spatial channel collaborative attention module and the second Ghost module are used to perform deeper fault feature mapping in spatial and channel dimensions to obtain a high-level semantic feature map. ; Feature classification: The high-level semantic feature map Input into the classifier module to obtain the classification result, and use the cross entropy loss function and reparameterization training method to complete the model training and obtain the fault detection model; Fault detection: After performing short-time Fourier transform on the sound signal to be detected, it is input into the trained fault detection model to obtain the fault diagnosis result.

2. The belt conveyor roller fault sound detection method according to claim 1 is characterized in that: The step of time-frequency domain transformation specifically includes: Perform a short-time Fourier transform on the one-dimensional sound signal to obtain a two-dimensional time-frequency domain feature map X. The time-frequency domain feature map X is input as a fault sample into a subsequent fault detection model for analysis. The calculation process of the short-time Fourier transform includes: in, is the window function, is the input signal, express In time and frequency The window function is a Hamming window, the window size is set to 2048, and the step size is set to 512.

3. The belt conveyor roller fault sound detection method according to claim 1, characterized in that: The step of extracting multi-scale features specifically includes: The time-frequency domain feature map X passes through a 3×3 convolution layer, a 5×5 convolution layer, and a 7×7 convolution layer in parallel, and the number of output channels of each convolution layer is 16; The output feature map after the i-th convolutional layer is recorded as , then Splicing is performed on the channel dimension to obtain a fused multi-scale feature map .

4. The belt conveyor roller fault sound detection method according to claim 1, characterized in that: The step of extracting high-level semantics specifically includes: The multi-scale feature map Enter the residual connection branch and the first Ghost module respectively, and the first Ghost module performs an operation on the multi-scale feature map Perform channel expansion and preliminary feature extraction to obtain a compact feature map ; The compact feature map Enter the deep convolution layer to further extract local features and obtain enhanced feature maps ; The enhanced feature map Enter the spatial channel collaborative attention module, based on the synergy of spatial attention and channel attention, strengthen the network's attention to important features, improve feature expression capabilities, and obtain the spatial channel collaborative attention feature map ; The second Ghost module coordinates the attention feature map of the spatial channel Compress the number of channels to obtain fusion features ; The multi-scale feature map With the fusion feature Add together to obtain a high-level semantic feature map .

5. The belt conveyor roller fault sound detection method according to claim 4, characterized in that: The calculation process of the spatial channel collaborative attention module specifically includes: the spatial channel collaborative attention consists of two parts: shared multi-semantic spatial attention and progressive channel attention; The calculation process of the shared multi-semantic spatial attention includes: The enhanced feature map Perform global average pooling along the height and width dimensions to obtain two unidirectional one-dimensional sequences; Decompose the two one-dimensional sequences separately to obtain four sub-features of the same size; Use 4 one-dimensional deep shared convolutions to extract features from each sub-feature and obtain the sub-feature spatial structure information; The sub-feature spatial structure information is concatenated along the channel direction, group normalization is performed, and the spatial attention weight is calculated by the Sigmoid activation function; The enhanced feature map is enhanced using spatial attention weights Weighted, we get a shared multi-semantic spatial attention feature map ; The calculation process of the progressive channel attention includes: For the shared multi-semantic spatial attention feature map Perform global average pooling operation and obtain the downsampled feature map after downsampling; Performing group normalization on the downsampled feature map, and then generating three sets of corresponding values ​​using 1×1 depthwise convolution; Input the three sets of values ​​into the channel-wise attention to calculate the attention weights, and use global average pooling and sigmoid activation to generate channel weights; The shared multi-semantic spatial attention feature map is Weighted, we get the spatial channel collaborative attention feature map .

6. The belt conveyor roller fault sound detection method according to claim 4, characterized in that: The calculation process of the first Ghost module or the second Ghost module specifically includes: The input feature map generates the main branch feature through 1×1 main branch convolution ; The main branch features are processed using 3×3 depth convolution Perform cheap operations and generate redundant features ; The main branch feature and the redundant features The concatenation is performed in the channel dimension to obtain the final output of the Ghost module.

7. The belt conveyor roller fault sound detection method according to claim 4, characterized in that: Enhanced feature map The calculation process includes: The compact feature map Input into the deep convolution layer, the calculation process of the deep convolution layer is expressed as: Among them, K represents the depth convolution kernel size, Represented in the enhanced feature map The value of the Cth channel position (i, j) in, represents the weight of the depth convolution kernel of the Cth channel at position (m,n), Represents a compact feature map The value of the Cth channel after downsampling with a step size of S.

8. The belt conveyor roller fault sound detection method according to any one of claims 1 to 7, characterized in that: The signal acquisition step specifically includes: The sound signal is collected using a distributed auscultation optical fiber or a microphone array.

9. A belt conveyor roller fault sound detection system, characterized in that: include: A memory for storing program instructions; A processor is used to call the program instructions stored in the memory to implement the belt conveyor roller fault sound detection method as described in any one of claims 1 to 8.

Images