Fault diagnosis method, system and equipment for wind power gear box and medium

Abstract

The invention discloses a fault diagnosis method, system, equipment and medium for a wind power gear box, and relates to the technical field of fault detection, and the method comprises the steps: collecting a vibration signal of the wind power gear box, and obtaining a time-frequency diagram of the vibration signal; capsule feature tensors in the time-frequency graph are obtained, a time-frequency two-dimensional network is formed in space, and corresponding query tensors are extracted from a time axis and a frequency axis of the time-frequency two-dimensional network by adopting different convolution kernels; dot product matching is carried out on the corresponding query tensors and a preset shared key value pair, attention distribution of each query tensor is obtained, and aggregation output in the directions of the time axis and the frequency axis is fused through the attention distribution; and performing class activation mapping on the aggregated output, determining a fault category of the wind power gear box, generating a class activation graph focused on the key time-frequency region through the fault category, and displaying a discrimination basis. The method can focus on a key time-frequency region with clear physical significance, and obviously improves the discrimination transparency and engineering credibility of the model.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of fault detection, in particular to a wind turbine gearbox fault diagnosis method, system, device and medium. BACKGROUND

[0002] Rotating machinery as the core power component in industrial systems, its running state is directly related to the performance and safety of production. In the long-term operation process, affected by fatigue damage, external disturbance and working condition change and other factors, often appear all kinds of structure damage or function degradation. Therefore, the development of intelligent fault diagnosis method with high precision and strong robustness is very important to improve the running safety of rotating machinery and reduce the cost of the whole industry. At the same time, in order to enhance its decision transparency and credibility, in recent years, the explainability of intelligent fault diagnosis is also put forward higher requirements.

[0003] With the rapid development of deep learning and visual intelligence technology, researchers have begun to explore the conversion of vibration signals into image form to capture key features in the signal in a more intuitive way and achieve efficient recognition with the help of deep neural networks. This strategy has gradually become an important research direction in the field of intelligent fault diagnosis, which to some extent overcomes the modeling limitations of traditional time and frequency domain methods under complex working conditions. Chen et al. proposed a novel rotating machinery fault diagnosis method based on dual-channel homologous information fusion bispectrum analysis, which can comprehensively extract nonlinear phase coupling features in vibration signals. Liu et al. proposed a fault diagnosis method for rolling bearings under variable speed conditions, which converts vibration signals into two-dimensional gray images and extracts texture features through a gray level co-occurrence matrix, combined with a dual-channel convolutional neural network to achieve fault recognition. Wang et al. proposed a gearbox fault diagnosis method combining Markov transform field and graph neural network, which converts vibration signals into two-dimensional images that preserve time correlation, and introduces the GCN-GAT model to achieve efficient recognition of non-Euclidean structure data, showing superior robustness under strong noise and variable load conditions. Tong et al. proposed a novel rolling bearing fault diagnosis method, which encodes vibration signals into Markov transform field (MTF) images with time dependence, and combines a hybrid attention residual network (MARN) to enhance feature expression capability. Liu et al. proposed a fault diagnosis framework for rolling bearings under variable speed conditions, which converts one-dimensional vibration signals into two-dimensional gray images adaptively, extracts texture features through a gray level co-occurrence matrix (GLCM), and uses a dual-channel convolutional neural network (DCCNN) for classification and recognition. Chen et al. proposed a robust rolling bearing fault diagnosis framework, which converts one-dimensional vibration signals into two-dimensional color recurrent graphs, and combines CNN, BiGRU and multi-head attention mechanism to build a fusion neural network model, achieving joint extraction of spatial and temporal features and high-precision recognition in a strong noise environment. He et al. proposed a rolling bearing fault diagnosis method, which converts one-dimensional vibration signals into two-dimensional gray images and uses a Wasserstein generative adversarial network (WGAN) to generate high-quality fault data under sample imbalance conditions, improving classification performance through a convolutional neural network with good noise robustness. Wang et al. proposed a novel rolling bearing fault diagnosis method that uses a time-frequency symmetric dot plot (TFSDP) to convert vibration signals into two-dimensional images, combines a CNN-based multi-scale feature extraction module and a Transformer network structure to achieve deep mining of global features and improve model interpretability under cross-condition fault.

[0004] Figure 1The visualization results of multiple typical two-dimensional representations of time sequence signals under the same fault sample are shown. Among them, the time-frequency diagram, as a two-dimensional representation that integrates time information and frequency components, can effectively depict the transient impact, frequency modulation, and local energy concentration in the fault signal, and is widely used in convolutional neural network (CNN) and transformer structure (Transformer) driven diagnostic frameworks. Li et al. proposed an intelligent fault diagnosis method for permanent magnet synchronous motors based on mechanism modeling, which combines continuous wavelet transform and convolutional neural network to convert current signals into time-frequency images, thereby extracting the feature patterns of stator inter-turn short circuit and demagnetization faults. Chen et al. proposed an intelligent fault diagnosis framework for rolling bearings under strong noise and cross-condition environment, which combines SFLA optimized variational mode extraction (SFLA-VME) and continuous wavelet transform (CWT) to generate two-dimensional time-frequency diagrams, and introduces a deformable large kernel attention mechanism (DLKA) in the YOLOv8 framework, which significantly enhances the recognition ability of multi-scale fault features. Ding et al. proposed a novel time-frequency transformer (TFT) structure for rolling bearing fault diagnosis, which converts vibration signals into time-frequency diagrams generated by synchronous wavelet transform (SWT), and performs feature extraction and classification through an end-to-end self-attention encoder, showing excellent diagnostic accuracy under multiple conditions and noise disturbances. Zhang et al. proposed an improved convolutional neural network framework for rolling bearing fault diagnosis, which converts vibration signals into time-frequency images through short-time Fourier transform (STFT), and introduces a self-normalized activation function (SELU) and a hierarchical regularization strategy, effectively alleviating problems such as overfitting and "dead neurons".

[0005] Although the above methods have achieved certain results in feature extraction and fault recognition accuracy, however, most existing image-based fault diagnosis methods still mainly rely on global modeling strategies, making it difficult to fully exploit the local structural features along the time axis and frequency axis in the time-frequency diagram, and in the feature extraction process, common convolution operations or self-attention mechanisms are often affected by the scene, making it difficult for the model to accurately identify local abnormal regions, reducing the perception ability of key diagnostic features. SUMMARY

[0006] The present application aims to solve the problems of the prior art by providing a fault diagnosis method, system, device and medium for wind power gearboxes.

[0007] The present application specifically provides the following technical solutions: A fault diagnosis method for a wind power gearbox, comprising the following steps: Collecting the vibration signal of the wind power gearbox and obtaining the time-frequency diagram of the vibration signal; Obtaining a capsule feature tensor in the time-frequency graph, constructing a time-frequency two-dimensional network in space, and using different convolution kernels to extract corresponding query tensors in the time axis and the frequency axis of the time-frequency two-dimensional network; Dot product matching the corresponding query tensors with the preset shared key-value pairs respectively to obtain the attention distribution of each query tensor, and fusing the time axis and the frequency axis direction aggregation output through the attention distribution; Performing class activation mapping on the aggregation output to determine the fault category of the wind turbine gearbox, and generating a class activation map focusing on the key time-frequency area through the fault category to show the basis for discrimination.

[0008] Preferably, the time-frequency graph is diagnosed by a pre-trained diagnostic model to generate a class activation map, wherein the diagnostic model comprises: a primary capsule layer, a double-axis sparse attention routing module, a fully connected layer and a class activation mapping layer connected in turn; wherein the double-axis sparse attention routing module comprises a time axis and a frequency axis connected in parallel, and a fusion layer connected subsequently, each axis comprises an axis direction attention layer, and the fusion layer comprises a summation and compression layer and a multilayer perception layer.

[0009] Preferably, before the time-frequency graph is diagnosed by the pre-trained diagnostic model, the method further comprises: For the generated class activation map, a frequency prior mask of the class activation map is obtained, the average response intensity of the mask area is calculated through the frequency prior mask, and the average response intensity is used to define a prior semantic guidance loss; the class activation map is averaged along the frequency axis to obtain the average response in the time dimension, the average response in the time dimension is quantified for sparsity, and a target sparsity is set for each fault category, the difference between the average response in the time dimension after sparsity quantification and the target sparsity is squared to define a sparse activation constraint loss, and a classification loss is calculated based on the classification output of the fault category; The prior semantic guidance loss and the sparse activation constraint loss are used to impose spatial and temporal prior guidance on the class activation map respectively, and the diagnostic model parameters are optimized together with the classification loss to obtain the pre-trained diagnostic model.

[0010] Preferably, the capsule feature tensor in the time-frequency graph is obtained by: extracting features from the time-frequency graph through two convolution blocks in the primary capsule layer; wherein the convolution block is composed of two convolution layers with batch normalization and ReLU activation function; selecting a feature representation with direction perception ability through channel-by-channel convolution, and adjusting the output channel dimension to a preset capsule vector dimension through 1×1 convolution to construct a capsule feature tensor with spatial directionality and local sparsity.

[0011] Preferably, the corresponding query tensor is respectively matched with a preset shared key-value pair through dot product to obtain the attention distribution of each query tensor, specifically: In the two orthogonal directions of the row direction and the column direction, the row direction query tensor and the column direction query tensor are respectively generated from the input feature map in parallel, and the shared key tensor and the value tensor are scaled and dot product attention calculation is performed to obtain the row direction attention output and the column direction attention output.

[0012] The application provides a fault diagnosis system of a wind turbine gearbox, comprising: A data acquisition module is configured to collect a vibration signal of the wind turbine gearbox and acquire a time-frequency graph of the vibration signal. A vector generation module is configured to acquire a capsule feature tensor in the time-frequency graph, form a time-frequency two-dimensional network in space, and extract corresponding query tensors in the time axis and the frequency axis of the time-frequency two-dimensional network by using different convolution kernels. An aggregation module is configured to respectively match the corresponding query tensors with preset shared key-value pairs through dot product to obtain the attention distribution of each query tensor, and fuse the aggregation outputs in the time axis and the frequency axis directions through the attention distribution. A discrimination module is configured to perform class activation mapping on the aggregation outputs, determine the fault category of the wind turbine gearbox, generate a class activation map focused on a key time-frequency region through the fault category, and display the discrimination basis.

[0013] The application provides a computer device comprising a memory and a processor, wherein the memory stores a program, and the program is executed by the processor to make the processor execute the steps of the above-mentioned fault diagnosis method of the wind turbine gearbox.

[0014] The application provides a storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the steps of the above-mentioned fault diagnosis method of the wind turbine gearbox.

[0015] Compared with the prior art, the application has the following advantages: The application obtains a time-frequency graph of a wind power gear box vibration signal, obtains a capsule feature tensor of the time-frequency graph, constructs a time-frequency two-dimensional network, adopts different convolution kernels, extracts corresponding query tensors on the time axis and the frequency axis of the time-frequency two-dimensional network, respectively performs dot product matching on the corresponding query tensors and a preset shared key-value pair, obtains the attention distribution of each query tensor, improves the modeling efficiency and direction sensitivity in the two-dimensional feature graph, and fuses the aggregation output in the time axis and the frequency axis direction through the attention distribution, realizes the effect of constructing a sparse routing channel of a capsule unit on the time axis and the frequency axis respectively, enhances the perception ability of the model to the anisotropic local structure features in the complex time-frequency graph, can accurately identify the local abnormal area, improves the perception ability to the key diagnostic features, maps the aggregation output to a class activation, determines the fault class and the class activation map of the wind power gear box, the method can focus on the key time-frequency area with clear physical meaning, and significantly improves the discrimination transparency and engineering credibility of the model. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 The visual results of various typical two-dimensional representations of time series signals in the background art under the same fault sample are provided; wherein Figure 1 (a) of is a CWT graph, Figure 1 (b) of is a Bispec graph, Figure 1 (c) of is a Gray graph, Figure 1 (d) of is an MTF graph, Figure 1 (e) of is an RP graph, Figure 1 (f) of is a GADF graph; Figure 2 The various dependent structure diagrams provided by the application are provided; wherein Figure 2 (a) of is an axial attention, Figure 2 (b) of is a double-axis sparse attention routing mechanism, Figure 3 The structural diagram of the application is provided; Figure 4 A physical diagram mentioned in an embodiment of the application is provided; Figure 5 The time-frequency graphs of various fault states after time-frequency transformation of the application are provided; wherein Figure 5 (a1)-(a7) in (a) of are the time-frequency graphs of various fault states under label 0, Figure 5 (b1)-(b7) in (b) of are the time-frequency graphs of various fault states under label 1, Figure 5 (c1)-(c7) in (c) of are the time-frequency graphs of various fault states under label 2, Figure 5 (d1)-(d7) in (d) of are the time-frequency graphs of various fault states under label 3, Figure 5 (e1)-(e7) in (e) of are the time-frequency graphs of various fault states under label 4; Figure 6 diagnostic example graphs provided by the present application; wherein Figure 6 (a) of the (a) is a diagnostic example graph under label 0, Figure 6 (b) of the (b) is a diagnostic example graph under label 1, Figure 6 (c) of the (c) is a diagnostic example graph under label 2, Figure 6 (d) of the (d) is a diagnostic example graph under label 3, Figure 6 (e) of the (e) is a diagnostic example graph under label 4; wherein Figure 6 (a1)~(e1) in the (a1)~(e1) are input graphs under different labels, Figure 6 (a2)~(e2) in the (a2)~(e2) are diagnostic example graphs provided by the present method DASECaps, Figure 6 (a3)~(e3) of the (a3)~(e3) are diagnostic example graphs provided by the ablation model; Figure 7 a prediction result graph provided by the present application; Figure 8 a flowchart of a fault diagnosis method for a wind turbine gearbox provided by the present application. DETAILED DESCRIPTION

[0017] The technical solutions of the embodiments of the present application will be described in detail below with reference to the drawings of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor shall fall within the scope of protection of the present application.

[0018] Time-frequency graphs are widely used in fault detection and classification tasks based on deep learning because of their dual representation capabilities for short-time energy changes and frequency response characteristics in non-stationary vibration signals. However, existing methods mostly rely on global modeling, which is difficult to effectively capture the structural features contained in the axial distribution, and generally lack the support of explainability in the decision-making process. Moreover, there is generally a lack of explicit mechanism in explainability, and the model decision-making process is difficult to trace, and the diagnostic results lack transparency and credibility.

[0019] Based on the above problems, the present application proposes an interpretable fault diagnosis method DASECaps guided by time-frequency prior knowledge, and the specific contributions are as follows: 1. A dual-axis sparse attention routing module is designed to construct sparse routing channels of capsule units on the time axis and the frequency axis, enhancing the model's ability to capture anisotropic structural features in time-frequency graphs.

[0020] 2. The time-frequency prior knowledge guided interpretability loss function is defined, and the spatial distribution of the CAM activation map is guided by using the pre-defined prior semantic mask and sparsity, so as to promote the model to pay attention to the discriminative region consistent with the prior from the optimization target level, thereby realizing the directional enhancement of interpretability.

[0021] 3. The structural interpretability of the model is proved by the class activation map visualization experiment, and the effectiveness and credibility of the method in identifying and focusing on the key time-frequency region are further verified.

[0022] As shown in Figure 3 and Figure 8 , the present application proposes a fault diagnosis method for a wind turbine gearbox, which specifically comprises the following steps: Step S1: Collecting the vibration signal of the wind turbine gearbox and obtaining the time-frequency graph of the vibration signal.

[0023] The time-frequency graph is diagnosed by the pre-trained diagnosis model to generate a class activation map, as shown in steps S2, S3 and S4, wherein the diagnosis model comprises: a primary capsule layer, a dual-axis sparse attention routing module, a fully connected layer and a class activation mapping layer connected in sequence; wherein the dual-axis sparse attention routing module comprises a time axis and a frequency axis connected in parallel, and a fusion layer connected subsequently, each axis comprises an axial attention layer, and the fusion layer comprises a summation and compression layer and a multilayer perception layer.

[0024] Capsule Network: Capsule Network was proposed by Hinton et al. in 2017, aiming to solve the problem that convolutional neural network is difficult to model spatial hierarchical relationship and pose change, and to improve the robustness of the model to local structure combination and geometric transformation. It is a neural network structure taking vector as the basic information unit, which can more structurally express the hierarchical dependence between "part-whole". Unlike the traditional convolutional network output scalar activation, the capsule unit outputs a vector , wherein the vector norm represents the mode existence probability, the direction encodes the position, the pose, the scaling and other attribute information.

[0025] In order to realize the selective aggregation between features, the capsule network introduces a dynamic routing mechanism (Dynamic Routing), which predicts and weightedly aggregates the high-level capsule vector by the low-level capsule vector: ; ; wherein, is a learnable projection matrix, is a dynamically updated coupling coefficient, is the input of the high-level capsule vector, high-level capsule vector, low-level capsule vector, index variable number of the current layer.

[0026] Finally, the high-level capsule vector output is compressed to the unit sphere by a squash activation function , which controls the vector norm while preserving the directional information: ; Axial attention: Axial attention mechanism is a variant of self-attention, aiming to improve the modeling efficiency and direction sensitivity in two-dimensional feature maps, especially to solve the problem of high computational complexity of standard self-attention in high-resolution images. As shown in Fig. Figure 2 (a), unlike the standard self-attention mechanism that establishes global relationships in the spatial dimension, axial attention decomposes the two-dimensional attention operation into two one-dimensional processes, modeling the dependency structure between features along the horizontal and vertical directions (columns and rows), respectively.

[0027] Specifically, let the input feature map be When performing row direction attention, each row is calculated as follows: ; where represents the h-th row tensor in the input feature map, with a shape of , C is the number of channels, , and are the linear mapping parameter matrices of the query, key, and value, respectively, with a shape of . To facilitate subsequent multiplication with the linear projection matrix, the dimension of needs to be changed from to , , and represent the query, key, and value tensors corresponding to the h-th row, respectively, with a shape of h , d is the feature dimension after projection. The attention output

[0028] is: ; where is used to scale the dot product result of the attention weight to alleviate the problem of gradient instability caused by excessive numerical values.

[0029] After repeating the process for all rows, column attention is performed to complete the directional modeling of the entire image.

[0030] Double-axis sparse attention routing module:​ To effectively model the directionally characteristic distribution in the time-frequency map, a double-axis sparse attention routing is designed based on the vector representation of the capsule network. Figure 1 As shown in (b) of FIG. 1, by constructing the attention path in the time axis and the frequency axis respectively, the model's ability to capture directional features is enhanced.

[0031] Step S2: Obtain the capsule feature tensor in the time-frequency map, construct a time-frequency two-dimensional network in space, and use different convolution kernels to extract the corresponding query tensor in the time axis and the frequency axis of the time-frequency two-dimensional network.

[0032] Specifically, the input capsule feature tensor constitutes a time-frequency two-dimensional network in space, each position is a dimensional capsule vector, and the batch size is N. In order to model the connection weight along two orthogonal axes respectively, (3, 1) and (1, 3) convolution kernels are used to construct local perception paths in the time axis and the frequency axis respectively, and the corresponding query tensors and are extracted. This design ensures that the feature aggregation of each direction only depends on its own physical neighborhood, avoiding cross-axis aliasing.

[0033] wherein the capsule feature tensor in the time-frequency map is obtained, comprising: The time-frequency map is feature-extracted by two convolution blocks in the primary capsule layer; wherein the convolution block is composed of two convolution layers with batch normalization and ReLU activation function.

[0034] The feature representation with direction perception ability is selected by the channel-by-channel convolution, and the output channel dimension is adjusted to the preset capsule vector dimension by the 1x1 convolution, thereby constituting the capsule feature tensor with spatial directionality and local sparsity.

[0035] Step S3: The corresponding query tensor is dot product matched with the preset shared key-value pair respectively, to obtain the attention distribution of each query tensor, and the aggregation output in the time axis and the frequency axis direction is fused through the attention distribution.

[0036] In the two orthogonal directions of the row direction and the column direction, the row direction query tensor and the column direction query tensor are generated from the input feature map respectively in parallel, and the scaling dot product attention calculation is performed with the shared key tensor and the value tensor, to obtain the row direction attention output and the column direction attention output. That is, the query tensors in the two directions are dot product matched with the preset shared key-value pair to obtain the attention distribution and of different tensors:

[0037] (5); (6); The entmax activation function is used to implement a selective connection mechanism between parent and child capsules, similar to that in capsule networks. By constructing a sparse attention distribution, it guides lower-level capsules to connect more focusedly to structurally related higher-level capsules, thereby improving local aggregation capabilities.

[0038] Fusion output from two directions The feature representation is then subjected to squash activation and subsequently fed into a feedforward network (MLP) for nonlinear transformation to obtain the final feature representation. : (7); (8); If the above process is repeated multiple times and residual connections are added, an iterative structure with routing capabilities can be constructed, and its recursive form can be simplified as follows: (9); (10); in, This describes the biaxial attention aggregation calculation process in formulas (5), (6), and (7). This is the intermediate value after aggregation. For the first The characteristic representation of the step.

[0039] Step S4: Perform class activation mapping on the aggregated output to determine the fault category of the wind turbine gearbox, and generate a class activation map focusing on key time and frequency regions based on the fault category to show the discrimination criteria.

[0040] Before performing fault diagnosis on the time-frequency graph using the pre-trained diagnostic model, the following steps are also included: For the generated class activation map, the frequency prior mask of the class activation map is obtained, and the average response intensity of the masked region is calculated through the frequency prior mask. The prior semantic guidance loss is defined by the average response intensity. The class activation map is averaged along the frequency axis to obtain the average response in the time dimension. The average response in the time dimension is quantized for sparsity, and a target sparsity is set for each fault category. The sparse activation constraint loss is defined by the square of the difference between the quantized average response in the time dimension and the target sparsity. The classification loss is calculated based on the classification output of the fault category.

[0041] By applying spatial and temporal prior guidance to the class activation graph through prior semantic guidance loss and sparse activation constraint loss, and combining it with classification loss to jointly optimize the diagnostic model parameters, a pre-trained diagnostic model is obtained.

[0042] wherein the time-frequency prior knowledge guided interpretative loss function is specifically The time-frequency prior knowledge guided interpretative loss function is used for constraining the consistency between the response region of the class activation map and the time-frequency feature with diagnostic significance. Specifically, the loss guides the model to generate an activation pattern that conforms to the physical prior in two aspects: (1) prior semantic guidance: based on the frequency prior mask, the class activation map is encouraged to focus on the high response region of the corresponding fault mode in the time-frequency map in the spatial domain, so as to enhance the attention ability of the model to the discriminative feature; (2) sparse activation constraint: by quantifying the sparsity of the average activation intensity of the class activation map along the frequency axis in the time dimension, the model is guided to present a response distribution that conforms to the actual fault signal feature in the time dimension, so as to be compatible with different fault performances such as transient impact type and continuous modulation type.

[0043] Prior semantic guidance loss: In the time-frequency map, a specific frequency interval usually corresponds to typical fault features such as burst impact, modulation harmonic or structural resonance, which is a significant mode region with physical meaning. Although these regions appear as high response blocks in the spatial domain of the two-dimensional time-frequency map, they essentially correspond to local structural distribution on the frequency axis. Therefore, the present application introduces a prior semantic guidance loss function, which aims to guide the model to generate a class activation map that accurately focuses on these frequency structure prior regions in the spatial domain, thereby improving the response selectivity and physical consistency of the model.

[0044] Let the class activation map generated by the model be , the frequency prior mask be , and the average response intensity of the mask region be , which is defined as: ; wherein is a numerical stability term, respectively represent the index variable number of the spatial position. In order to make the model maintain high response to the region, the prior semantic guidance loss is defined as:

[0045] ; Sparse activation constraint loss: The response characteristics of different types of faults on the time axis are significantly different. For example, the broken tooth fault usually shows a transient impact, and its energy distribution is sparse and concentrated; while the wear or modulation fault has a continuous response mode, and its energy distribution is relatively smooth and continuous. Therefore, the model should have the ability to distinguish different time sparse patterns to more accurately identify the potential fault type. Therefore, the present application designs a sparse activation constraint loss based on the class activation map (CAM) output, which is used to constrain the distribution characteristics of the activation response generated by the model in the time dimension, so as to be consistent with the prior sparsity of each category.

[0046] Specifically, let the activation map of the model output be , first average it along the frequency axis to obtain the average activation intensity in the time dimension , the specific expression is: ; Then, the sparsity of is quantified based on the Gini coefficient, defined as: ; Where is the th element in ascending order of value, is a numerical stability term. The higher the Gini value, the more sparse the time response; the lower, the more smooth the response.

[0047] Pre-specify the target sparsity for each fault category , and finally define the sparse activation constraint loss as: ; Running process: As shown in Figure 6 , this is a diagnosis example of wind turbine gearbox under five fault conditions. Figure 6 It can be further summarized as follows:

[0048] 1) Signal acquisition and sample division: collect vibration signals from the experimental platform, use continuous wavelet transform to convert them into time-frequency maps, and then divide the samples for training, validation and testing.

[0049] 2) Prior knowledge definition: based on the performance characteristics of each typical fault in the time-frequency map, construct a structure mask and set the time sparsity prior of the corresponding category.

[0050] 3) Network training: embed the interpretive loss function guided by the time-frequency prior knowledge, jointly optimize with the classification loss, and guide the model to learn a structure-consistent activation distribution in both spatial and temporal dimensions.

[0051] 4) Inference and result analysis: use the trained DASECaps to diagnose the test samples, and analyze the model focus area through class activation map visualization to verify its diagnostic accuracy and interpretability.

[0052] The first study is to test the adaptability of this method in a noisy environment using a planetary gearbox dataset.

[0053] The running environment is as follows: PyTorch 2.1.0; GPU is RTX 4060; CPU is i5-12600kf. The planetary gearbox dataset of Beijing University of Technology wind power transmission system test bench, test platform and five health conditions are shown in Figure 4 The experimental platform is composed of a motor, a planetary gearbox, a fixed shaft gearbox and a load device. The dataset contains vibration signals corresponding to five health conditions of the sun gear. The internal structure of the gearbox is shown in Figure 4 The vibration data is collected by acceleration sensors, and the speed pulse signal is obtained by cooperating with the encoder. The sampling frequency of all channels is set to 48 kHz.

[0054] The signal is divided into 3000-point sample segments by the sliding window method, and then converted into time-frequency diagram by continuous wavelet transform. Figure 5 The time-frequency diagrams of each fault condition after time-frequency transformation are shown. It is obvious that the image data generated for each fault condition shows certain differences in time-frequency structure features. For each health condition, 300 samples are selected, a total of 1500 samples, and the dataset is divided into training set, validation set and test set in the ratio of 5:3:4. In order to simulate the working conditions of mechanical equipment in real environment and verify the performance of the proposed model under strong noise, noise with signal-to-noise ratio of 10dB, 5dB and 0dB is added in the samples. In addition, the initial experiment without adding signal-to-noise ratio is carried out.

[0055] In order to reduce randomness, each experiment is repeated five times. Each training is performed for 100 iterations, with a batch size of 32 and a learning rate using an adaptive decay mode. The initial learning rate of each method is set by using a grid search method based on the accuracy of the validation set.

[0056] Table 1 shows the diagnostic accuracy results of each model under different noise conditions. From the table, it can be seen that as the signal-to-noise ratio decreases, the performance of each model decreases. However, the proposed DASECaps always maintains superior performance under each signal-to-noise ratio condition. In the noise-free and 10dB noise conditions, the average accuracy of DASECaps reaches 99.04% and 96.88% respectively, both slightly higher than CapsNet and ResNet18. In 5dB noise, DASECaps still maintains an average accuracy of 81.64%, significantly better than CapsNet (74.64%) and ResNet18 (61.56%), showing strong robustness. When the signal-to-noise ratio is further reduced to 0dB, the performance of all models decreases significantly, but the average accuracy of DASECaps (53.60%) is still higher than that of the comparative models, with a maximum accuracy of 62.20%, showing better anti-interference ability under extreme noise interference.

[0057] Table 1 diagnostic results Figure 7 The model is shown in the 5dB condition, the classification confusion matrix results on each category. From the results, the model performs best on class 0 and class 1, achieving 100% and 92% accurate classification, respectively, indicating that the method can effectively identify the feature clear, distribution of fault mode. In class 2 and class 4, the model also achieved good recognition performance, the accuracy rate reached 74% and 82% respectively, but some samples exist confusion phenomenon, mainly misclassified as adjacent categories, which may be related to the time-frequency features of these faults exist certain overlap. For class 3, the accuracy is 66%, the performance is relatively weak, and there is more confusion with class 0 and class 1, indicating that the feature mode of this class of faults has stronger similarity or feature boundary blur with other classes. Overall, the model shows strong discriminant ability in most categories, but there is still room for improvement in distinguishing complex or boundary fuzzy fault patterns.

[0058] Figure 6 The class activation map visualization results of each category sample under DASECaps and ablation model are shown in the figure. From the figure, it can be seen that DASECaps can focus on the key time-frequency area in the input graph that is highly related to the fault mode, and its activation area is significantly coincident with the high-energy structural features of the input graph, showing strong structural consistency and physical interpretability. The activation map of DASECaps in different categories can accurately cover the main discriminative feature band in the time-frequency graph. The activation map of the ablation model shows that the attention area is relatively discrete and the focusing ability is weak, and the activation area deviates from the key structure, which is difficult to effectively indicate the fault-related features. Overall, the activation pattern of DASECaps in each category is more focused on the physical key area, verifying the effectiveness of the proposed method in enhancing the discriminant ability and interpretability of the model.

[0059] The present application aims at the shortcomings of existing time-frequency graph fault diagnosis methods in feature extraction and decision interpretability, and proposes an interpretable fault diagnosis method guided by structural prior information. Specifically, a dual-axis sparse attention routing module is designed to enhance the model's perception of anisotropic local structural features in the time-frequency graph, and an explanation loss function guided by time-frequency prior knowledge is defined to spatially and temporally constrain the class activation map from the optimization target level. A case is used to verify that the proposed method has superior diagnostic accuracy, strong robustness and good interpretability under multiple noise conditions. The activation map visualization results further prove that the method can focus on the key time-frequency area with clear physical meaning, significantly improving the discriminant transparency and engineering credibility of the model.

[0060] Based on the above method, the application provides a fault diagnosis system of a wind power gear box, comprising a data acquisition module, a vector generation module, an aggregation module and a discrimination module.

[0061] The data acquisition module is used for collecting vibration signals of the wind power gear box and converting the vibration signals into a time-frequency graph by using continuous wavelet transform; the vector generation module is used for obtaining a capsule feature tensor in the time-frequency graph, constituting a time-frequency two-dimensional network in space, and extracting corresponding query tensors in a time axis and a frequency axis of the time-frequency two-dimensional network by using different convolution kernels; the aggregation module is used for performing dot product matching of the corresponding query tensors and a preset shared key-value pair respectively, obtaining an attention distribution of each query tensor, and fusing an aggregation output in a time axis direction and a frequency axis direction through the attention distribution; and the discrimination module is used for performing class activation mapping on the aggregation output, determining a fault category of the wind power gear box, and generating a class activation map focusing on a key time-frequency region through the fault category, and displaying a discrimination basis.

[0062] The application further provides a computer device comprising a memory and a processor, and the memory stores a program, and the program is executed by the processor to make the processor execute steps of a fault diagnosis method of a wind power gear box.

[0063] According to the disclosed embodiments, the computer device can communicate with one or more external devices (such as a keyboard, a pointing device, a Bluetooth communication, etc.), or communicate with any device (such as a router, a demodulator, etc.) that enables the computer device to communicate with one or more other computer devices.

[0064] The application further provides a storage medium having a computer program stored thereon, and the computer program is executed by the processor to implement steps of a fault diagnosis method of a wind power gear box.

[0065] According to the disclosed embodiments, the storage medium can be a non-volatile computer readable storage medium, which can include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the application, the storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, device or apparatus.

[0066] The above is a further detailed description of the application in combination with specific preferred embodiments, and for those skilled in the art, without departing from the concept of the application, a number of simple deductions or substitutions can also be made, which should be regarded as falling within the protection scope of the application.

Claims

1. A fault diagnosis method for a wind turbine gearbox, characterized in that, include: Vibration signals from wind turbine gearboxes were collected, and time-frequency diagrams of the vibration signals were obtained. Obtain the capsule feature tensor from the time-frequency map, construct a time-frequency two-dimensional network in space, and use different convolution kernels to extract the corresponding query tensor on the time axis and frequency axis of the time-frequency two-dimensional network; The corresponding query tensor is matched with the preset shared key-value pairs by dot product to obtain the attention distribution of each query tensor, and the aggregated output in the time axis and frequency axis is fused by the attention distribution. The aggregated output is subjected to class activation mapping to determine the fault category of the wind turbine gearbox, and a class activation map focusing on key time and frequency regions is generated based on the fault category to show the discrimination criteria.

2. The fault diagnosis method for a wind turbine gearbox as described in claim 1, characterized in that, Fault diagnosis is performed on the time-frequency graph using a pre-trained diagnostic model to generate a class activation map, wherein the diagnostic model includes: The system consists of a primary capsule layer, a dual-axis sparse attention routing module, a fully connected layer, and a class activation mapping layer, connected sequentially. The dual-axis sparse attention routing module includes a parallel time axis and a frequency axis, as well as a fusion layer connected subsequently. Each axis includes an axial attention layer, and the fusion layer includes a summation and compression layer and a multilayer perceptron layer.

3. The fault diagnosis method for a wind turbine gearbox as described in claim 2, characterized in that, Before performing fault diagnosis on the time-frequency graph using the pre-trained diagnostic model, the following steps are also included: For the generated class activation map, the frequency prior mask of the class activation map is obtained, and the average response intensity of the masked region is calculated through the frequency prior mask. The prior semantic guidance loss is defined by the average response intensity. The class activation map is averaged along the frequency axis to obtain the average response in the time dimension. The average response in the time dimension is quantized for sparsity, and a target sparsity is set for each fault category. The sparse activation constraint loss is defined by the square of the difference between the average response in the time dimension after sparsity quantization and the target sparsity. The classification loss is calculated based on the classification output of the fault category. By applying spatial and temporal prior guidance to the class activation graph through prior semantic guidance loss and sparse activation constraint loss, and combining it with classification loss to jointly optimize the diagnostic model parameters, a pre-trained diagnostic model is obtained.

4. The fault diagnosis method for a wind turbine gearbox as described in claim 2, characterized in that, The acquisition of the capsule feature tensor in the time-frequency graph includes: Feature extraction of the time-frequency map is performed using two convolutional blocks in the primary capsule layer; each convolutional block consists of two convolutional layers with batch normalization and ReLU activation functions. By selecting directional features through channel-wise convolution, and then adjusting the output channel dimension to the preset capsule vector dimension through 1×1 convolution, a capsule feature tensor with spatial directionality and local sparsity is formed.

5. The fault diagnosis method for a wind turbine gearbox as described in claim 1, characterized in that, The step of performing dot product matching between the corresponding query tensor and preset shared key-value pairs to obtain the attention distribution of each query tensor is as follows: In the two orthogonal directions of rows and columns, row query tensors and column query tensors are generated in parallel from the input feature map, and scaled dot product attention is calculated with the shared key tensor and value tensor to obtain row attention output and column attention output.

6. A fault diagnosis system for a wind turbine gearbox, characterized in that, include: The data acquisition module is used to collect vibration signals from the wind turbine gearbox and obtain the time-frequency diagram of the vibration signals. The vector generation module is used to obtain the capsule feature tensor in the time-frequency map, construct a time-frequency two-dimensional network in space, and use different convolution kernels to extract the corresponding query tensor on the time axis and frequency axis of the time-frequency two-dimensional network. The aggregation module is used to perform dot product matching between the corresponding query tensor and the preset shared key-value pairs to obtain the attention distribution of each query tensor, and then fuse the aggregation output in the time axis and frequency axis directions through the attention distribution; The discrimination module is used to perform class activation mapping on the aggregated output, determine the fault category of the wind turbine gearbox, and generate a class activation map focusing on key time and frequency regions based on the fault category to show the discrimination criteria.

7. A computer device, characterized in that, The device includes a memory and a processor, wherein the memory stores a program that, when executed by the processor, causes the processor to perform the steps of a fault diagnosis method for a wind turbine gearbox as described in any one of claims 1 to 5.

8. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the fault diagnosis method for a wind turbine gearbox according to any one of claims 1 to 5.

Images