A bearing anti-noise fault diagnosis method based on multi-cascade cross-dimension dynamic interaction Transformer

Abstract

The application discloses a bearing anti-noise fault diagnosis method based on a multi-cascade cross-dimension dynamic interaction Transformer, comprising the following steps: collecting bearing original vibration signals at different positions by using a sensor; performing data preprocessing, dividing the collected data into a training set, a verification set and a test set; performing feature extraction and conversion, and converting the data type into a quaternion to build an anti-noise bearing fault diagnosis model composed of a multi-cascade cross-dimension interaction ScConv module and a dynamic quaternion double-channel Transformer module; training based on the training set and the verification set, adjusting parameter configuration and model structure until an optimal model is obtained; verifying the model effect through the test set to obtain a fault classification result and evaluate the fault diagnosis performance. The method solves the problems of low recognition rate of a fault bearing in a strong noise environment, poor universality and low diagnosis precision of a traditional method.

Description

Technical Field

[0001] This invention relates to the field of bearing fault diagnosis technology, and in particular to a bearing noise-resistant fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer. Background Technology

[0002] In today's highly industrialized and modernized society, bearings, as an indispensable part of rotating machinery, directly affect the operation of the entire mechanical system and are of great significance to the safe operation of equipment. From ground transportation vehicles to aerospace equipment, from industrial manufacturing workshops to automated production lines, bearings always play a vital role. If the health condition of bearings is not assessed and diagnosed in a timely and effective manner, it can lead not only to equipment damage but also to serious safety accidents, causing huge economic losses and social impacts. Therefore, conducting efficient and reliable bearing fault diagnosis can effectively reduce economic losses caused by equipment damage and effectively prevent safety accidents, providing an important guarantee for industrial production safety.

[0003] Traditional fault diagnosis methods are mainly divided into two categories: signal processing methods and machine learning methods. In the field of signal processing, these methods possess good fault identification capabilities, but their effectiveness generally relies on high-quality signal input and struggles to handle complex fault modes, exhibiting significant limitations in real-world industrial scenarios. On one hand, noise interference in the production environment can mask key fault features, leading to decreased diagnostic accuracy. On the other hand, when faced with coupled multiple faults, traditional signal processing methods struggle to effectively separate interrelated fault features, significantly reducing diagnostic performance. In the field of machine learning, these methods extract features to build classification or regression models for fault identification, but they fail to fully mine the deep feature information within fault data, significantly impacting diagnostic performance.

[0004] To address these challenges, deep learning methods have emerged. Deep learning can spontaneously extract features from raw data, effectively filtering out fault characteristics from complex fault modes. A single-structure deep learning model can effectively combine raw signals and exhibits good performance in handling general bearing faults. However, in actual industrial production, a significant amount of noise exists during bearing operation, and this model cannot achieve good noise immunity, especially in high-noise environments where accurate fault diagnosis is difficult. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a bearing noise-resistant fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer. This method aims to solve the problems of low bearing identification rate in high-noise environments, poor versatility of traditional bearing fault diagnosis methods, and low diagnostic accuracy of bearing faults. The goal is to achieve more accurate bearing fault diagnosis results, realize the advantage of the model in accurately identifying bearing faults under high-noise conditions, and ultimately improve the versatility and accuracy of the bearing fault diagnosis model.

[0006] To achieve the above technical objectives, the present invention provides the following technical solution: A bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer includes the following steps:

[0007] S1. Use sensors to collect bearing operation signals and collect the original vibration signals of the bearing at different positions;

[0008] S2. Perform data preprocessing on the collected raw bearing vibration signals, and divide the collected data into training set, validation set, and test set;

[0009] S3. Extract and transform the features of the original vibration signal of the bearing, and convert the data type into quaternions to obtain the bearing fault quaternion features;

[0010] S4. Construct a noise-resistant bearing fault diagnosis model consisting of a multi-level, cross-dimensional interactive ScConv module and a dynamic quaternion dual-path Transformer module.

[0011] S5. Train the overall model based on the training set and validation set, and adjust the parameter configuration and structure of each module until the optimal model is obtained.

[0012] S6. Input the test set into the optimal diagnostic model, verify the model's effectiveness, obtain the fault classification results, and evaluate its fault diagnosis performance.

[0013] Furthermore, step S1 specifically includes:

[0014] Multiple measuring points were selected on the bearing surface, and vibration sensors were installed and fixed to ensure normal signal transmission. The original vibration signals of the bearing at different locations were collected by the vibration sensors at the measuring points, including data of the inner ring, outer ring, and rolling elements under four motor power conditions of 0, 1, 2, and 3 horsepower.

[0015] Furthermore, step S3 specifically includes:

[0016] S31. Perform signal sampling using a sliding window, extracting 1024 sampling points from the original bearing vibration signal as a sample unit. ;

[0017] S32. For each sample unit, 128 large convolutional kernels of size 7 and stride 2 are used to capture broadband features. Then, non-linearity is introduced through the ReLU activation function to obtain primary features. The formula is expressed as:

[0018] ;

[0019] in, That is, 128 convolutional kernels of size 7; For bias terms;

[0020] S33. Max pooling is used to compress the initial feature size, retaining the dominant peak of the bearing fault signal in the sliding window and weakening the low-amplitude feature disturbances caused by noise, thus obtaining the pooled feature. The formula is expressed as:

[0021] ;

[0022] in, This indicates max pooling. The pooling kernel size;

[0023] The pooling features are refined using a one-dimensional convolution of length 3 to ensure channel consistency, and the output dimension is... Local characteristics of bearing failure ;

[0024] in, For one-dimensional convolution, It is a bias term;

[0025] S34, Quaternion Modeling Transformation: Dividing the 128-channel bearing fault local features into real parts. imaginary part It consists of four parts, each with 32 dimensions; thus, the quaternion q is defined, expressed by the formula:

[0026] ;

[0027] in, These are the three corresponding components of the imaginary part;

[0028] Then, by performing a linear mapping on the quaternion, we obtain the mapping for each part as follows:

[0029] ;

[0030] ;

[0031] ;

[0032] ;

[0033] in, , , , It is the weight matrix of each part of the quaternion;

[0034] S35, Final Output Bearing Fault Quaternion Characteristics .

[0035] Furthermore, step S4 specifically includes:

[0036] S41. Determine the basic parameters, including learning rate, batch size, and number of iterations;

[0037] S42. Construct a multi-scale cascaded cross-dimensional interactive convolutional kernel, which adopts three parallel convolutional paths. Each path consists of multiple sets of cascaded structures, and each set of structures is combined with horizontal convolution, vertical convolution and square convolution of different sizes.

[0038] S43. Based on multi-scale cascaded cross-dimensional interactive convolution kernels, construct a multi-cascaded cross-dimensional interactive ScConv module, and use the bearing fault quaternion features obtained in step S3 as input to capture features of different frequencies.

[0039] S44. Construct a dynamic quaternion dual-path Transformer module, using the output of the multi-cascaded cross-dimensional interactive ScConv module as input, to focus on key fault characteristics in a noisy environment.

[0040] Furthermore, step S43 specifically includes:

[0041] S431, the multi-cascaded cross-dimensional interaction ScConv module adopts a three-branch convolutional path cascaded structure, and uses a cross-attention mechanism in each cascaded structure; the input features of each cascaded structure are... ,in, This represents the time step, i.e., the feature map height. The width of the channel dimension is equivalent to the width of the feature map. Represents the number of channels. Quaternion characteristics of bearing failure;

[0042] S432, the first cascaded structure is designed for modeling high-frequency, short-duration sudden fault signals. It employs a 1×3 horizontal convolution to model the sliding pattern within a small window on the time axis, a 3×1 vertical convolution to focus on modeling local perturbations in the spatial dimension of the feature map, and a 3×3 square convolution to detect local structural abrupt changes in the feature map. The formula is expressed as:

[0043] ;

[0044] ;

[0045] ;

[0046] in, , , The output features are 1×3 horizontal convolution, 3×1 vertical convolution, and 3×3 square convolution, respectively. 1×3 horizontal convolution kernel, 3×1 vertical convolution kernel, It is a 3×3 square convolution kernel; `c` is the index variable of the convolution kernel, representing the position of the kernel element in the convolution operation; `h`, `w`, and `c` are the height, width, and channel index of the feature map, respectively.

[0047] After obtaining the output features of each convolution, a guided cross-attention mechanism is applied to... As the foundation for guiding the main path, specifically the query in the cross-attention mechanism, one-dimensional convolution maps high-dimensional features to a low-dimensional space, while concatenating... , As auxiliary information, it generates the key and value in the cross-attention mechanism; the formula is expressed as:

[0048] ;

[0049] ;

[0050] ;

[0051] ;

[0052] in, It guides cross-attention dimensions. for , The fusion characteristics , , These are the query, key, and value that guide the cross-attention mechanism in the first cascade structure, respectively. This is a one-dimensional convolution operation;

[0053] Then , Reconstruct it into a two-dimensional tensor and compute the attention weights. and with Weighted blending and reshaping to the original size, then finally using... Convolution is used for local guided enhancement, ultimately yielding the output features of the first cascaded structure; the formula is expressed as:

[0054] ;

[0055] , ;

[0056] ;

[0057] in, This represents the softmax activation function. for convolution; To resize the features, This refers to the output characteristics of the first cascaded structure; This represents the feature dimension of each location;

[0058] S433, the second cascaded structure is used to extract mid-frequency feature information. Its internal structure is similar to the first cascaded structure, but it uses a 1×5 horizontal convolution to extract local features along the time series direction, a 5×1 vertical convolution to extract amplitude fluctuations in different directional channels, and a 5×5 square convolution to comprehensively perceive local and directional joint changes, respectively, to obtain output features. , , ;

[0059] Meanwhile, the second cascade structure uses a standard cross-attention mechanism, that is, through... , , Calculate the Query, Key, and Value in the standard cross-attention mechanism; the formula is expressed as:

[0060] ;

[0061] ;

[0062] ;

[0063] in, , , All are for batch normalization; , , These represent the query, key, and value of the standard cross-attention in the second-level cascade structure, respectively.

[0064] pass , Calculate attention weights And finally obtain the output features of the second cascade structure. The formula is expressed as:

[0065] ;

[0066] ;

[0067] S434, the third cascaded structure, is used for multi-directional sensing and modeling of long-period, high-amplitude oscillation characteristics in bearing signals. Its internal structure is similar to the first cascaded structure, but it employs 1×7 horizontal convolution, 7×1 vertical convolution, and 7×7 square convolution, respectively. The features output by each convolution are denoted as follows: , , ;

[0068] Then first , splicing results in splicing features Then, a low-rank decomposition cross-attention mechanism is used to... As the main path information is used for calculation and query, features are concatenated. As auxiliary information, the keys and values ​​are calculated, dynamically filtered and weighted through a low-rank decomposition cross-attention mechanism, and then channel-based dimensionality reduction projection is performed. The formula is expressed as:

[0069] ;

[0070] ;

[0071] ;

[0072] ;

[0073] Finally, through , Calculate attention weights And finally obtain the output characteristics of the third cascade structure. The formula is expressed as:

[0074] ;

[0075] ;

[0076] S435. A multi-scale gating selection mechanism is used to weight and fuse the output features of each branch cascade structure to obtain multi-scale fused features. Then, based on spatial attention mechanism, channel attention mechanism and integral-differential interaction layer, redundancy suppression is performed on the multi-scale fused features to finally obtain the output features of the multi-cascade cross-dimensional interactive ScConv module. .

[0077] More specifically, the multi-scale gating selection mechanism in step S435 is as follows:

[0078] Global average pooling is performed on the output features of the three-branch cascaded structure to obtain a compressed representation of the output features. The formula is expressed as:

[0079] , ;

[0080] in, yes This is global average pooling;

[0081] For each output feature, an independent gating network is set to extract local weights. The formula is expressed as:

[0082] ;

[0083] in, It is the sigmoid activation function. and These are learnable parameters;

[0084] Then, a higher-order selector is used for a global comparison. By piecing them together, a comprehensive representation is formed. ; and then through a The network predicts the global selection probability and learns the global competitive selection based on the output features of the three-branch cascade structure. The formula is expressed as:

[0085] ;

[0086] in, , These are learnable weights; It is the global feature after splicing. It is aimed at the first The weight components of each branch; The output is a 3D vector, which is... ;

[0087] Then, by combining the local weights and global selections of each cascaded structure, the final combined weight of each cascaded structure is obtained. The formula is expressed as:

[0088] ;

[0089] Finally, the output features of each branch cascade structure are weighted and fused according to the fusion weights to obtain the multi-scale fusion features. .

[0090] More specifically, the redundancy suppression of multi-scale fused features in step S435 is as follows:

[0091] Record multi-scale fusion features ,in, It's about height. It's the width. It is the number of channels;

[0092] Multi-scale fusion features are sequentially processed through spatial attention and channel attention mechanisms to suppress redundancy from both spatial and channel perspectives, as expressed by the formula:

[0093] ;

[0094] ;

[0095] ;

[0096] in, It is a multi-scale fusion feature at location and channels Convolutional features at the location, These are multi-scale fusion features at location and channels Channel-weighted features, spatial-weighted features, and weighted output convolutional features obtained at the location; In position Spatial attention weights; It is a passage Attention weights;

[0097] Next, the Sobel differential operator is used to enhance the edges of the spatially weighted features, and the Gaussian integral operator is used to denoise the channel-weighted features. The formula is expressed as follows:

[0098] ;

[0099] ;

[0100] in, It is a trainable Sobel differential convolution kernel used for gradient extraction of spatial paths; Use trainable Gaussian convolution kernels for channel smoothing; For depthwise convolution;

[0101] , These are the spatial weighted features after edge enhancement and the channel weighted features after denoising, respectively.

[0102] Define channel dimensions for learnable gating weights After normalization, they were obtained as follows: , The corresponding fusion gating weights are expressed by the formula:

[0103] ;

[0104] ;

[0105] Apply the fusion gating weights to respectively , ,get:

[0106] ;

[0107] ;

[0108] in, This represents the gating position multiplication mechanism; , These are the spatial weighted features and channel weighted features after gating enhancement, respectively;

[0109] Finally, feature reconstruction and interaction are performed, and the fusion result is used as an enhancement weighting term to apply to the spatial weighted features. Channel weighted features The output features of the ScConv module with multi-level cross-dimensional interaction are obtained. The formula is expressed as:

[0110] .

[0111] Furthermore, step S44 specifically includes:

[0112] S441, Output characteristics of the ScConv module with multi-level cross-dimensional interaction For input, Convert the input to quaternion form, dividing it into a real part r and three imaginary parts i, j, k;

[0113] S442. Then, using a dynamic quaternion multi-head attention mechanism, a query and key are assigned to each part of the input, and an attention score is calculated, i.e., the following definition is made. , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention , , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention Dynamic Quaternion Multi-Head Attention Score for:

[0114] ;

[0115] S443. Using a dynamic routing mechanism, the output of each header is averaged and pooled, then concatenated and fed into the scorer to generate the fusion weights. Then, the weighted fusion output of all heads is expressed by the formula:

[0116] ;

[0117] in, This represents the total number of attention heads, i.e., the number of parallel subspaces in multi-head attention. This represents the hd-th attention head currently being processed; it is an index variable used for head-by-head computation.

[0118] S444. After the dynamic quaternion multi-head attention mechanism layer, a residual connection and layer normalization are performed sequentially to standardize the entire feature dimension. The formula is expressed as:

[0119] ;

[0120] ;

[0121] in, These are the original features before entering the dynamic quaternion dual-path Transformer; This is the result of the first residual connection; This is the first layer normalized output;

[0122] S445. Design a dual-path feedforward network, performing parallel modeling and fusion representation in the time and frequency domains; the time-domain branch uses two quaternion fully connected layers to construct a nonlinear time-series transform, and the time-domain output is denoted as... The frequency domain branch uses a Fourier transform layer to capture peaks in the spectrum, expressed by the formula:

[0123] ;

[0124] in, and These are the real and imaginary parts of the spectrum, respectively.

[0125] Then concatenate the real and imaginary parts in the frequency domain to obtain The frequency domain output is obtained after passing through two quaternion fully connected layers. ;

[0126] S446. Finally, the time-domain output and frequency-domain output are fused through a gated fusion layer to obtain the time-frequency domain fusion features. The formula is expressed as:

[0127] ;

[0128] in, For the gated fusion layer;

[0129] S447. After obtaining the time-frequency domain fusion features, residual connection, addition, and layer normalization are performed sequentially, as expressed by the formula:

[0130] ;

[0131] ;

[0132] in, This is the result of the second residual connection; It is the final output feature of the noise-resistant bearing fault diagnosis model.

[0133] Based on the above technical solution, the present invention has at least the following beneficial effects:

[0134] This invention solves the problems of low recognition rate of faulty bearings in high-noise environments, poor versatility of traditional bearing fault diagnosis methods, and low diagnostic accuracy of bearing faults. It can output more accurate bearing fault diagnosis results and achieve the advantage of accurate bearing fault identification under high-noise conditions, thereby improving the versatility and accuracy of bearing fault diagnosis models.

[0135] The multi-tiered, cross-dimensional interactive ScConv module in this method utilizes different convolutional receptive fields, combined with guided cross-attention and low-rank cross-attention mechanisms, to accurately capture the dynamic fault feature relationships between local and global aspects. A multi-scale gating selection mechanism adaptively selects outputs at different scales, effectively achieving multi-scale weight fusion. The differential-integral interaction layer suppresses noise perturbations and strengthens the coupling of spatial channel dimensional information. The Transformer part introduces dynamic quaternion multi-head attention, enhancing the model's ability to select and aggregate complex modal features. The time-domain-frequency domain dual-path feedforward network extracts spectral features through FFT and fuses time-frequency information, enabling the model to have stronger generalization and discrimination capabilities when dealing with periodic, non-stationary, and noisy signals. Attached Figure Description

[0136] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0137] Figure 1 This is an overall flowchart of a bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer proposed in this invention.

[0138] Figure 2 This is a diagram showing the overall framework of the noise-resistant bearing fault diagnosis model proposed in this invention.

[0139] Figure 3 This is a framework diagram of the ScConv model for multi-cascaded cross-dimensional interaction in this invention;

[0140] Figure 4 This is a framework diagram of the dynamic quaternion dual-path Transformer model in this invention.

[0141] Figure 5 A bar chart comparing the performance of the method proposed in this invention with other existing models;

[0142] Figure 6 The confusion matrix diagram of this invention under a signal-to-noise ratio of -6dB;

[0143] Figure 7 The confusion matrix diagram of this invention under a signal-to-noise ratio of -4dB;

[0144] Figure 8 The confusion matrix diagram of this invention under a signal-to-noise ratio of -2dB;

[0145] Figure 9 The confusion matrix diagram of this invention under the condition of 0dB signal-to-noise ratio. Detailed Implementation

[0146] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. This will allow for a full understanding of how the present application uses technical means to solve technical problems and achieve technical effects, and to facilitate its implementation.

[0147] Those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0148] Please refer to Figures 1-9This illustration demonstrates a specific implementation of this embodiment. This embodiment utilizes a multi-tiered, cross-dimensional interactive ScConv module with different convolutional receptive fields, combined with guided cross-attention and low-rank cross-attention mechanisms, to accurately capture the dynamic fault feature relationships between local and global aspects. A multi-scale gating selection mechanism adaptively selects outputs at different scales, effectively achieving multi-scale weight fusion. The differential-integral interaction layer suppresses noise disturbances and strengthens the coupling of spatial channel dimensional information. The Transformer part introduces dynamic quaternion multi-head attention, enhancing the model's ability to select and aggregate complex modal features. The time-domain-frequency domain dual-path feedforward network extracts spectral features through FFT and fuses time-frequency information, enabling the model to have stronger generalization and discrimination capabilities when dealing with periodic, non-stationary, and noisy signals, achieving bearing fault identification under strong noise conditions. This solves the problems of low bearing fault identification rate in strong noise environments, poor generality of traditional bearing fault diagnosis methods, and low diagnostic accuracy of bearing faults. It can output more accurate bearing fault diagnosis results, achieving the advantage of accurate bearing fault identification under strong noise conditions, and thus improving the generality and accuracy of the bearing fault diagnosis model.

[0149] Please refer to Figure 1 This embodiment proposes a bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer, which specifically includes the following steps:

[0150] S1. Use sensors to collect bearing operation signals and collect the original vibration signals of the bearing at different positions;

[0151] In a preferred embodiment, step S1 specifically includes:

[0152] Multiple measuring points were selected on the bearing surface, and vibration sensors were installed and fixed to ensure normal signal transmission. The original vibration signals of the bearing at different locations were collected by the vibration sensors at the measuring points, including data of the inner ring, outer ring, and rolling elements under four motor power conditions of 0, 1, 2, and 3 horsepower.

[0153] S2. Perform data preprocessing on the collected original vibration signals of the bearing, and divide the collected data into training set, validation set and test set; in this embodiment, the division ratio is 3:1:1.

[0154] S3. Extract and transform the features of the original vibration signal of the bearing, and convert the data type into quaternions to obtain the bearing fault quaternion features;

[0155] In a preferred embodiment, step S3 specifically includes:

[0156] S31. Perform signal sampling using a sliding window, extracting 1024 sampling points from the original bearing vibration signal as a sample unit. ;

[0157] S32. For each sample unit, 128 large convolutional kernels of size 7 and stride 2 are used to capture broadband features. Then, non-linearity is introduced through the ReLU activation function to obtain primary features. The formula is expressed as:

[0158] ;

[0159] in, That is, 128 convolutional kernels of size 7; For bias terms;

[0160] The receptive field of the 7-point convolution kernel can capture the tiny abrupt changes in bearing failure and extract local features in the time domain, making it suitable for periodic impact waveforms caused by bearing failure. The 2-point step size enables downsampling and suppresses high-frequency noise, making it suitable for bearing failure identification.

[0161] S33. Max pooling is used to compress the initial feature size, retaining the dominant peak of the bearing fault signal in the sliding window and weakening the low-amplitude feature disturbances caused by noise, thus obtaining the pooled feature. The formula is expressed as:

[0162] ;

[0163] in, This indicates max pooling. The pooling kernel size;

[0164] The pooling features are refined using a one-dimensional convolution of length 3 to ensure channel consistency, and the output dimension is... Local characteristics of bearing failure ;

[0165] in, For one-dimensional convolution, It is a bias term;

[0166] S34, Quaternion Modeling Transformation: Dividing the 128-channel bearing fault local features into real parts. imaginary part It consists of four parts, each with 32 dimensions; thus, the quaternion q is defined, expressed by the formula:

[0167] ;

[0168] in, These are the three corresponding components of the imaginary part;

[0169] Then, by performing a linear mapping on the quaternion, we obtain the mapping for each part as follows:

[0170] ;

[0171] ;

[0172] ;

[0173] ;

[0174] in, , , , It is the weight matrix of each part of the quaternion;

[0175] S35. Based on the given quaternion weight matrix , , , Hamiltonian product operations are performed to encode the relative transformations and coupling relationships between temporal features, enhancing the model's ability to express weak multi-axis features and providing stronger nonlinear modeling capabilities than ordinary fully connected layers; the final output is the bearing fault quaternion feature. .

[0176] S4. Construct a noise-resistant bearing fault diagnosis model consisting of a multi-level, cross-dimensional interactive ScConv module and a dynamic quaternion dual-path Transformer module.

[0177] As a preferred embodiment, such as Figure 2 As shown, step S4 specifically includes:

[0178] S41. Determine the basic parameters, including learning rate, batch size, and number of iterations;

[0179] S42. Construct a multi-scale cascaded cross-dimensional interactive convolutional kernel, which adopts three parallel convolutional paths. Each path consists of multiple sets of cascaded structures. Each set of structures is combined using horizontal convolution, vertical convolution, and square convolution of different sizes. This design in this application introduces directional convolution operations in the spatial dimension to achieve comprehensive perception and cross-fusion of features at different scales and directions. This helps to fully explore the potential local perturbation patterns and periodic structures in bearing signals and enhance the diversity and robustness of feature representation.

[0180] S43. Based on multi-scale cascaded cross-dimensional interactive convolution kernels, construct a multi-cascaded cross-dimensional interactive ScConv module, and use the bearing fault quaternion features obtained in step S3 as input to capture features of different frequencies.

[0181] More specifically, in this embodiment, such as Figure 3 As shown, step S43 specifically includes:

[0182] S431, the multi-cascaded cross-dimensional interaction ScConv module adopts a three-branch convolutional path cascaded structure, and uses a cross-attention mechanism in each cascaded structure; the input features of each cascaded structure are... ,in, This represents the time step, i.e., the feature map height. The width of the channel dimension is equivalent to the width of the feature map. Represents the number of channels. Quaternion characteristics of bearing failure;

[0183] The core challenge in bearing fault diagnosis lies in feature extraction from vibration signals. Traditional convolutional neural networks typically use fixed-scale convolutional kernels, making it difficult to simultaneously capture features of different frequencies, thus affecting diagnostic accuracy. Therefore, this application designs a multi-cascaded, cross-dimensional interactive ScConv module. In this module, each convolutional path does not simply use a single... , , Instead of using standard convolutional kernels, a cascaded three-branch convolutional path structure is employed, utilizing... Horizontal convolution, Vertical convolution, The cascaded combination of square convolutions is used to cover different receptive fields, extract directional features and spatial overall features respectively, and then fuse them to achieve comprehensive coverage of high-frequency, mid-frequency and low-frequency features, so as to enhance feature representation ability and suppress noise interference.

[0184] S432, the first cascaded structure is designed for modeling high-frequency, short-duration sudden fault signals. It employs a 1×3 horizontal convolution to model the sliding pattern within a small window on the time axis, a 3×1 vertical convolution to focus on modeling local perturbations in the spatial dimension of the feature map, and a 3×3 square convolution to detect local structural abrupt changes in the feature map. The formula is expressed as:

[0185] ;

[0186] ;

[0187] ;

[0188] in, , , The output features are 1×3 horizontal convolution, 3×1 vertical convolution, and 3×3 square convolution, respectively. 1×3 horizontal convolution kernel, 3×1 vertical convolution kernel, It is a 3×3 square convolution kernel; `c` is the index variable of the convolution kernel, representing the position of the kernel element in the convolution operation; `h`, `w`, and `c` are the height, width, and channel index of the feature map, respectively.

[0189] 1×3 horizontal convolution can effectively extract the rapid energy changes between peaks and troughs, is highly sensitive to the starting position of the impact signal, and can amplify the small periodic disturbance characteristics generated during the operation of the bearing rolling elements, thereby enhancing the model's ability to perceive minor faults or early damage signals.

[0190] 3×1 vertical convolution can enhance the model's sensitivity to changes in directional signals during bearing operation, effectively improve the response capability to directional feature anomalies, and further enrich the expression dimensions of bearing fault features.

[0191] 3×3 square convolution can effectively aggregate spatial information and suppress redundancy. It exhibits good anti-interference ability when facing noise interference or unstructured disturbances, and can retain key features while suppressing invalid information. In particular, in the scenario of local amplitude change caused by inner ring faults or rolling element faults, 3×3 square convolution has strong sensitivity to high-frequency impact signals, can effectively extract local strong excitation areas, and improve the accuracy and stability of fault identification.

[0192] In this application, the first cascaded structure is primarily designed for modeling high-frequency, short-duration sudden fault signals. These signals typically occur during the contact process between the rolling element and the inner ring, exhibiting significant instantaneous impact characteristics. To address this characteristic, after obtaining the output features of each convolution, a guided cross-attention mechanism is applied to... As the foundation for guiding the main path, specifically the query in the cross-attention mechanism, one-dimensional convolution maps high-dimensional features to a low-dimensional space, while concatenating... , As auxiliary information, it generates the key and value in the cross-attention mechanism; the formula is expressed as:

[0193] ;

[0194] ;

[0195] ;

[0196] ;

[0197] in, It guides cross-attention dimensions. for , The fusion characteristics , , These are the query, key, and value that guide the cross-attention mechanism in the first cascade structure, respectively. This is a one-dimensional convolution operation;

[0198] Then , Reconstruct it into a two-dimensional tensor and compute the attention weights. and with Weighted blending and reshaping to the original size, then finally using... Convolution is used for local guided enhancement, ultimately yielding the output features of the first cascaded structure; the formula is expressed as:

[0199] ;

[0200] , ;

[0201] ;

[0202] in, This represents the softmax activation function. for convolution; To resize the features, The output characteristics of the first cascade structure; This represents the feature dimension of each location;

[0203] By guiding the cross-attention mechanism to achieve dynamic feature selection and weighted fusion, the model can effectively highlight the real fault signals and suppress interference caused by high-frequency noise or unstructured disturbances, thereby improving the model's ability to identify sudden impact faults.

[0204] S433, the second cascaded structure is used to extract mid-frequency feature information. Its internal structure is similar to the first cascaded structure, but it uses the following methods respectively: a 1×5 horizontal convolution to extract local features in the time series direction, enhancing the response to periodic slight oscillations and locating sharp rises and falls in the signal; a 5×1 vertical convolution to extract amplitude fluctuations in different directional channels, improving the inconsistent response to multi-directional vibrations; and a 5×5 square convolution to comprehensively perceive local and directional joint changes, used for identifying mid-frequency oscillations caused by bearing failures. The output features obtained from these three convolutions are denoted as follows: , , This setting can effectively capture the continuous fluctuation pattern and local amplitude gradual change characteristics in bearing fault signals, thereby enhancing the model's ability to perceive faults in rolling elements and outer rings.

[0205] Meanwhile, the second-level cascaded structure uses a standard cross-attention mechanism, enabling each spatiotemporal location to establish a global dynamic connection with other locations, thus enhancing the ability to extract periodic patterns; that is, through... , , In the standard cross-attention mechanism, the Query, Key, The formula is expressed as:

[0206] ;

[0207] ;

[0208] ;

[0209] Where BN is batch normalization; , , These represent the query, key, and value of the standard cross-attention in the second-level cascade structure, respectively.

[0210] pass , Calculate attention weights And finally obtain the output features of the second cascade structure. The formula is expressed as:

[0211] ;

[0212] ;

[0213] S434, the third cascaded structure, is used for multi-directional sensing and modeling of long-period, high-amplitude oscillation characteristics in bearing signals. Its internal structure is similar to the first cascaded structure, but it employs 1×7 horizontal convolution, 7×1 vertical convolution, and 7×7 square convolution, respectively. The features output by each convolution are denoted as follows: , , ;

[0214] Then first , splicing results in splicing features Then, a low-rank decomposition cross-attention mechanism is used to compress mesoscale features into a low-dimensional subspace for association matching, that is... As the main path information is used for calculation and query, features are concatenated. As auxiliary information, the keys and values ​​are calculated, dynamically filtered and weighted through a low-rank decomposition cross-attention mechanism, and then channel-based dimensionality reduction projection is performed. The formula is expressed as:

[0215] ;

[0216] ;

[0217] ;

[0218] ;

[0219] Finally, through , Calculate attention weights And finally obtain the output characteristics of the third cascade structure. The formula is expressed as:

[0220] ;

[0221] ;

[0222] The low-rank decomposition cross-attention mechanism effectively reduces computational redundancy and enhances the model's global modeling ability for complex signals such as severe faults and broadband impairments. The third-cascade structure has stronger long-distance sensing capabilities in the time domain, which helps to enhance the model's fault identification performance and noise robustness under conditions of large-scale temporal fluctuations.

[0223] S435. Use a multi-scale gating selection mechanism to weighted fuse the output features of each branch cascade structure to obtain multi-scale fused features;

[0224] In bearing fault diagnosis, convolutional receptive fields of different scales correspond to different frequencies and local-global features in the signal. However, the importance of features at each scale in the signal changes dynamically, requiring the introduction of a multi-scale selection mechanism for adaptive trade-offs. Therefore, this invention proposes a multi-scale gating selection mechanism to fuse bearing vibration signal features extracted from different convolutional kernel sizes. This mechanism first obtains compressed feature representations of each scale channel through global average pooling and extracts local response intensities within each scale through an independent gating network; simultaneously, a higher-order selector is constructed to compare the global importance of each scale. Finally, through a soft selection mechanism that fuses local responses and global weights, scale fusion weights are dynamically generated to achieve differentiated responses to features of different fault types (inner ring damage, outer ring spalling, rolling element defects, etc.). This mechanism exhibits excellent fault adaptability and robustness enhancement, effectively improving the discrimination capability under strong background noise fault conditions.

[0225] As a preferred implementation method, the multi-scale gating selection mechanism in step S435 is specifically as follows:

[0226] Global average pooling is performed on the output features of the three-branch cascaded structure to obtain a compressed representation of the output features. The formula is expressed as:

[0227] , ;

[0228] in, yes This is global average pooling;

[0229] For each output feature, an independent gating network is set to extract local weights. The formula is expressed as:

[0230] ;

[0231] in, It is the sigmoid activation function. and These are learnable parameters;

[0232] Then, a higher-order selector is used for a global comparison. By piecing them together, a comprehensive representation is formed. ; and then through a The network predicts the global selection probability and learns the global competitive selection based on the output features of the three-branch cascade structure. The formula is expressed as:

[0233] ;

[0234] in, , These are learnable weights; It is the global feature after splicing. It is aimed at the first The weight components of each branch; The output is a 3D vector, which is... ;

[0235] Then, by combining the local weights and global selections of each cascaded structure, the final combined weight of each cascaded structure is obtained. The formula is expressed as:

[0236] ;

[0237] Finally, the output features of each branch cascade structure are weighted and fused according to the fusion weights to obtain the multi-scale fusion features. .

[0238] After obtaining the multi-scale fused features, spatial redundancy (such as smooth background or repetitive texture in the spectrum) often exists in the convolutional feature map of bearing fault vibration signals. Especially under noise conditions, spatial redundancy activation can mask the true fault features. In addition, some channels may be irrelevant to classification or even dominated by noise, requiring channel-level importance re-evaluation. Therefore, it is necessary to further suppress redundancy of the multi-scale fused features based on spatial attention mechanism, channel attention mechanism, and integral-differential interaction layer, and finally obtain the output features of the multi-cascaded cross-dimensional interactive ScConv module. .

[0239] In this embodiment, redundancy suppression of multi-scale fusion features specifically involves:

[0240] Record multi-scale fusion features ,in, It's about height. It's the width. It is the number of channels;

[0241] Multi-scale fusion features are sequentially processed through spatial attention and channel attention mechanisms to suppress redundancy from both spatial and channel perspectives, as expressed by the formula:

[0242] ;

[0243] ;

[0244] ;

[0245] in, It is a multi-scale fusion feature at location and channels Convolutional features at the location, These are multi-scale fusion features at location and channels Channel-weighted features, spatial-weighted features, and weighted output convolutional features obtained at the location; In position Spatial attention weights; It is a passage Attention weights;

[0246] Fault features are often contaminated by strong noise, affecting the stability and generalization ability of the discrimination model. To improve the model's ability to model weak fault features and suppress redundant noise, this application designs an integral-differential interaction layer as an attention enhancement module that integrates spatial gradient and channel smoothing characteristics. The differential operator Sobel can capture local gradient information and enhance edge and abrupt features, making it suitable for abrupt fault identification; the integral operator Gaussian has smoothing and denoising capabilities, which is beneficial for suppressing background interference. However, traditional modules struggle to coordinate the modeling of the two effects, hence this interaction layer is introduced; specifically:

[0247] The Sobel differential operator is used to enhance the edges of the spatially weighted features, and the Gaussian integral operator is used to denoise the channel-weighted features. The formulas are as follows:

[0248] ;

[0249] ;

[0250] in, It is a trainable Sobel differential convolution kernel used for gradient extraction of spatial paths; Use trainable Gaussian convolution kernels for channel smoothing; For depthwise convolution;

[0251] , These are the spatial weighted features after edge enhancement and the channel weighted features after denoising, respectively.

[0252] Define channel dimensions for learnable gating weights After normalization, they were obtained as follows: , The corresponding fusion gating weights are expressed by the formula:

[0253] ;

[0254] ;

[0255] Apply the fusion gating weights to respectively , ,get:

[0256] ;

[0257] ;

[0258] in, This represents the gating position multiplication mechanism; , These are the spatial weighted features and channel weighted features after gating enhancement, respectively;

[0259] Finally, feature reconstruction and interaction are performed, and the fusion result is used as an enhancement weighting term to apply to the spatial weighted features. Channel weighted features The output features of the ScConv module with multi-level cross-dimensional interaction are obtained. The formula is expressed as:

[0260] .

[0261] Thus, the obtained output features It achieves both gradient modulation of the original spatial path and weighted smooth modulation of the channel path.

[0262] S44. Construct a dynamic quaternion dual-path Transformer module, using the output of the multi-cascaded cross-dimensional interactive ScConv module as input, to focus on key fault characteristics in a noisy environment.

[0263] Traditional models, under strong noise conditions, smooth out local periodic impulses in the signal, making them difficult to distinguish in the time domain; high-frequency band energy is masked; and the model tends to extract noise-dominant features, leading to misfocusing of attention. To further improve the identification capability of bearing fault diagnosis under strong noise conditions, this application, based on the traditional Transformer, decomposes noise into real and imaginary parts through a quaternion modeling mechanism, significantly suppressing noise. Simultaneously, a dynamic quaternion multi-head attention mechanism is designed, using a global scoring mechanism to score the output of each attention head and dynamically adjust the weights of each head to achieve the optimal combination of information channels. Finally, a time-frequency dual-path feedforward network is designed, using quaternion convolutional layers as the time domain path and Fourier transform layers as the frequency domain path, automatically adjusting the time-frequency fusion weights through a gating mechanism. That is... Figure 2 and Figure 4 As shown, step S44 specifically includes:

[0264] S441, Output characteristics of the ScConv module with multi-level cross-dimensional interaction For input, Convert the input to quaternion form, dividing it into a real part r and three imaginary parts i, j, k;

[0265] S442. Then, using a dynamic quaternion multi-head attention mechanism, a query and key are assigned to each part of the input, and an attention score is calculated, i.e., the following definition is made. , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention , , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention Dynamic Quaternion Multi-Head Attention Score for:

[0266] ;

[0267] S443. Using a dynamic routing mechanism, the output of each header is averaged and pooled, then concatenated and fed into the scorer to generate the fusion weights. Then, the weighted fusion output of all heads is expressed by the formula:

[0268] ;

[0269] in, This represents the total number of attention heads, i.e., the number of parallel subspaces in multi-head attention. This represents the hd-th attention head currently being processed. It is an index variable used for head-by-head computation. The dynamic routing mechanism automatically determines which heads are useful. When the input signal is disturbed by noise, it can suppress the influence of unstable attention and reduce false focusing.

[0270] S444. After the dynamic quaternion multi-head attention mechanism layer, a residual connection and layer normalization are performed sequentially to standardize the entire feature dimension. The formula is expressed as:

[0271] ;

[0272] ;

[0273] in, These are the original features before entering the dynamic quaternion dual-path Transformer; This is the result of the first residual connection; This is the first layer normalized output;

[0274] S445. Since weak faults in signals are easily masked by noise, frequency domain signal stability is often ignored, and features exhibit distinct time and frequency domain characteristics, this application designs a dual-path feedforward network to model and fuse time and frequency domain features in parallel, thereby improving noise robustness. The time-domain branch uses two quaternion fully connected layers to construct a nonlinear time-series transform, and the time-domain output is denoted as... The frequency domain branch uses a Fourier transform layer to capture peaks in the spectrum, expressed by the formula:

[0275] ;

[0276] in, and These are the real and imaginary parts of the spectrum, respectively.

[0277] Then concatenate the real and imaginary parts in the frequency domain to obtain The frequency domain output is obtained after passing through two quaternion fully connected layers. ;

[0278] S446. Finally, the time-domain output and frequency-domain output are fused through a gated fusion layer to obtain the time-frequency domain fusion features. The formula is expressed as:

[0279] ;

[0280] in, The gate function is used for the gated fusion layer. If the temporal features are unstable (e.g., large noise disturbances), the gate will favor the frequency domain path. If the signal has low-frequency fluctuations and obvious periodic impacts, the advantage of the temporal path will be preserved. The fusion weight is dynamically learned to avoid hard-coded path dependence and improve the model's adaptability.

[0281] S447. After obtaining the time-frequency domain fusion features, residual connection, addition, and layer normalization are performed sequentially, as expressed by the formula:

[0282] ;

[0283] ;

[0284] in, This is the result of the second residual connection; It is the final output feature of the noise-resistant bearing fault diagnosis model.

[0285] S5. Train the overall model based on the training set and validation set, and adjust the parameter configuration and structure of each module until the optimal model is obtained.

[0286] S6. Input the test set into the optimal diagnostic model, verify the model's effectiveness, obtain the fault classification results, and evaluate its fault diagnosis performance.

[0287] This concludes the description of the entire process of the bearing noise-resistant fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer proposed in this invention. Furthermore, to verify the performance of the proposed method, experiments were conducted on the publicly available bearing fault dataset provided by Western Reserve University.

[0288] The Western Reserve University dataset includes 36 ".mat" files containing fault data for the inner ring, outer ring, and rolling elements under four horsepower conditions (0, 1, 2, and 3), as well as 4 ".mat" files containing normal data. Each file contains vibration acceleration signals of the bearing collected by an accelerometer placed above the bearing housing at the motor drive end, at a sampling frequency of 12kHz. All faulty bearings were subjected to single-point damage machining using electrical discharge machining. The Western Reserve University publicly released bearing fault dataset includes three types of faulty bearings and one type of normal bearing. The faulty bearings are located in the outer ring, rolling elements, and inner ring. All data files were sampled, with each sample having a signal length of 1024. The resulting dataset was divided into training, validation, and test sets, with the training set accounting for 60%, the validation set for 20%, and the test set for 20%.

[0289] Table 1 below and Figure 5 This demonstrates that the model has a higher fault identification rate compared to other basic models, especially under strong noise conditions, where the advantage is even more obvious.

[0290] Table 1. Fault identification rate of each model under different noise conditions

[0291]

[0292] This invention sets the number of training iterations to 80, the batch size to 128, and uses the Adam algorithm with an initial learning rate of 0.0001. Figure 6-9 It can be seen that the fault identification accuracy of the present invention is above 95% under strong noise conditions, and the model performance is significantly improved with the increase of signal-to-noise ratio. Therefore, the bearing fault method proposed in this invention is reliable.

[0293] In summary, this invention provides a bearing noise-resistant fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer. It solves the problems of low recognition rate of faulty bearings in strong noise environments, poor versatility of traditional bearing fault diagnosis methods, and low diagnostic accuracy of bearing faults. It can output more accurate bearing fault diagnosis results. The model proposed in this invention has the advantage of accurately identifying bearing faults under strong noise conditions, and can improve the versatility and accuracy of bearing fault diagnosis models.

[0294] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of those different embodiments or examples.

[0295] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a processor-included system or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).

[0296] The above embodiments provide a detailed description of the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A bearing noise reduction fault diagnosis method based on multi-cascaded cross-dimensional dynamic interactive Transformer: S1. Use sensors to collect bearing operation signals and collect the original vibration signals of the bearing at different positions; S2. Perform data preprocessing on the collected raw bearing vibration signals, and divide the collected data into training set, validation set, and test set; S3. Extract and transform features from the original vibration signal of the bearing, and convert the data type into quaternions to obtain the bearing fault quaternion features; Step S3 specifically includes: S31. Perform signal sampling using a sliding window, extracting 1024 sampling points from the original bearing vibration signal as a sample unit. ; S32. For each sample unit, 128 large convolutional kernels of size 7 and stride 2 are used to capture broadband features. Then, non-linearity is introduced through the ReLU activation function to obtain primary features. The formula is expressed as: ； in, That is, 128 convolutional kernels of size 7; For bias terms; S33. Max pooling is used to compress the initial feature size, retaining the dominant peak of the bearing fault signal in the sliding window and weakening the low-amplitude feature disturbances caused by noise, thus obtaining the pooled feature. The formula is expressed as: ； in, This indicates max pooling. The pooling kernel size; The pooling features are refined using a one-dimensional convolution of length 3 to ensure channel consistency, and the output dimension is... Local characteristics of bearing failure ; in, For one-dimensional convolution, It is a bias term; S34, Quaternion Modeling Transformation: Dividing the 128-channel bearing fault local features into real parts. imaginary part It consists of four parts, each with 32 dimensions; thus, the quaternion q is defined, expressed by the formula: ； in, These are the three corresponding components of the imaginary part; Then, by performing a linear mapping on the quaternion, we obtain the mapping for each part as follows: ； ； ； ； in, , , , It is the weight matrix of each part of the quaternion; S35, Final Output Bearing Fault Quaternion Characteristics ; S4. Construct a noise-resistant bearing fault diagnosis model consisting of a multi-level, cross-dimensional interactive ScConv module and a dynamic quaternion dual-path Transformer module. S5. Train the overall model based on the training set and validation set, and adjust the parameter configuration and structure of each module until the optimal model is obtained. S6. Input the test set into the optimal diagnostic model, verify the model's effectiveness, obtain the fault classification results, and evaluate its fault diagnosis performance.

2. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 1, characterized in that, Step S1 is as follows: Multiple measuring points were selected on the bearing surface, and vibration sensors were installed and fixed to ensure normal signal transmission. The original vibration signals of the bearing at different locations were collected by the vibration sensors at the measuring points, including data of the inner ring, outer ring, and rolling elements under four motor power conditions of 0, 1, 2, and 3 horsepower.

3. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 1, characterized in that, Step S4 specifically includes: S41. Determine the basic parameters, including learning rate, batch size, and number of iterations; S42. Construct a multi-scale cascaded cross-dimensional interactive convolutional kernel, which adopts three parallel convolutional paths. Each path consists of multiple sets of cascaded structures, and each set of structures is combined with horizontal convolution, vertical convolution and square convolution of different sizes. S43. Based on multi-scale cascaded cross-dimensional interactive convolution kernels, construct a multi-cascaded cross-dimensional interactive ScConv module, and use the bearing fault quaternion features obtained in step S3 as input to capture features of different frequencies. S44. Construct a dynamic quaternion dual-path Transformer module, using the output of the multi-cascaded cross-dimensional interactive ScConv module as input, to focus on key fault characteristics in a noisy environment.

4. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 3, characterized in that, Step S43 specifically includes: S431, the multi-cascaded cross-dimensional interaction ScConv module adopts a three-branch convolutional path cascaded structure, and uses a cross-attention mechanism in each cascaded structure; the input features of each cascaded structure are... ,in, This represents the time step, i.e., the feature map height. The width of the channel dimension is equivalent to the width of the feature map. Represents the number of channels. Quaternion characteristics of bearing failure; S432, the first cascaded structure is designed for modeling high-frequency, short-duration sudden fault signals. It employs a 1×3 horizontal convolution to model the sliding pattern within a small window on the time axis, a 3×1 vertical convolution to focus on modeling local perturbations in the spatial dimension of the feature map, and a 3×3 square convolution to detect local structural abrupt changes in the feature map. The formula is expressed as: ； ； ； in, , , The output features are 1×3 horizontal convolution, 3×1 vertical convolution, and 3×3 square convolution, respectively. 1×3 horizontal convolution kernel, 3×1 vertical convolution kernel, It is a 3×3 square convolution kernel; `c` is the index variable of the convolution kernel, representing the position of the kernel element in the convolution operation; `h`, `w`, and `c` are the height, width, and channel index of the feature map, respectively. After obtaining the output features of each convolution, a guided cross-attention mechanism is applied to... As the foundation for guiding the main path, specifically the query in the cross-attention mechanism, one-dimensional convolution maps high-dimensional features to a low-dimensional space, while concatenating... , As auxiliary information, it generates the key and value in the cross-attention mechanism; the formula is expressed as: ； ； ； ； in, It guides cross-attention dimensions. for , The fusion characteristics , , These are the query, key, and value that guide the cross-attention mechanism in the first cascade structure, respectively. This is a one-dimensional convolution operation; Then , Reconstruct it into a two-dimensional tensor and compute the attention weights. and with Weighted blending and reshaping to the original size, then finally using... Convolution is used for local guided enhancement, ultimately yielding the output features of the first cascaded structure; the formula is expressed as: ； ， ； ； in, This represents the softmax activation function. for convolution; To resize the features, This refers to the output characteristics of the first cascaded structure; This represents the feature dimension of each location; S433, the second cascaded structure is used to extract mid-frequency feature information. Its internal structure is similar to the first cascaded structure, but it uses a 1×5 horizontal convolution to extract local features along the time series direction, a 5×1 vertical convolution to extract amplitude fluctuations in different directional channels, and a 5×5 square convolution to comprehensively perceive local and directional joint changes, respectively, to obtain output features. , , ; Meanwhile, the second cascade structure uses a standard cross-attention mechanism, that is, through... , , Calculate the Query, Key, and Value in the standard cross-attention mechanism; the formula is expressed as: ； ； ； in, , , All are for batch normalization; , , These represent the query, key, and value of the standard cross-attention in the second-level cascade structure, respectively. pass , Calculate attention weights And finally obtain the output features of the second cascade structure. The formula is expressed as: ； ； S434, the third cascaded structure, is used for multi-directional sensing and modeling of long-period, high-amplitude oscillation characteristics in bearing signals. Its internal structure is similar to the first cascaded structure, but it employs 1×7 horizontal convolution, 7×1 vertical convolution, and 7×7 square convolution, respectively. The features output by each convolution are denoted as follows: , , ; Then first , splicing results in splicing features Then, a low-rank decomposition cross-attention mechanism is used to... As the main path information is used for calculation and query, features are concatenated. As auxiliary information, the keys and values ​​are calculated, dynamically filtered and weighted through a low-rank decomposition cross-attention mechanism, and then channel-based dimensionality reduction projection is performed. The formula is expressed as: ； ； ； ； Finally, through , Calculate attention weights And finally obtain the output characteristics of the third cascade structure. The formula is expressed as: ； ； S435. A multi-scale gating selection mechanism is used to weight and fuse the output features of each branch cascade structure to obtain multi-scale fused features. Then, based on spatial attention mechanism, channel attention mechanism and integral-differential interaction layer, redundancy suppression is performed on the multi-scale fused features to finally obtain the output features of the multi-cascade cross-dimensional interactive ScConv module. .

5. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 4, characterized in that, The multi-scale gating selection mechanism in step S435 is as follows: Global average pooling is performed on the output features of the three-branch cascaded structure to obtain a compressed representation of the output features. The formula is expressed as: ， ； in, yes This is global average pooling; For each output feature, an independent gating network is set to extract local weights. The formula is expressed as: ； in, It is the sigmoid activation function. and These are learnable parameters; Then, a higher-order selector is used for a global comparison. By piecing them together, a comprehensive representation is formed. ; and then through a The network predicts the global selection probability and learns the global competitive selection based on the output features of the three-branch cascade structure. The formula is expressed as: ； in, , These are learnable weights; It is the global feature after splicing. It is aimed at the first The weight components of each branch; The output is a 3D vector, which is... ; Then, by combining the local weights and global selections of each cascaded structure, the final combined weight of each cascaded structure is obtained. The formula is expressed as: ； Finally, the output features of each branch cascade structure are weighted and fused according to the fusion weights to obtain the multi-scale fusion features. .

6. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 4, characterized in that, The redundancy suppression of multi-scale fused features in step S435 specifically involves: Record multi-scale fusion features ,in, It's about height. It's the width. It is the number of channels; Multi-scale fusion features are sequentially processed through spatial attention and channel attention mechanisms to suppress redundancy from both spatial and channel perspectives, as expressed by the formula: ； ； ； in, It is a multi-scale fusion feature at location and channels Convolutional features at the location, These are multi-scale fusion features at location and channels Channel-weighted features, spatial-weighted features, and weighted output convolutional features obtained at the location; In position Spatial attention weights; It is a passage Attention weights; Next, the Sobel differential operator is used to enhance the edges of the spatially weighted features, and the Gaussian integral operator is used to denoise the channel-weighted features. The formula is expressed as follows: ； ； in, It is a trainable Sobel differential convolution kernel used for gradient extraction of spatial paths; Use trainable Gaussian convolution kernels for channel smoothing; For depthwise convolution; , These are the spatial weighted features after edge enhancement and the channel weighted features after denoising, respectively. Define channel dimensions for learnable gating weights After normalization, they were obtained as follows: , The corresponding fusion gating weights are expressed by the formula: ； ； Apply the fusion gating weights to respectively , ,get: ； ； in, This represents the gating position multiplication mechanism; , These are the spatial weighted features and channel weighted features after gating enhancement, respectively; Finally, feature reconstruction and interaction are performed, and the fusion result is used as an enhancement weighting term to apply to the spatial weighted features. Channel weighted features The output features of the ScConv module with multi-level cross-dimensional interaction are obtained. The formula is expressed as: 。 7. The bearing noise reduction fault diagnosis method based on a multi-cascaded cross-dimensional dynamic interactive Transformer according to claim 3, characterized in that, Step S44 specifically includes: S441, Output characteristics of the ScConv module with multi-level cross-dimensional interaction For input, Convert the input to quaternion form, dividing it into a real part r and three imaginary parts i, j, k; S442. Then, using a dynamic quaternion multi-head attention mechanism, a query and key are assigned to each part of the input, and an attention score is calculated, i.e., the following definition is made. , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention , , , , The first, second, third, and fourth digits of r, i, j, and k are respectively... A person's attention Dynamic Quaternion Multi-Head Attention Score for: ； S443. Using a dynamic routing mechanism, the output of each header is averaged and pooled, then concatenated and fed into the scorer to generate the fusion weights. Then, the weighted fusion output of all heads is expressed by the formula: ； in, This represents the total number of attention heads, i.e., the number of parallel subspaces in multi-head attention. This represents the hd-th attention head currently being processed; it is an index variable used for head-by-head computation. S444. After the dynamic quaternion multi-head attention mechanism layer, a residual connection and layer normalization are performed sequentially to standardize the entire feature dimension. The formula is expressed as: ； ； in, These are the original features before entering the dynamic quaternion dual-path Transformer; This is the result of the first residual connection; This is the first layer normalized output; S445. Design a dual-path feedforward network, performing parallel modeling and fusion representation in the time and frequency domains; the time-domain branch uses two quaternion fully connected layers to construct a nonlinear time-series transform, and the time-domain output is denoted as... The frequency domain branch uses a Fourier transform layer to capture peaks in the spectrum, expressed by the formula: ； in, and These are the real and imaginary parts of the spectrum, respectively. Then concatenate the real and imaginary parts in the frequency domain to obtain The frequency domain output is obtained after passing through two quaternion fully connected layers. ; S446. Finally, the time-domain output and frequency-domain output are fused through a gated fusion layer to obtain the time-frequency domain fusion features. The formula is expressed as: ； in, For the gated fusion layer; S447. After obtaining the time-frequency domain fusion features, residual connection, addition, and layer normalization are performed sequentially, as expressed by the formula: ； ； in, This is the result of the second residual connection; It is the final output feature of the noise-resistant bearing fault diagnosis model.

Images