Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

97 results about "Vanishing gradient problem" patented technology

In machine learning, the vanishing gradient problem is a difficulty found in training artificial neural networks with gradient-based learning methods and backpropagation. In such methods, each of the neural network's weights receives an update proportional to the partial derivative of the error function with respect to the current weight in each iteration of training. The problem is that in some cases, the gradient will be vanishingly small, effectively preventing the weight from changing its value. In the worst case, this may completely stop the neural network from further training. As one example of the problem cause, traditional activation functions such as the hyperbolic tangent function have gradients in the range (0, 1), and backpropagation computes gradients by the chain rule. This has the effect of multiplying n of these small numbers to compute gradients of the "front" layers in an n-layer network, meaning that the gradient (error signal) decreases exponentially with n while the front layers train very slowly.

Electrocardiosignal reconstruction method based on hybrid optimization and multi-modal feature fusion

The invention provides an electrocardiosignal reconstruction method based on hybrid optimization and multi-modal feature fusion, and the method comprises the steps: obtaining a 12-lead electrocardiosignal, processing the 12-lead electrocardiosignal through a linear regression model, a genetic algorithm and a simulated annealing algorithm in sequence to obtain an optimal three-lead electrocardiosignal, and reconstructing the optimal three-lead electrocardiosignal according to the optimal three-lead electrocardiosignal. The optimal three-lead electrocardiosignal is subjected to one-dimensional convolution layer and maximum pooling processing in sequence to obtain time domain features, the time domain features, the frequency domain features and expert features are subjected to multi-modal feature fusion to obtain fusion features, and the fusion features are input into a Transform mechanism to be processed to obtain a reconstructed electrocardiosignal. The method has remarkable effects in long-range time sequence modeling and local waveform detail optimization. The traditional CNN / RNN is limited by the problem of local receptive field or gradient disappearance, the global rhythm and the local form are difficult to balance, the QRS is adopted to perceive a Transform architecture, and a multi-head self-attention and nonlinear feed-forward network is combined, so that the width error of a QRS wave group is smaller.
Owner:EAST CHINA JIAOTONG UNIVERSITY

Road disease detection method based on unmanned aerial vehicle, electronic equipment and program product

The invention discloses a road disease detection method based on an unmanned aerial vehicle, electronic equipment and a program product. The method is realized based on a trained road disease detection model, a C3k2-MDDSC module is introduced into a backbone network of the model, the feature multiplexing capability is enhanced through gradient shunting and multi-scale fusion, the gradient disappearance problem is relieved, and the robustness of the model is improved by means of jump connection and packet convolution. An ACFP module is introduced into the tail end of the backbone network, dynamic fusion of local and global features is realized by using multi-scale cavity convolution and a channel-space attention mechanism, and the complex scene modeling capability is improved. And the neck network is integrated with an SGF module, so that the spatial perception of the model to a tiny target can be improved. Besides, the ES-FPN proposed based on the SGF module not only can enhance the utilization of shallow spatial information, but also can optimize the complementarity of cross-level features. During training, regression loss, namely fast high-quality intersection-to-union ratio loss, is proposed, and angle punishment is introduced to improve the alignment precision of the rotating frame and the convergence speed of the model.
Owner:STREAMAP TECHNOLOGY CO LTD

Industrial product accumulated damage image generation method based on improved DCGAN

An industrial product cumulative damage image generation method based on an improved DCGAN is characterized by comprising the following steps: step 1, based on a DCGAN model framework, an industrial product cumulative damage image generation network IPD-GAN based on the improved DCGAN is constructed, and the IPD-GAN is provided with a generator and a discriminator; 2, the generator obtains random noise, processes the random noise, generates a damage image and transmits the damage image to a discriminator; step 3, the discriminator obtains a real image, carries out true and false discrimination on the real image and the damaged image, adopts a Wasserstein distance loss function with a gradient penalty term as a model to resist loss according to a discrimination result, guides training of the generator in combination with L1 loss and SSIM loss, and comprehensively optimizes system performance; and step 4, generating a damaged image by using the trained IPD-GAN. The method has the advantages that the problems of unstable training and gradient disappearance existing in the DCGAN are solved.
Owner:CHONGQING TECH & BUSINESS UNIV

High-speed lithium battery energy state estimation method

The invention discloses a method for estimating the energy state of a high-speed lithium battery, which belongs to the field of electric automobiles and comprises the following steps: performing multi-time scale modeling and hierarchical feature extraction on current, voltage and power data of the lithium battery through a deep echo state network, independently adjusting hyper-parameters of each layer by using a parameter differentiation strategy, and calculating the energy state of the lithium battery according to the hyper-parameters; therefore, different dynamic characteristic inputs can be adapted. Furthermore, sudden change output signals in the prediction process are removed through a modal decomposition noise reduction module, and the prediction precision and stability are improved. Experimental verification shows that the method shows high-speed prediction performance, high precision and high usability under various real automobile working conditions, not only has the capabilities of rapid training and efficient prediction, but also can effectively avoid the problem of gradient disappearance in a traditional recurrent neural network, and meanwhile, keeps higher precision and robustness.
Owner:SOUTHWEAT UNIV OF SCI & TECH

Sodium battery residual life prediction method for underwater robot application scene

An underwater robot application scene-oriented sodium battery residual life prediction method comprises the following steps of: obtaining normalized features after input features pass through a double-path feature normalization module; processing the input features through a multi-local sensing path module, and fusing and splicing the processed input features with the normalized features to obtain spliced features; performing 1 * 1 convolution operation on the input features, adding the input features and the splicing features element by element, and performing processing through a lightweight residual connection module to obtain multi-scale features; enabling the coder-decoder to predict an initial capacity prediction value according to characteristics rich in global time sequence information in the multi-scale characteristic data; performing element-by-element addition on the initial capacity prediction value and the normalized feature, and calculating a final sodium battery residual life prediction value; the coder-decoder can capture the long-range dependency relationship of the battery capacity sequence through a self-attention mechanism, the gradient disappearance problem of the recurrent neural network in the long sequence is solved, and the prediction precision is remarkably improved.
Owner:HENAN INST OF SCI & TECH

SDN abnormal traffic detection model based on improved bidirectional TCN model

The invention relates to the technical field of network security and abnormal traffic detection, in particular to an SDN abnormal traffic detection model based on an improved bidirectional TCN model, the model takes a traffic quintuple as a basis, extracts a data packet length sequence as a core time sequence feature, constructs an improved bidirectional time convolution network module, and performs joint modeling through a forward TCN and a backward TCN, so that the network security and abnormal traffic detection efficiency is improved. A long-range dependency relationship in a flow sequence is captured, an ELU activation function is introduced into the model to enhance the nonlinear expression ability, the gradient propagation effect is optimized through a residual connection structure, the gradient disappearance problem in deep network training is relieved, and for the problem that correlation modeling among multi-channel features is insufficient, the model is further fused with a multi-head extrusion excitation mechanism, so that the multi-channel feature correlation modeling method is improved. And the importance weight of the feature channel is adaptively adjusted, so that the abnormal traffic detection capability and the model generalization performance are improved.
Owner:BEIJING INFORMATION SCI & TECH UNIV

Underwater bridge crack defect detection method and system based on U-Net algorithm

The invention discloses an underwater bridge crack defect detection method and system based on a U-Net algorithm, and the method comprises the steps: enabling information to be directly transmitted from a shallow layer to a deep layer through quick connection of an added residual network module on the basis of a conventional U-Net algorithm, and effectively solving the problem of gradient disappearance; therefore, the U-Net can construct a deeper network structure, so that richer and higher-level features are extracted, and the ability of understanding complex images is improved. And secondly, the added RFB module can extract scale features of receptive fields of different sizes at the same time, more comprehensive information is provided for the model, and the detection capability of cracks of different sizes is improved.
Owner:NANJING UNIV OF SCI & TECH +1

Remote sensing image segmentation method based on Transsubnet edge information enhancement and multi-dimensional feature perception

The invention belongs to the field of deep learning technology and remote sensing image segmentation, and particularly relates to a remote sensing image segmentation method based on Transsubnet edge information enhancement and multi-dimensional feature perception, and the method comprises the steps: S1, preparing a data set; s2, constructing remote sensing picture text description; s3, constructing and training a remote sensing image segmentation model; and S4, storing and testing the model. The invention designs a multi-modal feature extraction method based on parallelism of a sampling branch and a text feature extraction branch under edge feature compensation. The residual error mixing axial attention module is used for forming a transformer structure; and a text-picture multi-dimensional feature fusion enhancement module and a decoder part are embedded. According to the method, the ground feature identification capability can be improved through a text and picture multi-modal feature enhancement strategy, the segmentation boundary and small target object feature information is enhanced, more fine-grained features are reserved, the cross-regional long-distance dependency relationship is better captured, the common gradient disappearance problem in a deep network is relieved, and the method is suitable for large-scale popularization and application. And meanwhile, the small sample data set segmentation effect is improved.
Owner:CHANGCHUN UNIV OF SCI & TECH

Audio depression detection method and system based on improved convolutional neural network auto-encoder

The invention belongs to the field of audio processing, and particularly discloses an audio depression detection method and system based on an improved convolutional neural network autoencoder, and the method comprises the steps: carrying out the potential feature extraction and compression of input original audio data, extracting the data into a low-dimensional and dense potential feature vector, and carrying out the recognition of the potential feature vector; and the information loss in the reconstruction process is reduced. According to the model part, a residual block structure is introduced into an encoder part, input low-layer information is reserved through jump connection, the learning ability of the network is enhanced, and the gradient disappearance problem is avoided. A transpose convolution operation is introduced into a decoder part, the spatial resolution is increased through up-sampling, and a high-quality signal reconstruction task is taken as a constraint, so that the extracted potential features are ensured to contain all key information for accurate classification. Finally, the potential features are directly used for depression classification, and experimental results show that the accuracy and robustness of depression detection can be remarkably improved, and the method has high practical application value.
Owner:SOUTHWEST JIAOTONG UNIV

Single-frame infrared small target detection method based on adaptive channel interaction

The invention provides a single-frame infrared small target detection method based on a variant convolutional neural network. The single-frame infrared small target detection method specifically comprises the steps that a picture input module carries out standardized preprocessing and primary feature extraction on an original image; the efficient channel attention module extracts channel descriptors through global pooling, efficiently calculates weights by using a lightweight network, and performs weighted adjustment on input channels; the FPN module realizes efficient fusion of cross-scale features through a space cyclic shift and channel grouping technology; the residual error convolution module adopts a structural design of combining a convolution path and jump connection, so that the problem of gradient disappearance in deep network training is effectively solved; the feed-forward module integrates an efficient channel attention mechanism, and enhances the response capability of a key feature channel through global information aggregation, channel weight generation and re-calibration operation; the model output module converts high-level features into high-precision mask images and calculates detection performance indexes in real time, all the modules work cooperatively to form a complete feature extraction-fusion-prediction processing chain, and the performance of the infrared small target detector is remarkably improved while the real-time reasoning efficiency is guaranteed.
Owner:SHENYANG LIGONG UNIV

Photoetching hot spot detection method based on Inception block and residual network

The invention relates to a photoetching hot spot detection method based on an Inception block and a residual network. The invention provides a data enhancement and preprocessing method, a photoetching pattern is processed firstly, a training data set is effectively expanded through the step, a data enhancement processing method is adopted, a hot spot pattern is subjected to 180-degree rotation, mirroring and 180-degree rotation and then mirroring, and the recognition capability of a model on the hot spot pattern is enhanced. On the basis, the invention provides a deep learning network adopting an Inception-Resnet neural network structure to solve the photoetching hot spot detection problem, and the neural network combines the multi-scale feature extraction capability of an Inception module and the residual connection of Resnet, so that the network can effectively solve the gradient disappearance problem while keeping the depth, and the detection accuracy is improved. And the training stability and the model learning efficiency are improved.
Owner:ZHEJIANG UNIV +2

Semantic relationship decoupling-based data set distillation method and system

ActiveCN121456458AData setAlgorithm
The invention discloses a data set distillation method and system based on semantic relation decoupling, and belongs to the technical field of data distillation. According to the method, the feature distribution of the distillation data is aligned with the category-level statistics of the original data stored in the memory bank to realize efficient and fine-grained category-level optimization of the distillation data, so that the representativeness and semantic consistency of the distillation data are improved; in addition, for the problem that distribution in the last layer of feature distribution of the pre-training model is too concentrated, the problem of downstream task gradient disappearance caused by insufficient sample diversity in the feature space is effectively relieved by maximizing diagonal elements of a covariance matrix and minimizing non-diagonal elements at the same time. Therefore, the generalization ability and the learning effect of the model on downstream tasks are improved.
Owner:INSTITUTE OF INFORMATION ENGINEERING CHINESE ACADEMY OF SCIENCES

High spatial resolution remote sensing image building extraction method

The invention relates to the technical field of building image processing, in particular to a high-spatial-resolution remote sensing image building extraction method. Comprising the following steps: firstly, preprocessing an original remote sensing image; and then, a BuildingNet model is introduced to extract the building. All the preprocessed samples are used as the input of the model, and the trained model outputs two types of classification diagrams. A multi-layer dense connection convolution block adopted by the BuildingNet model is excellent in performance in image classification and has the advantages that the gradient disappearance problem in a deep neural network is relieved, the feature extraction capacity is high, feature propagation in training and evaluation is promoted, feature reuse in classification and segmentation tasks is encouraged and the like, and meanwhile, the DenseNet can reduce the number of parameters, so that the method is easy to train.
Owner:CHONGQING UNIV

Network traffic matrix prediction method based on multi-scale convolution and attention collaborative enhancement LSTM

The invention provides a network traffic matrix prediction method based on multi-scale convolution and attention collaborative enhancement LSTM (Long Short Term Memory), and solves the problems that an existing traffic matrix prediction model is insufficient in multi-scale feature capture, weak in space-time correlation modeling and poor in generalization. A dynamic multi-scale convolution module (adopting a 3 * 3 / 5 * 5 / 7 * 7 two-dimensional convolution kernel) is used to extract local fine-grained association and global coarse-grained trend of a two-dimensional traffic matrix, deep fusion of LSTM time sequence features and two-dimensional multi-scale spatial features is realized in combination with a cross attention mechanism, and time-space cross-dimension association is enhanced. And meanwhile, the problem of gradient disappearance of the deep network is relieved by relying on residual connection, and topology independence is realized based on a flow-by-flow method so as to adapt to traffic matrixes of different dimensions. The method specifically comprises the following steps: performing stream-by-stream division and normalization preprocessing on an original two-dimensional traffic matrix, and after processing by modules such as dynamic multi-scale convolution, cross attention enhancement LSTM, residual block and gating screening and the like, outputting a single OD stream predicted value and reconstructing a complete traffic matrix; and integrating objective functions of the encoder and the decoder, taking the MSE as a loss function, and adopting an Adam optimizer to iteratively update model parameters until the model converges. Experiments show that the MAE and the MSE of the method on real data sets such as Ailene, GEANT and the like are better than those of mainstream models such as SVR, LSTM, MTGNN and the like, the reconstruction precision of a high-dimensional traffic matrix is particularly remarkable, and a reliable basis can be provided for network congestion control and resource optimization.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Two-stage brain glioma segmentation system based on improved U-Net model

The invention discloses a two-stage brain glioma segmentation system based on an improved U-Net model, and belongs to the field of medical image segmentation. According to the method, the problems of low precision, low efficiency and poor generalization ability of the existing segmentation technology are solved. In a tumor tissue detection stage, the lightweight neural network is utilized to realize preliminary identification of a brain glioma region, and the calculation range of subsequent fine segmentation is effectively reduced, so that the model can perform reasoning at relatively low resource and time cost, and the segmentation efficiency is improved. By adopting the multi-scale feature residual module, the problem of gradient disappearance caused by network deepening can be relieved, information can be propagated in a deeper level in the network, and extra parameter and calculation complexity overhead cannot be brought. Meanwhile, jump connection is changed into a multi-scale jump connection structure, the problem that a decoder network can only receive same-scale feature information is solved, and the tumor segmentation precision is remarkably improved. The method can be applied to medical image segmentation.
Owner:HARBIN UNIV OF SCI & TECH +1

Brain load assessment method and system based on BEAM

The invention discloses a brain load assessment method and system based on BEAM. The method comprises the steps that EEG data sets corresponding to high, medium and low symbol loads of a subject are collected, and labels are edited; carrying out data preprocessing on the collected data to reduce the calculation amount and reserve effective frequency band information; calculating the power spectrum density by adopting a Welch method; constructing a color BEAM image by using the obtained power spectrum density and the electrode coordinates; inputting the BEAM sequence into a convolutional neural network to extract deep spatial features; the image sequence is transmitted into a BiLSTM module to capture time sequence features; constructing a GUI (Graphical User Interface) to visually display the spatial distribution condition of the electroencephalogram signals; compared with the traditional electroencephalogram frequency band feature vector research, the method has the advantages that the position information between the electrodes can be better reserved; the gradient disappearance problem in the deep network is effectively solved; the prediction accuracy is well improved; the active condition of each functional area of the brain is visually displayed, and the convenience of man-machine interaction is improved.
Owner:JILIN UNIVERSITY

An ECG signal reconstruction method based on hybrid optimization and multimodal feature fusion

The present invention proposes a method for reconstructing an ECG signal based on hybrid optimization and multimodal feature fusion, the method comprising: obtaining a 12-lead ECG signal, processing the 12-lead ECG signal in sequence through a linear regression model, a genetic algorithm, and a simulated annealing algorithm to obtain an optimal three-lead ECG signal, processing the optimal three-lead ECG signal in sequence through a one-dimensional convolutional layer and a maximum pooling layer to obtain time domain features, fusing the time domain features, frequency domain features, and expert features into a multimodal feature to obtain fused features, and inputting the fused features into a Transformer mechanism for processing to obtain a reconstructed ECG signal. The present invention achieves significant results in long-range time series modeling and local waveform detail optimization. Traditional CNN / RNN is limited by the local receptive field or gradient vanishing problem, making it difficult to balance the global rhythm and local morphology. The present invention adopts a QRS-aware Transformer architecture, combined with multi-head self-attention and a nonlinear feedforward network, to reduce the error in the width of the QRS complex.
Owner:EAST CHINA JIAOTONG UNIVERSITY

Remote sensing image road extraction method, system and device based on improved Transform network and storage medium

The invention discloses a remote sensing image road extraction method, system and device based on an improved Transform network and a storage medium, and relates to the technical field of road extraction. According to the technical key points, the method comprises the following steps: carrying out road extraction on a road remote sensing image by utilizing a road extraction model based on an improved Transform network, wherein the improved Transform network comprises a cross-scale coding layer, an improved encoder and a decoder; the cross-scale coding layer solves the influence of Transform multi-scale input on the road extraction effect in the coding stage; a multi-head attention mechanism is replaced by a regional multi-head attention mechanism with a residual term in an encoder and a decoder, so that not only can the features of small objects be accurately concerned and learned, but also more original features can be reserved, and the gradient disappearance problem can be relieved; and the feedforward neural network is improved by using a gating mechanism, so that the expression ability of the model is enhanced. According to the method, road detail information can be extracted more accurately, and a new solution is provided for automatic extraction of road features in high-resolution remote sensing images.
Owner:HARBIN NORMAL UNIVERSITY

Fan blade crack detection method

PendingCN121962044AAvoid interference from own textureImprove crack detection accuracyImage enhancementImage analysisPattern recognitionDeblurring
The invention provides a fan blade crack detection method, which comprises the following steps of: for a fan blade image acquired by an unmanned aerial vehicle, performing deblurring processing on the image through a pre-processing algorithm designed by the invention, and overcoming the problem of motion blurring when the unmanned aerial vehicle acquires the fan blade image; and carrying out crack detection on the acquired image by adopting a crack detection neural network model improved based on YOLOv8. According to the crack detection model, self texture interference of the blade can be avoided, the crack detection precision is improved, crack characteristics of different scales are captured through a Stem module of a multi-branch structure, a CAM module is added into a C2f-1 module, crack attention is integrated, and crack related characteristics are enhanced; a residual connection mode of a residual block is designed in a C2f-2 module to avoid the problem of deep network gradient disappearance, gradient flow and effective transmission of crack characteristics are guaranteed, response of crack-related channels is enhanced through channel re-calibration, and irrelevant channels such as blade textures are inhibited.
Owner:NANJING INST OF TECH

Mine dust concentration image recognition method based on prior features and multi-kernel residual attention network

The invention discloses a mine dust concentration image recognition method based on prior features and a multi-kernel residual attention network, and the method comprises the steps: collecting mine dust images under different concentration conditions, extracting multi-dimensional image features, and constructing a prior feature library; linear and nonlinear feature subsets significantly related to the mine dust concentration are screened out; respectively mapping the linear and nonlinear feature subsets to a high-dimensional space by adopting a multi-kernel learning framework and carrying out weighted fusion to obtain fused high-order features; a multi-kernel residual attention network is constructed and trained, the gradient disappearance problem is relieved through a residual block structure, the weight of each feature channel is learned through a channel attention mechanism, and dynamic enhancement of key mine dust image features is carried out; and inputting the fused high-order features into a multi-kernel residual attention network for regression calculation, and outputting a mine dust concentration predicted value. According to the method, high-precision, non-contact and high-interpretability image recognition of mine dust concentration can be realized, and the method is suitable for real-time mine safety monitoring in a complex environment.
Owner:CHINA UNIV OF MINING & TECH

A gene regulation inference method guided by topological data analysis for gene network embedding

This invention discloses a gene regulation inference method guided by topological data analysis and gene network embedding. It combines TDA and GNN to enhance the inference capability of gene regulation networks. By capturing the topological structure of the gene regulation network graph through TDA features, the model's ability to model gene expression is enhanced. The TDA features and GAT embedding representations are effectively integrated through gating fusion. This fusion mechanism enables the model to adaptively adjust node embeddings based on global topological characteristics, which not only improves the accuracy of gene interaction representation but may also enhance the accuracy of regulatory relationship prediction. The traditional GAT architecture is extended through a four-layer graph attention mechanism. Each layer uses residual connections to alleviate the gradient vanishing problem and improve training stability. In addition, independent multilayer perceptron branches are designed for transcription factors and target gene embeddings. This deep architecture can achieve more expressive feature transformations and capture subtle patterns in gene regulation networks.
Owner:HUZHOU UNIVERSITY

Lightweight image super-resolution reconstruction method, apparatus and device, and storage medium

The invention provides a lightweight image super-resolution reconstruction method, device and equipment and a storage medium, standard convolution is solved into two steps of deep convolution and point convolution, a depth separable convolution layer performs independent extraction on each channel feature of a low-resolution image to realize channel decoupling, each channel only uses an independent convolution kernel, the convolution kernel is independent, and the reconstruction efficiency is improved. The original calculation amount of H * W * X * Y * M * N is reduced to H * W * X * Y * M, the parameter amount is reduced to X * Y * M from X * Y * M * N, and the compression ratio of about 1 / N is achieved. And then the information of each channel is fused through a 1 * 1 point convolution layer to generate fusion features, and the parameter quantity is further reduced while the feature expression capability is maintained. And meanwhile, residual connection is introduced to connect a plurality of feature stacking modules in series, cross-layer information transmission is realized, and bottom feature information is reserved, so that the problem of gradient disappearance during deep network training is prevented, and redundant calculation is avoided through feature multiplexing.
Owner:HEFEI HAODI MICROELECTRONICS CO LTD

A traffic flow prediction method based on spatiotemporal attention network

The present invention belongs to the field of spatiotemporal data prediction, and specifically relates to a traffic flow prediction method based on a spatiotemporal attention network. The method comprises: collecting real-time traffic flow data and preprocessing the real-time traffic flow data; inputting the preprocessed real-time traffic flow data into a spatiotemporal attention network model to extract the temporal and spatial features of the real-time traffic flow data; concatenating the temporal and spatial features and inputting them into a spatiotemporal attention module, adaptively fusing the temporal and spatial features, and outputting spatiotemporal features; and passing the spatiotemporal features output by the spatiotemporal attention network through a fully connected layer to generate predicted traffic flow data. The present invention alleviates the vanishing gradient problem and network degradation associated with increased network depth that may be encountered when processing long time series by using a temporal convolutional network with residual connections. Furthermore, the graph attention mechanism combined with node2vec enables more efficient modeling of spatial correlations and adaptive learning of spatial features, thereby improving the accuracy of traffic flow prediction.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Classification and identification method of underwater wavelength scale sound scattering object based on continuous wavelet transform and Botnet

The invention discloses an underwater wavelength scale sound scattering object classification and identification method based on continuous wavelet transform and Botnet, and the method comprises the steps: extracting the time-frequency joint features of a sound scattering signal through the continuous wavelet transform, and processing an obtained time-frequency graph through the feature extraction capability based on a convolutional neural network method, thereby recognizing and classifying an object. According to the method, a framework of ultrasonic scattering-time frequency analysis-deep learning is provided, the gradient disappearance problem in deep network training is effectively relieved through cross-layer jump connection, and it is ensured that the model can capture multi-level detailed information in a time frequency feature map; and global structure information of a time-frequency domain can be mined through a self-attention mechanism, so that the precision of a multi-category classification task is improved.
Owner:NANJING UNIV OF SCI & TECH

A lightweight pest recognition method based on Transformer structure

The present invention relates to a lightweight pest recognition method based on a Transformer structure, which belongs to the field of deep learning and comprises the following steps: S1: extracting shallow features of pest images using a focused fast downsampling module; S2: extracting global feature information in a deep feature map using a multi-head self-attention module; S3: adding local feature sensitivity and scale invariance information to the deep feature map using local convolution; S4: performing feature splicing on the global feature information with the local feature sensitivity and scale invariance information to obtain a pest image rich in semantic information, sending the global feature information to a multi-layer perceptron, and performing feature fitting on the fused feature tensor; S5: reducing the gradient vanishing problem of the network through residual connection, and integrating the information in the channel through point-by-point convolution; and S6: using a pooling mechanism to classify the finally calculated feature representation through a classification module.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Network intrusion detection method, terminal device and storage medium

The present invention discloses a network intrusion detection method, terminal device and storage medium. It calculates the feature importance based on the LightGBM feature selection method, performs feature screening according to the importance score, improves the interpretability of the IDS, eliminates redundant features in the data to prevent the model from overfitting redundant data, and improves the generalization performance of the model. Experiments have verified that compared with other feature selection methods, the method of the present invention significantly improves the accuracy of the model. By enhancing the convolutional network, the present invention designs a dual-channel residual convolution module, which effectively solves the gradient disappearance problem, optimizes the feature fusion mechanism, and improves the generalization ability of the model. In addition, in response to the problems of high computational complexity and difficulty in capturing deep-level dependencies faced by ordinary attention modules when processing long sequences, a residual BA module is designed. By introducing residual connections, the model is easier to learn the residual between input and output, and the model's ability to capture deep-level features and dependencies is enhanced.
Owner:HUNAN UNIV

A plug-and-play model inversion attack method based on a generative model in a collaborative reasoning environment

PendingCN122368669AData setAlgorithm
This invention discloses a plug-and-play model inversion attack method based on a generative model in a collaborative reasoning environment. This method uses a pre-trained StyleGAN2 as the target-independent image prior, leveraging its mapping and synthesis networks in the generator structure to map latent vectors into intermediate representations to generate images. During the attack optimization process, to address the gradient vanishing problem easily caused by traditional cross-entropy loss, a Poincaré loss function is introduced, utilizing the gradient preservation properties of non-Euclidean space to ensure the stability of the optimization process. Simultaneously, through standard image transformation and random image transformation techniques, the difference between the target data distribution and the image prior is effectively reduced, enhancing the robustness of the generated features. This method effectively overcomes limitations such as high computational resource consumption, insufficient flexibility, and sensitivity to changes in dataset distribution. In high-resolution scenarios such as face recognition, it demonstrates outstanding attack efficiency and generated image quality.
Owner:BEIJING UNIV OF TECH

XSS attack detection method and system based on multi-model fusion

The invention relates to the technical field of network security, and discloses an XSS attack detection method and system based on multi-model fusion, and the system comprises a traffic data cleaning module, a feature extraction module, a traffic detection module and an instruction generation module. According to the method, hidden features in the front-back direction are captured by adopting a BiTCN to better obtain long-time dependency of a sequence, then, output of the BiTCN is further processed by utilizing a BiGRU layer, and the BiGRU enhances the memory ability of a model by combining a forward GRU and a reverse GRU, so that the model can learn dynamic changes of data from two directions, and therefore, the reliability of the model is improved. The method improves the perception capability of the model for the dynamic change of the time sequence, reinforces the semantic representation of the key segment of the XSS attack through the multi-head self-attention dynamic distribution weight, can reinforce the interaction between the internal features of the model through weight distribution and an attention layer, enables the model to learn more complex and abstract feature representation, and improves the accuracy of the model. And the problem of deep network gradient disappearance is solved by combining residual connection.
Owner:CHUZHOU UNIV +1

Intelligent cooperative control method for flexible lander of small celestial body

The intelligent collaborative control method for a small celestial body flexible lander disclosed in the present invention belongs to the field of deep space exploration technology. The implementation method of the present invention is: using a flexible lander intelligent dynamics model based on deep neural network training instead of a discrete curvature dynamics model. Using an LSTM-based RNN to learn the sequence data of the discrete curvature dynamics model of the flexible lander and train the flexible lander intelligent dynamics model is beneficial to avoid the gradient vanishing problem caused by too long a sequence. At the same time, it can memorize the motion evolution law of the flexible lander, extract the motion state correlation relationship of the lander dynamics model data at the time level through the memory unit of the LSTM network, and use the motion state correlation relationship to improve the fitting efficiency of the flexible lander dynamics model. The present invention uses the flexible lander intelligent dynamics model to design the attachment control compensation term, reduce the lander motion error, and improve the autonomous control accuracy and real-time performance of the flexible lander during the attachment process.
Owner:BEIJING INST OF TECH

A high-speed lithium battery energy state estimation method

The present invention discloses a high-speed lithium battery energy state estimation method, which belongs to the field of electric vehicles. The method comprises: performing multi-time scale modeling and hierarchical feature extraction on the current, voltage, and power data of the lithium battery through a deep echo state network, and independently adjusting the hyperparameters of each layer using a parameter differentiation strategy to adapt to different dynamic characteristic inputs. Furthermore, a modal decomposition denoising module is used to remove sudden changes in output signals during the prediction process, thereby improving prediction accuracy and stability. Experimental verification shows that the method exhibits high-speed prediction performance, high accuracy, and high ease of use under a variety of real-world automotive operating conditions. It not only has the ability to quickly train and efficiently predict, but also effectively avoids the gradient vanishing problem in traditional recurrent neural networks while maintaining high accuracy and robustness.
Owner:SOUTHWEAT UNIV OF SCI & TECH