375 results about "Feed forward network" patented technology

The invention provides a service prediction method and device based on a time sequence model, equipment and a storage medium, and the method comprises the steps: carrying out the preprocessing of historical time sequence data, and obtaining a training data set; performing fast Fourier transform on the training data set to obtain frequency domain data and frequency component intensity; extracting a plurality of main frequency components and corresponding period values from the frequency domain data, and determining a plurality of two-dimensional feature tensors according to the period values and the training data set; constructing L layers of time blocks including feature mapping, an attention mechanism and a feedforward network according to the two-dimensional feature tensor, and establishing residual connection between adjacent time blocks to obtain a time sequence model to be trained; performing feature extraction on each two-dimensional feature tensor by applying a multi-branch convolutional network to obtain a one-dimensional representation vector, and performing weighted fusion on the one-dimensional representation vector according to the frequency component intensity to obtain a fusion feature; and training the to-be-trained time sequence model through the fusion features, and outputting an analysis report of historical time sequence data.

The invention provides a complex scene-oriented AI large model lightweight deployment method, and relates to the technical field of edge computing, and the method comprises the steps: carrying out the structured pruning of a pre-trained Transform network based on the attention head importance score, carrying out the dynamic sparsification of the activation state of a feedforward network according to the input tensor entropy value, employing the dynamic mixing precision quantization, and carrying out the reconstruction of an AI large model. Obtaining network parameters after pruning quantization; deploying the pruned and quantized network parameters to an edge computing device, distributing a feature extraction operator to a neural network processor through a heterogeneous computing scheduler, and unloading a classification operator to a multi-core central processing unit; and managing an on-chip memory in combination with a virtual memory paging mechanism, realizing zero-copy data transmission by utilizing a direct memory access controller, and outputting a reasoning result tensor. According to the method, efficient and reliable operation of the large model at the resource-constrained edge node is realized.

The invention relates to an innovative embedded reconstructed text-image alignment style migration method, which comprises the following steps of: constructing a basic framework based on a diffusion model, and adding noise through a forward process and denoising to learn image style characteristics. And extracting style embedding from the artwork data set by utilizing perceptron attention and a feedforward network. Text embedding is generated through a text encoder, and guidance is provided for style migration. A cross attention mechanism is adopted to fuse style embedding and text embedding, multi-modal embedding is generated, and interaction of text and image information is optimized. And fusing multi-modal embedding and image embedding through linear interpolation, splicing with text embedding to form complete prompt embedding, and integrating the prompt embedding into a diffusion model to generate a style image matched with text description. According to the method, the quality and diversity of artistic image style migration are remarkably improved, the method has wide application potential in the field of artistic creation and design, rich and diversified stylized visual achievements can be provided, and the requirements of multiple creation scenes are met.

The invention provides an end-side multi-modal large model accelerated reasoning method and system, and the method comprises the steps: carrying out the two-stage screening and rearrangement of visual tokens based on the CLS attention and text-to-visual attention in a visual encoder and pre-filling stage, and constructing a sparse attention and sparse key value cache; in a decoding stage, an important neuron set is judged according to activation gating or historical statistics, only a corresponding feedforward network weight is pulled and calculated, missed weights are loaded on demand through asynchronous I / O, and hot neurons are maintained in a high-speed memory to utilize model sparsity, so that video memory / memory occupancy and calculation overhead are remarkably reduced on an end side; throughput and time delay performance are improved. According to the method, the internal memory and computing resources required by reasoning of the multi-modal large language model are reduced from two dimensions by utilizing the endogenous sparsity of the end-side large language model in input and the model, so that a higher reasoning speed is achieved by utilizing fewer resources on the premise of keeping the size of the model unchanged, and the performance of the whole system is improved.

The invention provides a Zip-MoE model grouping hybrid expert layer-based Chinese and English speech recognition method and system, a Zip-MoE model comprises six encoder blocks, a Bypass module is included between every two encoder blocks, and the weights of the output of the previous encoder block and the output of the current encoder block are learned; the first three encoder blocks are of a standard Zipform structure; the last three encoder blocks adopt a Zipform-MoE structure containing a grouped hybrid expert layer, and the grouped hybrid expert layer is used for replacing the last feed-forward network of the Zipform structure; the grouping mixed expert layer comprises a Chinese expert group, an English expert group and a language router, and each expert group is composed of a plurality of expert networks and is provided with an unsupervised router. The problem of language confusion is relieved, different time delay streaming scenes can be adapted, the number of experts is flexibly expanded, pre-training is not needed, and the Chinese and English recognition efficiency is greatly improved.

The invention discloses a multi-mode electroencephalogram analysis model construction method and an online processing method and system. According to the method, multi-modal physiological signals such as electroencephalogram, electrocardio, skin electrical activity and eye movement are collected, and an integrated multi-modal signal collection device is used for preprocessing and feature extraction. A modal expert system based on an adaptive Transform architecture is adopted to replace a standard feed-forward network so as to enhance the feature processing capability. By means of the method, the features can be complemented under the condition of mode or data missing, the robustness, real-time performance and accuracy of the brain-computer interface technology in multi-mode data processing are improved, and the method is particularly suitable for the fields of emotion recognition, cognitive load monitoring, neural rehabilitation and the like.

The invention provides an image recognition and classification method, system and device and a medium, and belongs to the field of image model optimization. The method comprises the following steps: acquiring a to-be-processed image, and carrying out normalization and zooming processing on the image to generate a target image; performing block processing and vectorization processing on the target image to generate a plurality of image blocks containing one-dimensional vectors as initial feature vectors; inputting the initial feature vector into a hybrid expert module, and calculating a routing weight of an expert network through a gating mechanism; activating the expert network for processing the data by adopting a sparse activation mechanism based on the calculated routing weight; outputting a feature vector according to the initial feature vector by using the MoE layer based on the activated expert network; and performing aggregation processing on the feature vectors through a multi-head self-attention mechanism and a feedforward network, and generating a classification result of the to-be-processed image by using a classifier. The invention provides an efficient, flexible and excellent-performance solution for the field of image recognition and classification.

The invention discloses a medical image classification method and system based on multi-scale spatial state modeling, and the method comprises the steps: firstly dividing an input medical image into a plurality of non-overlapping image blocks, and mapping the non-overlapping image blocks to a feature space through a learnable linear projection layer to obtain an initial feature map; then, multiple layers of stacked MS-SMamba blocks are used for carrying out layer-by-layer feature extraction, each MS-SMamba block comprises a main branch, an auxiliary branch, a dynamic gating fusion network, a residual error connection unit and a feedforward network, and long-range dependency relation capture and multi-scale feature fusion are achieved; and finally, processing the last-layer output feature map through a global feature aggregation and classification module, generating a global feature vector, and outputting a classification result. According to the method, the capturing capability of complex pathological features in the medical image is improved, the calculation efficiency and clinical applicability are improved, and the method is suitable for scenes such as disease screening and auxiliary decision making in medical image diagnosis.

The invention discloses a road defect detection method based on an improved RT-DETR-R18 model. A backbone network adopts a CSPNet architecture. According to the invention, innovative improvement is carried out on an original C2f module, and Bottleneck in the original C2f module is replaced by DynamicIncMixerBlock to form a C2fDCMB module. The DynamicIncMixerBlock is characterized in that a DynamicIncMixerBlock is fused with a DynamicInceptionMixer component and a ConvolutionalGLU component, and the DynamicIncMixerBlock and the ConvolutionalGLU component are fused with each other. A dynamic Inception deep convolution structure is adopted by the DynamicInception Mixer, and features of different scales and directions are adaptively captured through dynamic kernel weight distribution; according to the method, AIFI (intra-scale feature interaction) in a high-efficiency hybrid encoder is improved, a module is combined with an EfficentAdditiveAttach and a feedforward network structure to form TransformerEncoder LayerEfficentAdditiveAttach, a RepC3 module is replaced by a RetBlockC3 module in a cross-scale feature fusion module (CCFM) through a multi-head attention mechanism and a nonlinear activation function, the RetBlockC3 is improved based on the RepC3, RetBlock and RelPos2d are introduced, and the RetBlock and RelPos2d are introduced into the RetBlockC3 module to form a multi-scale feature fusion module. According to the method, the accuracy, recall rate and detection speed of road defect detection are obviously superior to those of a traditional detection model, and a more accurate and efficient technical solution is provided for maintenance of road infrastructures and traffic safety guarantee.

The invention provides a magnetic particle imaging resolution improving method and system based on frequency domain information filtering, and relates to the technical field of magnetic particle imaging. Comprising the following steps: inputting original magnetic particle imaging data into a Transform model, and selectively filtering frequency domain information in the magnetic particle imaging data through a fusion frequency domain discrimination feedforward network module in an encoder to obtain the output of the encoder; inputting the output of the encoder into a bottleneck layer, aggregating global and local information through a multi-scale attention mechanism module, and then selectively filtering frequency domain information in the magnetic particle imaging data again to obtain the output of the bottleneck layer; inputting the output of the bottleneck layer into a decoder with the same structure as the bottleneck layer to obtain deep features; inputting the deep features into a convolutional layer to obtain a residual image; and calculating the sum of the original magnetic particle imaging data and the residual image to obtain a reconstructed image. According to the invention, the overall imaging resolution of the MPI image under the low-gradient field acquisition condition is improved.

The invention discloses a power transmission line insulator multi-modal multi-type defect detection method based on an MEWL-YOLO model. The method comprises the following steps: acquiring a multi-modal power transmission line data set; constructing an insulator multi-type defect detection model of the MEWL-YOLO model; the method specifically comprises the steps that on the basis of a YOLOv10n network framework, a multi-head attention mechanism and a gated convolution feedforward network are combined, a multi-head gated convolution feedforward network MGDB module is designed, and a C2K layer is optimized; a multi-scale efficient attention mechanism (EMA) is inserted into the Neck part of the YOLOv10n network; an Inner-Wise-MPDIOU loss function is adopted to replace a traditional loss function; a detection head in a YOLOv10n network is replaced by an LSCD lightweight detection head, and defect detection is carried out on the power transmission line insulator based on an insulator multi-type defect detection model of a constructed MEWL-YOLO model. According to the method, the MEWL-YOLO model is provided to realize defect detection of the multi-modal power transmission line insulator image, the detection effect of multi-modal and multi-type defects is improved, and the method has good practical application value.

The invention discloses a physical-data dual-drive retaining wall catastrophe robustness evaluation method, and relates to the technical field of structure catastrophe evaluation and computer science crossing. Aiming at the problems that an existing retaining wall catastrophe robustness evaluation method cannot correct physical model errors in real time and is insufficient in accuracy, the invention provides a retaining wall catastrophe process robustness evaluation method driven by fusion of a physical model and a neural network. The method comprises the following steps: 1, carrying out time discretization and parameter vectorization on retaining wall catastrophe monitoring parameters; 2, constructing a performance attenuation function based on the physical model; 3, updating an implicit damage state in combination with a neural network Cell module; 4, correcting an error through a feedforward network to obtain a total performance attenuation function; and 5, finally calculating a robustness index and outputting a corresponding robustness grade, thereby realizing quantitative evaluation of the retaining wall catastrophe robustness. Reliable quantitative support can be provided for retaining wall design optimization, operation monitoring and post-disaster recovery evaluation.

The invention discloses an adaptive TimeXer model photovoltaic power prediction method and system based on weather typing, and belongs to the technical field of photovoltaic power generation, and the method comprises the steps: dividing a historical photovoltaic power sequence into time patches, carrying out PatchEmbedded projection on the time patches to generate time stamps, and generating learnable global stamps; the method comprises the following steps: carrying out standardization processing on meteorological data, carrying out clustering to generate a weather classification label, converting the weather classification label into a discrete variable label, and carrying out Variate Embedded projection on the standardized continuous meteorological data to generate a continuous meteorological factor; performing endogenous self-attention calculation on learnable global marks, continuous meteorological factors and discrete variable marks to obtain attention weights among the time marks, aggregating the continuous meteorological factors and the discrete variable marks by using the attention weights among the time marks through cross attention processing, and inputting multi-scale feature marks into a feedforward network to obtain a multi-scale feature mark; and adjusting the frequency domain of the predicted value by using a Fourier mixing layer to obtain a final prediction result.

The invention discloses a double-branch pyramid attention time sequence prediction method, which belongs to the field of time sequence prediction, and comprises the following steps of: supplementing and standardizing input sequence deletion, and embedding and aligning time covariables; a horizontal branch coding time domain and a vertical branch coding variable are dynamically fused to obtain a unified feature; multi-scale representation is formed through multi-layer convolution down-sampling, and information interaction is completed through local-cross-scale mask attention. The result is subjected to pyramid residual normalization and feedforward network updating, a global context is generated through multilayer stacking, and a linear head outputs future multi-step prediction. The complexity of the method is O (L log L), long-range dependence and a fine-grained mode are captured at the same time, the method is remarkably superior to thirteen existing models on five data sets including ECL, Exchange and Trafic, and the method has the advantages of being high in precision, high in speed and easy to expand.

The invention provides a hierarchical hybrid structured compression method and device for a large language model, and relates to the technical field of artificial intelligence, and the method comprises the steps: determining the compression ratio of each layer of a target model based on the importance degree of each layer of the target model; based on the compression ratio of each layer, compressing the target model to obtain a compressed model; wherein the compression of the target model comprises the following steps: for a current processing layer, calculating a two-norm of an input activation value corresponding to each weight of the current processing layer on a calibration data set to obtain a characteristic norm; under the condition that the current processing layer is the multi-head attention sub-layer, performing weighted low-rank decomposition and differential singular value distribution processing on the current processing layer based on the characteristic norm of the current processing layer and the compression ratio of each layer; and under the condition that the current processing layer is the feedforward network sub-layer, performing channel pruning and compensation processing on the current processing layer based on the characteristic norm of the current processing layer and the compression ratio of each layer. Therefore, the compression ratio and the performance balance of the LLM are realized.

The invention relates to a complex medium inversion imaging method and system guided by a physical information neural network, and the method comprises the steps: constructing a two-dimensional grid model of a block structure with different medium distributions, obtaining out-of-plane displacement data at grid points through staggered grid finite difference, and forming a wave field full-waveform data set; constructing a physical information neural network, wherein the physical information neural network comprises a first feed-forward network for modeling a mapping relation of a displacement field of the sample, a second feed-forward network for modeling a velocity field of the sample, and a residual network; based on the wave field full-waveform data set, training a physical information neural network by taking minimization of compound loss as a target; and taking the space-time coordinates of the sample as input, and utilizing the trained physical information neural network to obtain predicted displacement and sound velocity of the corresponding position of the space-time coordinates, so as to realize inversion imaging of sound velocity medium distribution. According to the method, the ultrasonic propagation model of the complex medium can be quickly and accurately established under the condition that a small amount of marked data is used.

The invention relates to a Chinese grammar error correction method and system based on large model fine tuning. According to the method, a Qwen2-7B model is used for generating an error correction instruction data set; screening the instruction data set according to complexity, quality and diversity; performing supervised fine tuning on the Qwen2-7B model by adopting an LORA method, and emphatically optimizing a self-attention layer and a feedforward network layer so as to enhance the processing capability of the model on long-distance dependence and context information; then, a Qwen2-72B model is used for scoring the error correction data set, preference tags are generated, and the Qwen2-7B model is further optimized by using the tags, so that the response quality of the Qwen2-7B model is improved; a direct preference optimization method is used, a preference data set is combined to train the model, and parameters are adjusted to minimize a loss function, so that the tendency of the model to preference response is enhanced. According to the method, the accuracy of Chinese grammar error correction is effectively improved through a multi-level optimization strategy.

A processor-implemented method for converting a trained language model into a language model in an architecture of mixture of experts (MoE), and a computing device using the same is provided. The method for converting a trained language model into a language model in an architecture of mixture of experts using a computing device according to an embodiment of the disclosure may include dividing a plurality of layers included in a target language model and extracting a feed-forward network (FFN) included in each of the plurality of layers, generating an MoE block of the MoE language model, which corresponds to the feed-forward network, generating an input tensor, comparing output tensors between the feed-forward network and the MoE block for the input tensor to obtain a first loss, and updating a weight of the MoE block, based on the first loss.

The invention discloses an oil and gas exploitation stratum rapid prediction method and device, a storage medium and equipment, and belongs to the technical field of oil and gas field development. Comprises: constructing a data set; the data set comprises logging parameters of multiple wells in the target work area; constructing a deep learning model; the deep learning model comprises an encoder and a decoder, the encoder comprises a set number of encoder layers, and each encoder layer comprises a multi-head self-attention sub-layer and a full-connection feedforward network sub-layer; the decoder comprises a set number of decoder layers, and each decoder layer comprises a mask multi-head self-attention sub-layer, a multi-head self-attention sub-layer and a full-connection feedforward network sub-layer; training the constructed deep learning model through the data set, and iteratively updating parameters to obtain optimal model parameters; and obtaining logging parameters of a to-be-logged well and inputting the logging parameters into the trained deep learning model to obtain a stratum prediction result. The method has the advantages of higher prediction precision, higher prediction speed and higher applicability.

The invention relates to the field of well drilling anomaly detection, and discloses a well drilling abnormal vibration working condition detection method, device, equipment and medium, which can be realized by using a trained abnormal vibration working condition detection model, and the model comprises a multi-head self-attention layer, a feedforward network layer and a full connection layer. According to the invention, the multi-modal vibration data can be collected in the drilling operation, the multi-modal vibration data is input into the trained abnormal vibration condition detection model, and the multi-head self-attention layer efficiently captures the potential long-range dependency relationship among different modal vibration data in the multi-modal vibration data through a self-attention mechanism. And generating a multi-modal feature vector, and performing label detection by the feed-forward network layer and the full-connection layer according to the multi-modal feature vector output by the multi-head self-attention layer, thereby realizing detection of the abnormal vibration working condition of the drilling well and obtaining an abnormal vibration working condition detection result. The method can enrich the detection means of the abnormal vibration working condition in the drilling operation, and effectively improves the detection accuracy of the abnormal vibration working condition.

The invention discloses a feature hierarchical attention fusion and dynamic optimization method for single-stage target detection, and relates to the technical field of computer vision. The method comprises the steps of collecting image data, preprocessing an image and dividing the image into a training set, a test set and a verification set; the HAF-DRFPN neck network uses dynamic up-sampling single pixel point sampling to recover the feature resolution; feature extraction is optimized by using a gating residual mechanism and depth separable convolution; a feature refining feed-forward network is introduced through multi-layer perception generation weight, and feature expression is enhanced; respectively capturing and fusing superficial details and deep semantic information by utilizing channel and space attention and cross attention; a multi-branch dynamic sampling stacking framework is adopted, and cross-scale features are adaptively fused and optimized; multi-module cooperative processing is carried out on the whole architecture, and multi-scale features with higher discrimination are provided for the detection head; according to the method, the YOLO12 trunk and the detection head are connected with the HAF-DRFPN to form the model HAF-DRNet suitable for target detection, so that the flexibility and accuracy of single-stage target detection are improved.

The invention discloses a real haze image defogging method based on a haze degradation model. The method comprises the following steps: constructing a haze degradation model fusing multiple scattering effects and multiple image degradation factors; using the haze degradation model to construct a training data set including the clear image and the corresponding pseudo haze image; constructing a defogging network for a real haze scene; training the defogging network by adopting the training data set until a preset loss function is converged; and inputting a to-be-defogged image into the trained defogging network to obtain a defogging result. According to the haze degradation model constructed by the invention, the difference between a synthetic domain and a real domain is effectively relieved; a designed space-frequency hybrid module improves the adaptability of the model to complex degradation characteristics; the prior-guided feed-forward network fully excavates and fuses dark channel prior information, and the sensing and modeling capability of the model to the haze area is effectively enhanced.

The invention belongs to the technical field of image data processing, and particularly relates to a super-resolution remote sensing image reconstruction method, system and device based on frequency domain enhancement, and the method comprises the steps: S1, extracting the shallow features of a low-resolution remote sensing image; s2, inputting the shallow features into a plurality of cascaded frequencies for interactive processing, performing double-branch processing on the input features, performing inverse transformation after radial weighting on different frequency components in a frequency domain to obtain first features, and obtaining second features through depth separable convolution, an activation function, a selection scanning module and layer normalization; fusing the two branch features according to the weight, performing jump connection with the original features, performing enhancement through a feedforward network, performing repeated execution for a set number of times, and performing convolution and residual connection to obtain deep features; and S3, fusing the deep features and the shallow features, and outputting a super-resolution image through convolution and pixel rearrangement up-sampling. According to the method, texture details and edge contours of the remote sensing image can be more accurately reconstructed while the structural consistency is kept.

The invention provides a construction method and device of a cerebral apoplexy early diagnosis model, electronic equipment and a storage medium, which are applied to the field of model construction, and in a transformer training process, channel reduction or channel expansion is performed on a feedforward network based on an activation matrix and a current width of the feedforward network of transformer to adjust the width of the feedforward network, so that the accuracy of the cerebral apoplexy early diagnosis model is improved. On the premise of not sacrificing the model performance, the parameter quantity and video memory occupation are reduced, the computing resource overhead of a cerebral apoplexy early diagnosis system is reduced, and the adaptability is enhanced.

The invention discloses an image classification method and system based on a pruning deep learning model, and the method comprises the steps: obtaining a deep learning model, carrying out the pruning operation of the deep learning model, and obtaining a pruning deep learning model; a pruning operation is carried out, and the pruning operation comprises the step of carrying out pruning operation on a multi-head attention mechanism layer (Multi-head attention) and a full-connection feed-forward network (FFN) of each encoder Transform Ender by adopting a genetic algorithm in a Vision Transform model, and the step of carrying out pruning operation on the multi-head attention mechanism layer (Multi-head attention) and the full-connection feed-forward network (FFN) of each encoder Transform Ender; obtaining a trained pruning deep learning model; and obtaining a to-be-classified image, and inputting the to-be-classified image into the trained pruning deep learning model to obtain an image classification result.

The invention discloses a model illusion detection method and device based on internal state fusion and a medium, and relates to the technical field of natural language processing. The method comprises the following steps: extracting multi-modal features in a forward propagation process of a target large language model, wherein the multi-modal features comprise a hidden layer embedding feature, an attention feature, a feedforward network activation feature and a text feature; aligning the multi-modal features to the lexical element length of the generated text through an interpolation method, and calculating the weight of the position of the lexical element corresponding to the multi-modal features; performing weighted fusion on the multi-modal features according to the weights to generate a fusion feature sequence; and constructing the fusion feature sequence into a graph structure, reasoning the graph structure by using a multi-layer attention network, and outputting a lexical-level illusion probability through a classification head. According to the method, the target model parameters do not need to be modified, and high-precision detection can be completed only through single-time forward propagation.

The invention relates to the field of data anomaly detection, and particularly discloses a multi-stage anomaly detection system based on multivariable time sequence data, which comprises an input data acquisition module used for acquiring time sequence multivariable data; the MTS-Mixer spatio-temporal feature extraction module is used for extracting multi-level time sequence correlation features through a feature mixing technology and generating low-rank compression prediction features; the time sequence anomaly detection module is used for realizing anomaly positioning and classification by adopting alternate stacking of an Angle-Attention layer and a feed-forward network, expanding anomaly differences in combination with prior constraints and adversarial learning and fusing reconstruction errors and association differences to generate anomaly scores; and the attention mechanism soft thresholding module is used for suppressing noise, enhancing key signals and outputting high signal-to-noise ratio representation. According to the method, multiple technologies are integrated, and real-time anomaly detection and interpretable positioning of the high-dimensional time series data are realized through multi-stage collaborative optimization.

The invention discloses an SAR ship image detection method based on an improved YOLOv11 model, an improved C2PSA module C2DyMoETAttn is introduced, the core innovation point is that a PSABlock module is replaced by a DyMoETAttnBlock module, the DyMoETAttnBlock module fuses a Dynamic Tanh activation function, a Mona module, a TSSA attention mechanism and a frequency domain enhancement feedforward network (EDFFN), multi-dimensional modeling and robust enhancement of features are realized, and the detection accuracy is improved. The feature expression capability and the noise suppression performance under the background of small targets and complex sea clutters are effectively improved; in the deep feature fusion stage, a C3k2 module of YOLOv11 is optimized, an ScConv structure is introduced, adaptive fusion of space and channel features is realized through a joint reweighting mechanism of SRU and CRU, and the multi-scale target discrimination capability and feature selectivity are enhanced; on the bounding box regression layer, a Focaler-MPDIOU loss function is provided, and a Focaler-IoU sample difficulty adaptive mechanism is combined with MPDIOU positioning matching constraint, so that the learning ability of the model for small targets and shielded targets is enhanced, and the bounding box positioning precision and convergence stability are improved.

The invention provides a knowledge editing-based large-model adaptive detoxification method and device, and relates to the technical field of natural language processing. The method comprises the following steps: constructing a knowledge editing-based large-model adaptive detoxification model; inputting the constructed training set into a large language model to obtain a feature vector; constructing training sample data according to the feature vectors; training a toxicity detection module according to the training sample data to obtain a trained toxicity detection module; inserting the trained toxicity detection module into a target layer of the large language model, and sensing through a toxicity feature sensing module to obtain a classification result; inputting the classification result into an anti-toxicity feedforward calculation module, and determining a parameter matrix to be detoxified through a parameter isolation editing strategy; optimizing by adopting a gradient optimization method and a knowledge editing method to obtain a detoxified feedforward network; and according to the detoxified feedforward network, obtaining a detoxified large language model. According to the invention, the calculation cost can be reduced.

The invention relates to the technical field of computer vision, and discloses a multi-modal image fusion method and system, a medium and equipment, and the method comprises the steps: carrying out the basic feature extraction and detail feature extraction of a visible light image and an infrared image; according to the basic feature extraction, after self-attention operation and channel-local composite attention operation are carried out on image features, gating mechanism fusion, feedforward network processing and domain specific batch normalization are carried out in sequence; according to the detail feature extraction, image features are divided into two branches, and then detail node operation, channel dimension splicing operation, channel-local composite attention operation, attention weight fusion operation and domain specific batch normalization are carried out in sequence. Carrying out adaptive fusion on the basic features; and carrying out adaptive fusion on the detail features, and obtaining a fused output image through a decoder. And the quality and information integrity of the fused image are enhanced.