95 results about "Expressive communication ability" patented technology

The invention discloses a feature attention and bilinear gating fused speech emotion recognition method and device, and the method comprises the following steps: 1, collecting an audio file, obtaining corresponding label information, generating audio waveform and time frequency representation data through preprocessing, and constructing an audio waveform mask and a time frequency mask to mark an effective information region; 2, constructing a dual-path feature extraction module which comprises a time-frequency feature extraction module and a pre-training acoustic feature coding module; wherein the time-frequency feature extraction module models emotion correlation through local convolution and a multi-dimensional attention mechanism, and performs global time sequence modeling based on a bidirectional gated loop network; the pre-training acoustic feature coding module extracts high-level speech representation with high expression ability for emotion distinguishing by using a pre-training model; and step 3, constructing a feature fusion module and an emotion classification module, and combining with a dual-path feature extraction module to form a speech emotion recognition model.

The invention relates to the technical field of speech processing, can be applied to business scenes of medical health, financial science and technology and the like, and discloses a speech enhancement method based on multi-scale feature learning, which comprises the following steps: framing an input audio signal, extracting a Mel-frequency spectrum feature, extracting a frequency domain feature by using a multi-scale convolutional neural network, and carrying out multi-scale feature learning on the frequency domain feature; carrying out coding dimension reduction on the image; noise is suppressed through a deep residual network, enhanced audio features are generated, a non-autoregression generative model is adopted for feature conversion, and finally a generative adversarial network is used for reconstructing a target voice waveform. Voice frequency domain features are extracted through the multi-scale convolutional neural network, and the feature expression ability of different frequency bands is improved; noise suppression is carried out through a deep residual network, and the purity of the voice signals is enhanced; feature conversion is optimized through a non-autoregression generation model, and the modeling efficiency of speech enhancement is improved; the target voice waveform is reconstructed through the generative adversarial network, and the naturalness and definition of the generated voice are improved.

The invention discloses an intelligent psychological state assessment method and system based on multi-modal alignment, and relates to the technical field of psychological assessment, and the method comprises the following steps: S1, constructing a training sample set of a psychological state assessment model; s2, preprocessing video data, voice data and text data in the training data sample set; s3, performing alignment and fusion by using multi-modal cross attention, taking the text data as a main modal, and taking the video data and the voice data as assistance of the text data to obtain multi-modal fusion features for psychological state analysis; s4, training by using the aligned and fused multi-modal fusion features to obtain a psychological state analysis model; and S5, obtaining a multi-dimensional psychological analysis result of the testee through the psychological state analysis model obtained through training. According to the method, the multi-modal deep features of the teenagers are extracted by pre-training the large model, and the feature expression ability of the data is improved by using the modal alignment technology.

The invention relates to the technical field of voice signal processing, and discloses a voice emotion recognition method, device and equipment and a readable storage medium, and the voice emotion recognition method comprises the steps: obtaining a target voice signal, and executing sampling processing to obtain voice sampling data; extracting a plurality of acoustic features based on the voice sampling data, and constructing initial feature representation; in combination with environment signal-to-noise ratio information, performing channel weighted fusion processing to generate fusion feature representation; inputting the fusion feature representation into a time sequence modeling network, and extracting context information to obtain time sequence abstract features; and executing emotion recognition processing based on the time sequence abstract features to generate a corresponding emotion recognition result. According to the method, the emotion recognition accuracy in a multi-noise environment is improved, the expression ability of fine-grained emotion features such as speech speed changes and rhythm fluctuations is enhanced, the dynamic adaptability to environment changes in the feature fusion process is achieved, and higher recognition stability and environment adaptability are achieved.

The invention discloses an end-to-end deep counterfeit voice detection system and method, and belongs to the technical field of voice processing. The detection system is divided into a front-end embedded extraction network and a rear-end classification network. And the front-end embedded extraction network adopts a front-end pre-training model to extract global semantic features of different scales of the voice signals, and adopts a feature fusion module to perform deep fusion on the extracted global semantic features of different scales, so that the expression ability of feature embedding is further enhanced. And the rear-end classification network adopts a single-layer long-short-term memory classification network to classify the fusion features, performs joint optimization by using cross entropy loss and center loss, and finally judges whether the voice is real or forged. The method is applied to scenes of voice security, identity authentication, voice assistants and the like, a more accurate and robust deep counterfeit voice detection scheme with good generalization ability can be provided, and the method has important significance for improving the security and credibility of a voice recognition system.

The invention discloses a situation simulation method and system based on a vehicle-mounted large language model, and belongs to the technical field of vehicle-mounted artificial intelligence, and the method comprises the steps: carrying out simulation situation construction and role setting based on a simulation situation type and a role selected by a user, and generating a virtual dialogue scene; voice features and emotional states of the user are analyzed, and simulation situation construction and role setting are dynamically adjusted; according to the voice features and the emotional state, selecting a proper voice synthesis role from a vehicle-mounted voice database to represent the voice of the role of the opposite side; based on the language and the expression content of the user, using a large language model to generate words and logics of the role of the opposite side; and real-time situational simulation feedback of the opposite role is provided according to the synthesized role and the generated words and logics of the opposite role in combination with real-time analysis of the voice feature and the emotional state of the user. The method helps the user to improve the expression ability and emotion management ability in a specific scene. A user is allowed to select an interested simulation situation from a preset situation library.

The invention discloses a teaching speech emotion recognition method based on dynamic time sequence modeling and multi-scale fusion. The method comprises the steps of speech data set preprocessing, speech feature extraction, speech emotion classification network construction, speech emotion classification network training, inputting a test set into the trained speech emotion classification network, and outputting the probability of each type of emotion. According to the method, the direction of the information flow is dynamically adjusted through the adaptive time displacement module, the features of different time scales are extracted by using the multi-scale convolution branch, the modeling capability of the model for a complex time sequence structure and variation data is improved, the feature expression is enhanced, the time sequence features are extracted by using the Wav2Vec2.0 pre-training model, and the time sequence features are extracted by using the Wav2Vec2.0 pre-training model. A speech emotion classification network comprising an AdaShiftFormer learning module and a multi-scale time sequence fusion module is constructed, training is carried out in combination with classification loss and comparison loss, and classification performance is optimized. The method is superior to the prior art in emotion classification accuracy and feature expression ability, and can assist in teacher speech behavior analysis and classroom interaction optimization in an intelligent education scene.

The invention provides a voice synthesis method and system based on VITS improvement, and the method comprises the steps: optimizing a text encoder of a VITS model, introducing a large language model, and enabling the emotion, intention and speaking style of an input text to be captured when the text is encoded; a random disturbance item is introduced when the Q value is dynamically planned and solved, the alignment flexibility in the initial training stage is improved, meanwhile, monotonicity constraint is strictly kept, and it is avoided that a suboptimal solution is obtained through convergence too early; a ConvNeXt module is used as a basic backbone network of a decoder, and ISTFT is utilized to efficiently reconstruct a time domain signal, so that waveform up-sampling is realized, redundant calculation of traditional transpose convolution is avoided, and reasoning is accelerated. According to the method, the reasoning speed, the emotion expression ability and the style control flexibility of speech synthesis can be effectively improved, a new solution is provided for cross-language diversified speech synthesis, and a reference is provided for the more efficient and more intelligent development of the speech synthesis technology.

The invention discloses a sound authenticity identification method based on multi-modal feature deep interactive fusion. According to the method, a double-flow architecture is adopted, and a pre-trained BEATs model and a CNN14 network are respectively utilized to extract Transform sequence features and convolution time-frequency embedding features of an audio; an adaptive MobileFormer fusion device is innovatively proposed, an original MobileFormer structure used in the image field is transformed into a bidirectional cross-modal interaction module suitable for one-dimensional time sequence audio features, dynamic complementary modeling of local details and global semantic features is achieved through a cross attention mechanism, and dynamic nonlinearity is introduced to activate and enhance the expression ability; and the fused enhanced features are input into a hierarchical graph attention network ASSIST, and high-order semantic modeling and authenticity classification are completed by combining spectrogram and time sequence double-flow reasoning. Experimental results show that the performance of the method on an ASVspoof2021LA data set is superior to that of an existing baseline model. The method can effectively detect AI generation voice, replay attack and other forged voice, and is suitable for a voice authentication system.

The invention relates to the technical field of voiceprint recognition, and discloses an air-ground conversation speaker recognition method for short voice and complex noise, which dynamically suppresses background noise through a self-adaptive filter in combination with a minimum mean square algorithm, and improves the voice signal quality. A multi-scale feature fusion technology is adopted, short-time Fourier transform, filter bank energy features and multi-scale convolution are combined, a random time and frequency shielding data enhancement strategy is introduced, and the short speech feature expression ability is enhanced; bi-GRU is integrated in the ECAPA-TDNN model, and context information of multiple rounds of conversations is captured through context time sequence modeling, so that the recognition stability in a dynamic scene is improved; and an AAM-Softmax loss function is adopted to strengthen the distinguishing capability of the model, and finally identity judgment is realized through cosine similarity matching. According to the method, the voiceprint recognition precision and robustness under complex noise and short voice conditions are remarkably improved, and the safety risk caused by identity misjudgment in aviation communication is effectively reduced.

The invention provides an AI text recognition method and device based on ensemble learning and advanced semantic statistical feature analysis, and the method comprises the steps: 1, respectively sending a to-be-recognized text into a Bert detector and a high-order natural language statistical feature detector for recognition, the high-order natural language statistical feature detector comprises a word logarithm probability detector, a word ranking logarithm detector, an Entropy detector and a confusion degree detector; and 2, performing election on detection results output by the Bert detector and the high-order natural language statistical feature detector by using an election module to obtain an AI text recognition result. According to the method, an integrated learning strategy is adopted, and a pre-training language model subjected to fine tuning is combined with high-order natural language statistical characteristics, so that when the model detects a large language model to generate a text, the strong expression ability of the pre-training language model can be fully utilized, and a deep rule of the text can be captured through the high-order statistical characteristics; and the detection accuracy is improved.

The invention relates to a multi-modal knowledge representation learning method fusing a multi-attention mechanism and semantic enhancement, and aims to solve the problems that the multi-modal knowledge representation method is insufficient in multi-modal feature fusion and difficult to effectively model complex semantic relationships such as symmetric and anti-symmetric. The method comprises the following steps: firstly, extracting entity image and text features from a multi-modal knowledge graph by using a CLIP model, and extracting entity audio features by using a VGGish model; then image features are enhanced through spatial attention, and image-text feature fusion is realized through cross attention; designing a cross-modal fusion module to dynamically fuse the image-text features and the audio features to obtain multi-modal fusion features; and finally, extracting structured features based on a ComplEx model, integrating the structured features with multi-modal fusion features through an adaptive dual-channel scoring function, and optimizing a training process by adopting a contrast learning loss function. The multi-modal features can be fully fused, the semantic expression ability is enhanced, and the performance of downstream tasks such as intelligent question and answer is improved.

The invention discloses an incomplete multi-mode dialogue emotion recognition method and system based on a speaker and time sequence information joint graph network, and the method comprises the steps: obtaining the deep features of a text mode, a voice mode and a visual mode in a dialogue through a feature extraction module, and guaranteeing the high expression capability of the features through a pre-training model; the random mode missing simulation module effectively simulates the data incomplete condition in a real scene, and the robustness of the model is improved; a bi-directional long-short term memory network (Bi-LSTM) is combined with a time sequence diagram network (TGNN) to capture context and time dynamic characteristics of a dialogue, and meanwhile, an interaction relationship between speakers is modeled through a speaker influence matrix, so that joint modeling of a time sequence and speaker information is realized; the deep features are further extracted through the graph convolutional network, and the emotion discrimination of the features is enhanced; finally, the modal reconstruction and emotion classification module significantly improves the accuracy and robustness of incomplete multi-modal dialogue emotion recognition through reconstruction of missing modals and multi-class emotion prediction, and is suitable for man-machine interaction and emotion analysis application in a complex real scene.

The invention relates to the technical field of artificial intelligence and emotion recognition, and discloses a multi-modal emotion classification method and system based on corpus enhancement and cross-modal generation, and the method comprises the following steps: 1, carrying out the preprocessing and feature extraction of multi-modal data; wherein the multi-modal data comprises a video modal, a text modal and an audio modal; 2, projecting each modal feature to a low-dimensional shared space; wherein video, text and audio modal features are respectively mapped to a unified low-dimensional space through a full connection layer so as to eliminate dimension differences among modals, and an ReLU activation function is adopted to enhance expression ability; and step 3, performing feature enhancement based on a text library on each input modal feature to output the enhanced modal features. The scheme supports single-mode, dual-mode and three-mode input, adapts to diversity of data missing in practical application, and is high in model recognition accuracy.

The invention discloses a method and device for evaluating speech expression ability of neurological and mental diseases. According to the method, speech is induced through a visual stimulation material, speech data are collected, and after speech recognition, semantic calibration and text error correction, evaluation indexes are calculated from multiple dimensions of fluency, microcosmic linguistics and macroscopic linguistics in combination with a natural language processing technology, a large language model and a vector embedding technology, so that the evaluation accuracy is improved. And the result credibility is guaranteed through a robustness verification mechanism of iteration reflection of a double-big language model. According to the method, the problems of large subjective deviation, low efficiency and shallow analysis dimension of traditional evaluation are solved, and objective, accurate, efficient and comprehensive evaluation is realized.

The invention discloses a multi-language voiceprint recognition method based on a pre-training voice model. The pre-training voice model WavLM and a traditional voiceprint recognition model ECAPA-TDNN are fused. According to the method, a multi-layer perceptron (MLP) module is introduced for further refining and converting the features extracted by the WavLM, so that the features are more suitable for the input requirement of an ECAPA-TDNN model, and the abstraction and expression ability of the model to the features is enhanced. In the aspect of multilingual voiceprint recognition, the model is finely adjusted by using a small amount of voice data sets, and the method comprises the following basic steps of: firstly, freezing parameters of a pre-trained voice model WavLM, so that the pre-trained voice model WavLM keeps learned knowledge; and then, parameters of the MLP module and the ECAPA-TDNN model are continuously adjusted in training, so that the multilingual voiceprint recognition capability is learned. In the application, a to-be-recognized voice passes through the fusion model to obtain a feature vector, and after the vector is subjected to judgment and decision making, a voiceprint recognition result is obtained.

The invention relates to the technical field of voice signal processing, and discloses a method for realizing personalized singing synthesis model training through multi-modal voice driving, and the method comprises the following steps: obtaining multi-modal input data, including text, reference audio, speaker and emotional features; processing the data to obtain coding features; the inter-modal redundant information is evaluated and suppressed through redundant perception coding; compressing coding features by using an information bottleneck model, and retaining effective information; fusing the compressed features to generate personalized singing features; the input decoding module generates Mel spectrum features; and converting the Mel spectrum into an audio waveform through a vocoder, and outputting the audio waveform. And converting the Mel spectrum into an audio waveform through a vocoder, and outputting the audio waveform. According to the method, multi-modal data can be effectively fused, the individuation and emotion expression ability of the singing sound is improved, redundant information interference is reduced, the quality and efficiency of singing sound synthesis are improved, and finally, high-fidelity individualized singing sound is output.

The invention discloses a classification method and system for data enhancement and hybrid expert mechanism feature selection. The system comprises an automatic speech recognition (ASR) module, a text-to-speech synthesis (TTS) module, a multi-modal feature extraction module, a hybrid expert mechanism (MoE) module, a common attention mechanism module, a feature fusion module and a classification module. According to the invention, a voice data enhancement module based on a voice-to-text (TTS) technology is utilized to improve data diversity and model generalization ability; by means of multi-level acoustic and text feature extraction, language changes are represented more comprehensively; a hybrid expert mechanism (MoE) is utilized to realize dynamic selection of multi-modal features, and the feature utilization efficiency is improved; according to the method, the fusion mode between different modal features is optimized by using a co-attention mechanism, the interaction expression ability between the features is enhanced, the recognition precision and the robustness of the system in a multi-modal environment are remarkably improved, and the defects are overcome.

The invention belongs to the field of artificial intelligence, finance and medical treatment, and relates to a speech conversion method based on sentiment analysis, which comprises the following steps: inputting a preprocessed standard text data set into a pre-constructed conversion synthesis model, performing sentiment analysis through a sentiment analysis structure, combining an acoustic structure with a sentiment analysis result to obtain predicted acoustic features, and converting the predicted acoustic features into speech data. And performing voice waveform synthesis through a voice generator, adjusting training according to a preset loss function to obtain a final emotion voice synthesis model, inputting the to-be-converted text into the emotion voice synthesis model, and synthesizing target voice. The invention also provides a speech conversion device and equipment based on emotion analysis, and a storage medium. In addition, the invention also relates to a block chain technology, and the to-be-converted text can be stored in a block chain. According to the invention, the emotion expression ability is enhanced, and the coherence and fluency of voice are enhanced.

The invention discloses an emotional dialogue generation method and system fused with psychological information, and the emotional expression capability of generating response can be improved through the obtained global emotional latent variable fused with a speaker and a listener. By determining a multi-hop knowledge reasoning path set, obtaining context semantic representation of each knowledge reasoning path, and fusing the context semantic representation with dialogue history global context representation to obtain knowledge-enhanced context representation, the knowledge reasoning ability and semantic relevance in a dialogue context are improved; by constructing a knowledge representation matrix, taking a global emotion latent variable as a bias item, and dynamically adjusting the knowledge representation matrix and a value vector generated by knowledge-enhanced context representation through semantic features, multi-scale attention fusion representation is obtained, and the context adaptive capacity and emotion representation naturalness of generated response are effectively improved. According to the method, the psychological state of the user can be identified more accurately, and the dialogue response with humanization, estrus-sharing expression and interaction adaptability is generated.

The invention belongs to the technical field of multi-modal emotion recognition, and particularly relates to a multi-modal dialogue emotion recognition method based on uncertainty adaptive weighting. The method comprises the following steps: processing original modal information of each modal to obtain an alignment feature vector of each modal; calculating a cross-modal fusion feature of each cross-modal path based on the alignment feature vector of each modal; obtaining an uncertainty score of each cross-modal path according to the cross-modal fusion features of each path; obtaining the optimized weight of each path based on the initial weight and the uncertainty score of each path; and obtaining a predicted emotion category based on the optimized weights of all the paths and the cross-modal fusion features. According to the method, the expression ability of the non-text mode in the key emotion scene is remarkably enhanced while the semantic advantages of the text are kept.

This invention relates to the field of artificial intelligence technology and discloses a training method, apparatus, device, and storage medium for an emotional speech synthesis model, which can be applied to intelligent voice dialogue scenarios in finance, insurance, and medical fields. This invention selects at least one layer of a pre-trained speech synthesis model as the target layer, loads a VB-LoRA fine-tuning module onto the target layer, and then fine-tunes it using emotional speech data. This enables the model to achieve emotional speech synthesis and output. No emotional information is added during the training phase; emotional information is only added during fine-tuning. This allows for fine-tuning by adding emotional information of different emotion categories, giving the model the ability to express different emotion categories, thus enhancing the model's scalability and flexibility. Furthermore, during fine-tuning, only the parameters of the target layer with the VB-LoRA fine-tuning module are adjusted, eliminating the need for full parameter fine-tuning of the entire model, reducing the workload of model fine-tuning and lowering computational costs.

The application discloses a natural emotional singing method and an emotional singing audio processing method, and belongs to the singing information field, and aims to solve the problems of fragmented training elements and single feedback system of a traditional vocal music teaching method. The technical scheme comprises six training modules combined by action guidance, emotion awakening and sound area training, and a training system for improving singing emotional expression capability based on a deep learning model for real-time extraction of user singing audio emotional indexes and generation of dynamic visual feedback.

The invention discloses a voice keyword recognition method based on CNN-LSTM and online knowledge distillation, and relates to the technical field of voice processing. According to the method, an improved contraction residual attention module is introduced into a CNN-LSTM-based neural network model and is used for discovering and inhibiting redundant information and noise in features, and the expression ability of the features is enhanced. According to the method, a training method based on online knowledge distillation is introduced, the current training iteration is supervised by using information in the previous two training iterations, and an extra regularization effect is provided for the training process by using the difference in prediction probabilities output by a neural network model. The overfitting risk of the neural network model is reduced, and the generalization ability of the neural network model is enhanced.

The invention relates to the technical field of speech synthesis, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a speech generation method and device based on preference alignment, equipment and a medium, and the method comprises the steps: obtaining a pre-training speech generation model and a preference training sample pair, constructing a preference alignment model and a non-preference alignment model, and taking the pre-training model as a reference; determining a loss function based on the preference samples and the non-preference samples, and updating model parameters to obtain a trained model; and receiving a target condition item and generating an agent prompt in a reasoning stage, fusing speed prediction results of the two types of models, and generating a target voice based on a fusion result in a stream matching process. According to the method, human preference signals are fused through a preference alignment mechanism, so that the naturalness and semantic consistency are considered in the speech generation process, and the speech quality and the personalized expression ability are improved.

The invention discloses an open vocabulary point supervision time sequence action positioning method based on a progressive optimization network, and belongs to the field of video understanding. Firstly, visual features are preliminarily screened through semantic guidance early enhancement, so that background noise interference is inhibited, and the expression ability of category-related features is improved. And then, semantic association of modeling actions in different time periods is further established by utilizing context-semantic post-enhancement, the category identification degree of visual expression is enhanced, and the model is promoted to mine more unconstrained new category suggestions. And finally, the action boundary is optimized in combination with pseudo-label constraint, fine modeling of the boundary position is realized, and the generalization ability of the model is enhanced while the detection precision is improved. According to the method, a progressive optimization modeling strategy is combined, visual and semantic features are fused to construct a unified progressive optimization network, and the method aims at improving the action positioning performance while reducing mark dependence. The method has a wide application prospect in tasks such as intelligent monitoring, abnormal behavior detection and video question and answer.

The present invention provides a method and device for generating sign language videos based on an improved Transformer model. The method of the present invention first extracts the skeletal posture sequence in the sign language video and removes redundant information to reduce the amount of calculation. In addition, considering the importance of spatiotemporal information to the accuracy of generating sign language videos, a semantically rich embedding module is designed to encode position and speed information into the same high-dimensional space as the input of the model, thereby improving the coordination of joint movements and improving the accuracy of feature representation. Finally, an encoder-decoder model with a pyramid structure is constructed. The encoder accepts a spoken sentence as input and encodes the information in the sequence into an intermediate representation. The decoder then decodes the intermediate representation into a target sign language posture sequence in a semi-autoregressive manner. The present invention can effectively improve the utilization rate of semantic information and the overall expression ability of movements, thereby significantly improving the accuracy and speed of sign language video generation.

The invention discloses an interactive processing method and system based on a digital person, and belongs to the technical field of digital persons. The interactive processing system comprises a voice recognition module, a natural language processing module, an emotion recognition module, a dialogue management module, a voice synthesis module, a visual perception module and a behavior decision and feedback module. By improving the emotion expression ability of the digital person, the digital person can simulate the emotion depth of human beings more truly, so that the digital person can better understand complex emotion requirements when interacting with the user and make more appropriate and natural response according to the emotion state of the user, the reality sense and naturalness of interaction are enhanced, and the user experience is improved. Meanwhile, the emotion expression depth and the complex language understanding capability of the digital human are improved, the naturalness, depth and accuracy of interaction can be remarkably improved, the digital human is closer to real human interaction, and the expression of the digital human in processing complex emotion requirements and multi-level problems can be improved.

The application provides a kind of based on user behavior perception's augmented reality content recommendation and expressive presentation method, including constructing the state representation of multiple virtual roles in augmented reality scene;Joint objective function for evaluating virtual role layout rationality is constructed;According to the attribute information of virtual role, the adaptive weight is generated by the weight prediction model constructed in advance, and the adaptive weight is used to adjust the cost item related to the importance of role in the space cost function;Based on the joint objective function, the position and orientation of all virtual roles are iteratively optimized to obtain an optimized layout;Expressive presentation is carried out in the augmented reality scene The optimized layout is realized in three-dimensional space Automatic optimization of role position and orientation, avoid visual conflict, improve the naturalness, coordination and semantic expression ability of layout, thereby significantly enhance the interactive experience and information transmission effect of AR system.

The present invention belongs to the technical field of multimodal perception, and specifically relates to an audiovisual speaker tracking method based on semantic-spatial feature fusion, comprising the following steps: obtaining original audio-visual signals, and extracting semantic feature encodings in the audio-visual signals by using an audiovisual fusion keyword recognition network; adopting a two-stream network structure including a visual branch and an auditory branch to process image frames and acoustic signals respectively; and adopting a cross-attention module to realize information interaction and fusion between two different sequences of semantic-spatial features. The present invention uses a cross-attention mechanism to mine the correlation and complementarity between different-level features and different-modal features, and promotes information interaction between different information sources. The semantic-spatial feature fusion mechanism can adaptively focus on valuable information, learn multi-level and cross-modal spatio-temporal consistent feature representations, further improve the expression ability of audiovisual features, and thus achieve more accurate tracking.