61 results about "Attentional network" patented technology

The invention discloses an enterprise big data security early warning method based on anomaly detection, and the method comprises the following steps: S1, collecting original data, and carrying out the format unification and structure standardization processing; s2, preprocessing is carried out, and feature vectors are constructed; s3, a behavior entity relation graph is constructed, a graph attention network is adopted for training, and structural features in a normal behavior mode are learned; s4, calculating the deviation degree between the current behavior and the normal behavior; s5, reconstructing the feature vector, measuring the deviation degree between the current behavior and the standard behavior distribution by using a mahalanobis distance, and calculating the posterior anomaly probability of the behavior through a Bayesian updating mechanism; and S6, evaluating the risk level of the current behavior according to the posterior anomaly probability, and generating a corresponding early warning event. According to the method, the graph attention network and the Bayesian self-coding technology are fused, enterprise behavior anomaly detection and grading early warning are achieved, and the method has the advantages of being high in recognition precision, high in self-adaption and timely in response.

The invention belongs to the field of electroencephalogram signal processing, and provides a time-frequency space electroencephalogram emotion recognition method based on three-dimensional space position embedding, which comprises the following steps of: firstly, constructing a three-dimensional electrode space position matrix based on an international 10-20 system standard, determining a space adjacency relation between electrodes, and calculating a phase locking value to obtain a functional connection matrix; then, deep feature fusion of an electrode spatial position matrix and a functional connection matrix is realized by adopting a hierarchical cross Transform architecture, the spatial position matrix represents spatial distribution features of a cerebral cortex region, and the functional connection matrix quantifies phase synchronization features of cross-brain region neural oscillation and simulates a brain spatial topological structure; and finally, extracting time, frequency and spatial features of the electroencephalogram signals through combination of a graph attention network and bidirectional long-short-term memory with an attention mechanism for emotion recognition. The method can effectively extract space structure information highly related to the emotional state, and significantly improves the accuracy of emotion recognition.

The invention discloses a multi-modal data drawing logical relationship analysis method, electronic equipment and a medium, and the method comprises the steps: generating a node set based on drawing image data and text data; generating a cross-modal hyperedge set based on the spatial proximity relationship, the visual feature similarity and the semantic correlation between the node sets; generating a hypergraph embedding input representation based on the node set and the cross-modal hyperedge set; the hypergraph is embedded into the input representation input improved hypergraph self-attention network model, and a hyperedge logic relation type and a corresponding hyperedge confidence coefficient are generated; generating a graph structure result based on the hyperedge logic relationship type and the node set, wherein the graph structure result meets the structure legality requirement; and performing hyper-parameter automatic adjustment and convergence control on the atlas structure result based on hyper-edge confidence, and generating an optimal atlas analysis model and a structured output result. According to the method, the reliability and the quality of analysis of component nodes, logic edge relationships and semantic structures in the drawing are improved.

The invention discloses a reconfigurable intelligent surface (RIS)-assisted multiple-input-multiple-output (MIMO) implicit channel estimation method based on a graph attention network, which is used for efficient downlink transmission in a multi-user scene. Firstly, a graph attention network is designed, user nodes and RIS nodes are modeled in a unified mode, received pilot signals serve as initial features, spatial feature expression is enhanced in combination with user three-dimensional position information, and therefore interference between users and a spatial correlation structure are accurately represented; secondly, end-to-end feature aggregation is achieved based on a message passing mechanism, a base station beam forming matrix and an RIS reflection coefficient are directly predicted under the condition that explicit channel estimation is not needed, and the total transmitting power constraint and the unit mode constraint are met through normalization processing so as to complete joint optimization; according to the method, the users and the speed of the system can be remarkably improved under limited pilot frequency overhead, and the method has excellent generalization performance and robustness in a multi-user complex propagation environment.

The invention provides a multi-modal sentiment analysis method based on graph-attention collaborative optimization cross-modal recombination, and relates to the technical field of multi-modal sentiment analysis. The method comprises the following steps: firstly, designing a modal self-adaptive multi-modal graph construction module, constructing a local sparse graph based on KNN-RBF for a language modal, and adopting a low-rank representation method combined with nuclear norm regularization for an audio and video modal; secondly, the processed modal features are transmitted into a graph attention network to realize high-order feature aggregation; then, a language-guided hierarchical cross-modal interaction mechanism is constructed, and multi-granularity semantics are accumulated in combination with an advanced multi-modal feature container module; and finally, designing an advanced feature recombination strategy based on dynamic matching, and realizing feature alignment by taking a language feature container as an anchor point. According to the method, graph learning and sequence learning are unified in a collaborative framework through a graph-attention collaborative optimization cross-modal recombination model, so that the problems of cross-modal attention noise interference, modal imbalance, insufficient cross-modal feature alignment efficiency and the like can be effectively solved.

The invention relates to the technical field of image processing, in particular to a multi-modal image fusion method based on a deep coding and decoding axis interactive attention network, which comprises the following steps of: S1, acquiring data of an infrared image and a visible light image, normalizing the infrared image and the visible light image, and then inputting a model for feature extraction; the feature extraction method comprises an encoder, a fusion strategy and a decoder. S2, in a feature extraction stage of an encoder, multiple times of extraction is performed on two paths of infrared and visible light images through a convolutional neural network and transformer, so that local information of two modal images is captured, and encoding representation is obtained; s3, performing multi-time layered fusion on the features coded by the encoder by a fusion strategy; s4, reconstructing and decoding the fused image by a decoder; the feature representation capability is higher, the utilization rate of original information is higher, image detail mining is more sufficient, and the fusion effect is better.

A three-dimensional tooth model segmentation method of a double-branch geometric attention network based on centroid guidance is oriented to oral cavity three-dimensional scanning point cloud data and comprises the steps that firstly, normalization and normal vector estimation are conducted on the oral cavity three-dimensional point cloud data, a double-branch encoder for coordinate and normal decoupling is constructed, and a global topological structure and local geometric features are extracted respectively; secondly, a separable attention mechanism guided by the mass center is introduced into a coordinate branch so as to improve the distinguishing ability of adjacent teeth, and a graph convolution attention mechanism is introduced into a normal branch so as to strengthen the boundary expression of the teeth and gingiva; further, in the fusion stage, a mass center thermodynamic diagram and multi-scale feature aggregation are combined, and joint modeling of global and local structures is achieved; and finally, collaborative optimization of instance segmentation and centroid localization tasks is carried out through a dynamically weighted joint loss function. According to the method, the segmentation precision and robustness under complex cases are remarkably improved while the light weight is kept, and the automation and clinical practicability of oral diagnosis and treatment are enhanced.

The invention relates to the technical field of intelligent manufacturing workshop logistics scheduling, in particular to a multi-agent path planning method based on social value orientation and DRL fusion, and the method comprises the steps: S1, building multi-channel tensor representation based on local observation, carrying out the spatial coding of dynamic information, and building an interpretable thinking feature space; s2, receiving neighbor agent dynamic information based on a heterogeneous graph attention network communication mechanism of SVO, separating and aggregating the information through a multi-head SVO perception heterogeneous graph attention network, and extracting information which is most critical to self decision; and S3, based on an SVO double-layer decision-making mechanism of a neighbor agent group, combining SVO and PPO algorithms, and dynamically adjusting an SVO strategy by adopting a local environment and a neighbor agent group to realize dynamic change of a self-adaptive environment of a lower-layer action strategy. According to the method, path conflicts and deadlocks are effectively eliminated, the throughput and success rate of the system are improved, an efficient collaborative solution is provided, and the workshop operation efficiency and the intelligent level are improved.

The application discloses a kind of attention mechanism trajectory generation and simulation methods for sparse data completion, belong to intelligent transportation and trajectory prediction field.The application fills in trajectory missing value using high-precision sensor and map information, combines graph attention network (GAT) and multi-modal fusion technology;Adopt the attention module based on distance (D-GAT) and based on view (V-GAT), capture the interaction between vehicles, improve the understanding of complex traffic scene;Through prediction supervision generator and multi-modal trajectory generator, combine LSTM and Gaussian mixture model (GMM) to generate multiple possible trajectories, and use Kalman filter for online adjustment, ensure the accuracy and real-time of trajectory.The application realizes the intelligent completion of sparse traffic data and the accurate generation of trajectory, provides reliable data support and decision basis for intelligent transportation system, helps the efficient operation and sustainable development of urban traffic planning and management.

The invention discloses an electric power topological graph node classification method, system and device based on a federal asynchronous graph attention network, and a storage medium, and relates to the field of electric power system automation, and the method comprises the steps: collecting local electric power topological graph data of each regional power grid client, constructing a data set, and generating weighted embedding through label semantic embedding learning; based on this, a weighted tag semantic graph and an auto-encoder are constructed to obtain coding representation and loss, the two are combined to obtain a classification result through backbone network processing, and client model training is carried out. And finally, generating a global model at a server side through operations such as spectrum similarity and the like, wherein the global model is used for power topological graph node classification. According to the invention, the privacy of power grid data is guaranteed, and the generalization ability and robustness of the model are improved. The node type and state of the power topological graph are accurately identified, a decision basis is provided for troubleshooting and load distribution, the operation and maintenance efficiency of a power grid is effectively improved, and safe and stable operation of the power grid is guaranteed.

The application provides a text classification method and system based on a topic-aware hierarchical multi-attention network, comprising: obtaining text information to be classified; obtaining a classification result according to the obtained text information and a preset text classification model; wherein the text classification model is constructed in a hierarchical structure to form multiple attention mechanisms, and converts sentence-level and document-level inputs into sentence and document encoders respectively; the application takes self-attention as the main building block of the neural network, not only improves the modeling ability of the distance relationship, but also makes the training speed of the self-attention network faster due to the feedforward structure; a hierarchical neural structure is introduced, which converts sentence-level and document-level inputs into sentence and document encoders respectively, and realizes the most advanced classification accuracy.

This invention discloses a semantic segmentation method for ocean internal wave stripes in SAR images, relating to the field of semantic segmentation of remote sensing images. The method model consists of an encoder and a decoder. The encoder comprises four Transformer modules, each containing a self-attention layer, a feedforward neural network, and an overlap patch merging module. Within each module, the input image is processed N times through a multi-head self-attention mechanism, and then the merging module generates feature maps at four scales. The decoder consists of three modules: a serpentine convolution, an EVC module, and an expectation-maximization attention network. The advantages of this invention are: the model fully utilizes the multi-scale fusion module, improving performance and robustness; the use of serpentine convolution can better extract features of linear shapes; and the use of the expectation-maximization attention network improves model accuracy while reducing computational complexity.

The application provides a power load anomaly detection method and device, and belongs to the technical field of power grid safety. The method comprises the following steps: standardizing power load data and processing the power load data in blocks. Then, a multi-head self-attention network is used to calculate an attention matrix representation between blocks and within blocks, and the attention matrix representation is respectively up-sampled. Next, a divergence loss function of the two is calculated, and an anomaly score of each point is calculated according to the divergence loss function. Finally, whether the power load data is abnormal is determined through a preset hyperparameter threshold. Through the method, the distance between normal and abnormal user features is maximized, the distance between features of the same type of users is minimized, an effective power data representation is learned, different user power consumption data features are actively compared, and abnormal power consumption behaviors are effectively identified.

The invention provides a method and a system for constructing a knowledge representation learning model based on a periodic perception contrast graph attention network. The method comprises the steps of constructing a sub-graph sampler, constructing a graph attention network and performing time sequence perception contrast learning. According to the method, firstly, adjacent neighbor entities are screened and queried through a period time sensing sub-graph sampler in a period dynamic weighting mode, consumption of computing resources is reduced, and key time sequence context and period information are reserved; then, the graph attention network with the time perception function generates dynamic representation of time perception by using graph attention in the constructed query related sub-graph, and entity embedding representation fused with neighbor information is obtained; then, time sequence perception contrast learning improves robustness in time knowledge graph reasoning through dynamic and static representation contrast learning of an entity, and entity prediction is carried out through embedded representation obtained through learning. Finally, the entity representation is decoded using a decoder.

This application relates to a method, apparatus, and device for screening the risk of reading and attention deficit disorder in children. The method includes acquiring multi-channel raw brain blood oxygenation signals under task-induced conditions using a specific layout fNIRS array integrated into a wearable headband, based on a rapid naming cognitive paradigm. Based on the raw brain blood oxygenation signals, a fusion feature vector representing the reading and attention networks is generated by calculating temporal waveform features and frontotemporal functional connectivity strength. The multi-dimensional fusion feature vector is then processed and analyzed using a Transformer classification model to generate classification results indicating the risk level of reading disorders and comorbid ADHD. This application achieves portable and rapid brain function signal acquisition by integrating a targeted fNIRS array with a standardized cognitive paradigm. By fusing temporal dynamics and brain network connectivity features, a multi-dimensional neural representation is constructed. Finally, a lightweight Transformer model is used to output the risk level of reading disorders and comorbid ADHD end-to-end, achieving high-precision automated assisted screening.

The application provides a visual question answering method and system based on a multi-level visual feature enhancement network, which can enhance the relationship between local objects and local objects and the relationship between regional objects and global concepts, thereby jointly learning the visual semantic relationship of multiple spatial contexts. A separation visual feature module based on a graph attention network is used to capture pixel-level visual features and object-level regional features; a joint visual feature representation based on a graph attention network is used to jointly represent the pixel-level features and the object-level features, simultaneously learn the semantic relationship between different levels, better associate with the question text, and thus provide more rich visual feature representation. The application solves the problem that the traditional visual feature representation loses the context relationship between the regional features and the global features, so that the global semantic cannot be fully utilized, and the visual features are lost.

The application discloses a texture feature guided texture preserving low dose CT image denoising method, and belongs to the field of medical image processing.The application specifically discloses a multi-scale deep residual attention network model with texture feature guidance, which is applied to low dose CT imaging.The main network model comprises four sub-models, one is a multi-scale initial denoising network model for denoising low dose CT, and the other network is used for extracting texture details after the initial denoising network, and the two network parts work cooperatively.The extracted texture details and the initial low dose CT are fused through a multi-scale image and texture feature fusion network model, and then enter a multi-scale main denoising network for further denoising of the low dose CT, which is beneficial to the main denoising network to learn more unobvious details.The low dose CT image denoising method disclosed by the application efficiently removes the noise and stripe artifacts in the low dose CT image, and meanwhile, the structural information and texture feature detail information in the image are preserved.

The invention belongs to the technical field of bioinformatics, and more specifically relates to a spatial domain identification method based on a single cell large model and a graph attention network. The method comprises the following steps: S1, data preprocessing; s2, extracting hidden features by adopting an scGPT full-human model; and S3, screening out high-variation genes with top 3000 ranks from the preprocessed data, splicing the high-variation genes with hidden features, and finally inputting the spliced high-variation genes into a graph attention network to obtain a clustering result. According to the method, the missing part of ST data is acquired by using scGPT, the problem that high-quality single cell data is difficult to acquire is solved, and meanwhile, with the development of a single cell large model, GFGAT is also very convenient to use different single cell models. A finer graph attention network is used, and a part of the network is trained by adopting a cut adjacent matrix, so that more site information is reserved, and a more accurate spatial domain is identified.

The invention relates to the technical field of digital operation and maintenance, in particular to an underground pipe network facility life prediction system and method based on multi-parameter time sequence analysis, and the method comprises the steps: generating a holographic state set through a multi-scale window and a tensor filling algorithm, building a pipe network topology through three-layer logic verification, and paying attention to network quantification risk conduction characteristics based on a space-time diagram. And performing state recursion and continuous integration by using a particle filter algorithm to predict the remaining life. According to the method, heterogeneous monitoring data is converted into a low-rank tensor model, and sparse graph matrix operation is combined, so that the calculation complexity and memory overhead in a high-dimensional spatial-temporal feature extraction process are effectively reduced; meanwhile, based on a numerical integration strategy of a Bayesian sequence Monte Carlo method, the particle degradation problem in nonlinear system state estimation is solved, and convergence and numerical stability of a residual life prediction result in a computer simulation environment are guaranteed.

The application provides an Alzheimer's disease classification method and system based on a multi-modal supergraph attention network, and the method comprises the following steps: acquiring sMRI image data of the brain of a plurality of Alzheimer's disease patients and performing preprocessing; performing feature extraction on the preprocessed sMRI image data, and constructing a plurality of cross-modal supergraphs according to the image features and morphological features of the brain regions of the patients; establishing a supergraph attention neural network model, training the cross-modal supergraphs, finally acquiring sMRI image data of the brain of a patient to be diagnosed, constructing a corresponding supergraph, inputting the trained supergraph attention neural network model for classification, and obtaining an Alzheimer's disease classification result and the attention weight corresponding to each supergraph; the application can effectively improve the accuracy of the Alzheimer's disease classification task, and can also find out which brain regions and morphological supergraphs have a significant contribution degree in the model, which is helpful for accurate diagnosis by doctors.

The invention discloses a building damage change detection method and device based on change guidance and interactive attention. The method comprises the following steps: acquiring a double-time-phase image of a building to be detected; inputting the double-time-phase image into a trained interactive attention network based on change guidance to obtain a change detection graph of the to-be-detected building, the change detection graph being used for indicating a damage change area of the to-be-detected building; wherein the interactive attention network is used for extracting multi-scale dual-time-phase features of the dual-time-phase image, generating a prior change diagram based on the deepest-scale dual-time-phase features, and under the guidance of the prior change diagram, executing interactive attention operation on the multi-scale dual-time-phase features to obtain a change detection diagram. The method is good in detection effect and high in detection precision in a complex scene.

An exemplary scheduler system and method are disclosed that can schedule a plurality of heterogenous robots to perform a set of tasks using heterogeneous graph attention network models. The exemplary scheduler system and method can outperform other work in multi-robot scheduling both in terms of schedule optimality and the total number of feasible schedules found and also in a scalable framework that can be trained via imitation-based Q-learning operations. The exemplary scheduler system and method can autonomously learn scheduling policies on multiple application domains.

The invention relates to an entity relationship recognition method and device, computer equipment and a medium, the method applies an entity relationship extraction model to recognize entity relationship data for a target text, and the method comprises the following steps: a feature representation network performs feature representation on a word segmentation sequence of the target text of a to-be-recognized entity relationship to generate a full-text feature vector; a conversion network performs entity classification based on the full-text feature vectors to obtain entity boundary information, and word element vector segments of all entities in the full-text feature vectors are constructed into entity feature vectors; performing convolution enhancement processing on the entity feature vector by a convolution network to obtain a structure enhancement vector; the attention network performs context enhancement processing on the structure enhancement vector by using the full-text feature vector to generate an entity enhancement vector; and determining entity relationship data between every two entities contained in the target text by the classification network according to the entity enhancement vectors. According to the method, the entity feature representation precision and breadth can be improved, and the accuracy and efficiency of relation extraction are remarkably improved.

This application relates to the field of healthcare informatics technology, providing a drug recommendation method and related equipment based on drug representation and dynamic user modeling. User features are generated based on the acquired user's historical health records and current health status. Diagnostic features and procedural features are sequentially input into a GRU network and a Transformer network, respectively, to generate user representations through dynamic modeling. Drug features are input into a pre-constructed graph attention network to construct a heterogeneous graph between drug attributes and molecular motifs. Drug representations are generated by message propagation and stacking on this heterogeneous graph. User and drug representations are input into a pre-constructed feedforward neural network, outputting fused features between the drug and the user. The fused features are used to generate probabilities through an activation function, and recommendation information is generated based on the target drugs corresponding to these probabilities. This method can accurately match user health needs and provide personalized and effective drug recommendations.

This invention provides a method, apparatus, and device for spoken-to-written language conversion based on graph attention networks. The method includes: semantically encoding a spoken document to obtain a semantic representation of the spoken document; determining the initial representation of each node in the document structure graph of the spoken document based on the semantic representation, wherein the document structure graph includes document nodes, sentence nodes, and word segmentation nodes; performing message propagation on the initial representation of each node in the document structure graph based on an attention mechanism to obtain a structure graph representation of the document structure graph; and performing semantic decoding based on the structure graph representation to obtain the written document corresponding to the spoken document. The method, apparatus, and device provided by this invention, by constructing a document graph structure diagram, can obtain a more concise and readable written document, avoiding the omission of spoken terms crossing sentence boundaries during text conversion, and ensuring the effectiveness of document-level spoken text conversion to written text.

The present invention discloses a multi-channel noise suppression method based on a two-stage deep complex network, comprising constructing a deep complex gated convolutional attention network to perform correlation modeling on complex spectra; utilizing a two-stage deep complex network to enhance multi-channel noisy signals; in the beamforming stage, performing amplitude and phase enhancement on the multi-channel complex spectrum to obtain a coarsely denoised single-channel complex spectrum; and in the post-filtering stage, performing refinement on the coarsely denoised single-channel complex spectrum to further suppress noise. The method of the present invention divides the noise suppression task into two stages, beamforming and post-filtering, through a two-stage enhancement strategy, effectively avoiding the problems of residual noise and distortion of the target acoustic signal. In addition, by adopting a complex network structure in both stages to model the complex spectrum, the amplitude and phase information of the signal are simultaneously enhanced, phase distortion is reduced, and the quality and naturalness of the signal are improved.

The present invention proposes a method and device for classifying ECG data based on a multi-branch block full-attention network. The method comprises: acquiring target ECG data; inputting the acquired target ECG data into a pre-configured multi-branch block full-attention network model, wherein the target ECG data is multi-lead ECG data, wherein the model comprises a feature extraction module and a full-attention block, wherein the feature extraction module comprises multiple multi-branch blocks and a short-circuit block; extracting features from the target ECG data using the feature extraction module to obtain first data; inputting the first data into the full-attention module to extract spatial features and channel features; and determining the target classification result corresponding to the target ECG data from preset optional classifications based on the spatial features and channel features. The features extracted by the feature extraction module are input into the full-attention block, and the features of the spatial dimension and the channel dimension are extracted for classification. The features of multiple data channel features and spatial features are integrated to improve the accuracy of ECG data classification.

The application provides a conversation recommendation method, device and equipment and a computer storage medium, comprising: obtaining an item set and a conversation set; obtaining a first feature matrix of the item set, and performing hypergraph convolution processing on the first feature matrix of the item set by using a hypergraph neural network of the item set to obtain a second feature matrix of the item set; inputting the second feature matrix of the item set into a multi-layer self-attention network for learning to obtain a first feature matrix of the conversation set; constructing a graph attention network by using the conversation set, and inputting the first feature matrix of the conversation set into the graph attention network for learning to obtain a second feature matrix of the conversation set; and calculating a recommendation score of each item by using the second feature matrix of the item set and the second feature matrix of the conversation set, and calculating a loss function by using the recommendation score of each item and a recommendation true value, which improves the recommendation accuracy through the combination of the hypergraph neural network, the multi-layer self-attention network and the graph attention network.

The present invention discloses a disaster information filtering method based on a graph attention network, which has the following characteristics: using a graph attention network to understand the correlation between the words in a post and the corresponding information type, and filtering to obtain executable information, including the following steps: step 1, preprocessing the posts in the data set to obtain preprocessed data; step 2, building an information filtering network model; step 3, inputting the preprocessed data into the information filtering network model for training to obtain a trained information filtering network model; step 4, inputting the posts to be classified into the trained information filtering network model to obtain a classification result. Among them, the information filtering network includes a BERT encoder, a graph attention network, and a relationship network. The present invention also discloses a disaster information filtering system based on a graph attention network, including a preprocessing unit and an information filtering unit.

The application provides a service recommendation method based on a knowledge graph, comprising the following steps: S1, converting the interactive matrix data of a user into a two-part graph, and then matching the non-user entities in the two-part graph with the entities in a knowledge graph to form a joint graph in combination with the knowledge graph; S2, using a knowledge graph embedding method to parameterize the entities and relationship parameters of the joint graph into vector representations; S3, inputting the representations of the entities into a multi-layer graph attention network, using an attention mechanism to calculate the neighbor entity weight of each entity respectively, and performing weighting; S4, aggregating the representation of the node and the weighted result obtained in step 3; S5, repeating steps 3-4, so that each entity recursively aggregates its neighbor entities to obtain the final representation of the user and the entity; S6, predicting the probability of the user's service preference according to the final representation of the user and the entity. The method introduces auxiliary information of the knowledge graph, and improves the recommendation effect of the recommendation system.