93 results about "Relationship learning" patented technology

The invention relates to the technical field of deep learning, and discloses an MES digital collaborative management method and system based on deep learning, and the method comprises the steps: collecting multi-source heterogeneous data, and constructing a dimensionless multi-dimensional data set; analyzing a dynamic association relationship among the data items through node feature embedding and edge relationship learning, and generating a production line operation dependency relationship graph; performing collaborative anomaly detection and root cause positioning in combination with the dynamic association weight between the data items to obtain causal association data between the abnormal event and the data parameters; constructing a digital twinborn simulation environment to simulate an influence path of heterogeneous data parameter intervention production disturbance on collaborative anomaly so as to evaluate an anomaly influence result; constructing an iterative scheduling model according to a deep learning framework, and iteratively generating a multi-objective optimized collaborative scheduling strategy to realize dynamic configuration and exception prevention among heterogeneous data; therefore, collaborative optimization management of production operation parameter configuration and abnormity prevention of multi-source heterogeneous data in large-scale production with high dimension, high complexity and dynamic change can be realized.

The invention discloses a retrieval method and device based on a knowledge graph, computer equipment and a storage medium. The method comprises the steps that the knowledge graph is acquired, a node relation vector is output through a preset relation learning module, nodes related to user query content are retrieved from the knowledge graph, and an external knowledge representation result is generated; performing feature fusion on the user query content and the external knowledge representation result by using the correlation matrix to obtain a fused feature vector; performing image-text bidirectional semantic alignment on the fused feature vector based on an attention mechanism to generate a joint feature vector; and performing matching calculation based on the joint feature vector to obtain a matching score for representing the semantic correlation degree. According to the method, the user query content and the generated external knowledge representation result are fused through the correlation matrix, image-text semantics are aligned through an attention mechanism, the joint feature vector is generated, the matching score is calculated, and cross-modal retrieval is realized by using the matching score, so that the information retrieval accuracy of the community property management system is greatly improved.

The invention discloses an industrial Internet of Things time sequence self-supervision anomaly detection method and a monitoring and early warning system, and relates to the field of industrial Internet of Things, and the method comprises the steps: S1, constructing an anomaly detection model, and S2, obtaining a training data set; s3, training and optimizing an anomaly detection model; s4, acquiring to-be-detected data in real time; s5, performing anomaly detection analysis on the to-be-detected data, and outputting an anomaly detection result; through a time sequence and relation learning module, a dynamic graph topological structure learning module and an enhancement module, internal characteristics of a time sequence in a time domain and a space domain are deeply mined. The time sequence and relation learning module comprehensively captures a multi-scale time pattern, and the dynamic graph topological structure learning module eliminates dependence on a predefined graph structure; the enhancement module enhances the invariant representation under noise, and improves the recognition capability of the model to a normal mode; through wide experiments, the advancement of the method in detection performance is verified, and reliable support is provided for intelligent manufacturing and infrastructure diagnosis.

The invention provides a power battery health state anomaly detection method based on machine learning, and relates to the field of data anomaly detection. The invention provides an MtsNet anomaly detection model which comprises a perturbation response time modeling module, a variable relation learning module and an anomaly detection module, specifically, the perturbation response time modeling module is used for processing a dynamic mode in data, the variable relation learning module is used for processing a dynamic coupling problem of the data, and the anomaly detection module is used for detecting the anomaly of the data. The anomaly detection module is used for integrating the two deviation scores to obtain a final power battery health state anomaly score, and all the modules are matched with one another to achieve anomaly detection of the power battery health state.

The invention discloses a multi-omics causal structure relation learning method based on comparative learning, which comprises the following steps: firstly, respectively constructing corresponding encoders for preprocessed gene mutation and gene expression data, and respectively carrying out feature extraction on two kinds of omics data; then, constructing a projection head with shared parameters to realize cross-modal feature alignment; then, using the aligned features as nodes, and constructing causal graph data through a learnable causal graph structure; constructing a graph neural network to learn causal graph representation, and constructing a contrast loss function; and finally, a model prediction result is obtained through a multi-layer perceptron, a survival prediction loss function is constructed, and a total loss function is obtained for multi-omics causal structure model training. Based on gene mutation and gene expression data, a cross-omics causal structure relationship is constructed and learned through comparative learning, more accurate prognosis prediction is provided for diseases such as acute myelogenous leukemia and the like, and potential biomarkers and key regulatory factors are helped to be found.

The invention discloses an uncertain knowledge graph reasoning method based on semi-supervised confidence distribution learning. The method comprises the following steps: converting triple confidence in uncertain knowledge graph training data into confidence distribution; learning embedding of the uncertainty knowledge graph on the marked data and the pseudo-marked data generated by the pseudo-marked data generator at the same time by using a relation learner based on confidence distribution learning; generating a high-quality pseudo-confidence distribution label for the unmarked data by using a pseudo-marked data generator; iteratively training a relation learner based on confidence distribution learning and a pseudo-mark data generator by utilizing element self-training until the relation learner and the pseudo-mark data generator converge; and transmitting data to be complemented into the trained relationship learner based on confidence distribution learning for reasoning to realize uncertainty knowledge graph complementation. According to the method, the supervision information of a small amount of confidence or no confidence in the marked data can be captured, and the method is suitable for the scene of unbalanced confidence distribution of the triple of the uncertainty knowledge graph.

The invention provides a multi-modal semantic-action alignment method and equipment for end-to-end automatic driving, and belongs to the technical field of automatic driving, and the method comprises the steps: carrying out semantic reasoning through a large language model based on various sensor data and language instruction information of a vehicle, and generating semantic information containing a driving intention; inputting the semantic information into a semantic-action alignment module, and converting the semantic information into corresponding driving action representation through a learned consistency mapping relation from a semantic space to an action space; and generating an executable control track of the vehicle according to the driving action representation. According to the method, the problem of insufficient semantic and action space alignment is solved, information distortion and precision limitation caused by post-processing depending on rules are avoided, the high-level driving intention can be generated based on complex multi-mode information (such as navigation instructions and traffic environments), it is ensured that the final execution action is highly consistent with the intention, and the driving intention is more accurate. And the decision-making rationality of the system in a complex scene is enhanced.

The invention discloses a traffic engineering multi-source monitoring data fusion intelligent management and control system, and the system comprises a multi-source data dynamic access module which is used for the access of multi-source heterogeneous data; a data processing module; the dynamic relation learning module is used for mining dynamic space-time association and potential laws in the multi-source data and establishing a time-varying mapping model among the data; the intelligent fusion decision module is used for generating a traffic control decision based on the processed multi-source data and an output result of the time-varying mapping model; an adaptive adjustment module; a data service module; through cooperation of the multi-source data dynamic access module, the data processing module, the dynamic relation learning module, the intelligent fusion decision-making module, the adaptive adjustment module and the data service module, full-process automation from multi-source data access to intelligent management and control decision-making can be realized, and self-adaption to changes of a complex traffic environment can be realized. And the fine management level of traffic engineering is improved.

The invention provides a multi-modal semantic guided three-dimensional target positioning method, a medium and equipment. The method is realized based on a multi-modal semantic guided three-dimensional target positioning model, and comprises a multi-view semantic prior module, a text coding module, a double-branch point cloud coding and multi-source comparison supervision module, a sparse scene graph construction and graph relationship learning module and a positioning decoding module. The multi-view semantic prior module is used for segmenting the 3D scene point cloud into a 3D object point cloud, generating a multi-view 2D visual representation and encoding the semantics of the multi-view 2D visual representation; the double-branch point cloud coding and multi-source comparison supervision module is used for injecting semantic features into a 3D object point cloud to obtain 3D fusion features and realizing multi-source feature alignment through multi-source comparison supervision; the sparse scene graph construction and graph relation learning module is used for constructing a sparse scene graph and optimizing the sparse scene graph through a graph attention network; and the positioning decoding module is used for decoding and outputting a positioning result. The method can improve the target positioning capability of the model in a complex scene.

The invention discloses a motor fault diagnosis method based on a graph isomorphic network and cross-graph relation learning, and the method comprises the following steps: firstly, obtaining multi-source signals of a motor in different health states, carrying out the normalization, and building an original signal graph sample set; secondly, utilizing graph samples of a motor in different health states to train the model, capturing relation characteristics among cross-graph samples through a multi-head self-attention mechanism and a feedforward network, and combining a knowledge distillation technology to obtain an optimized cascade structure of a multilayer graph isomorphic network; and finally, testing a to-be-diagnosed sample by using the trained model, and finally outputting a diagnosis result. According to the method, the noise immunity is enhanced through fusion of multi-sensor signals, cross-graph relation feature extraction and a new dynamic training feedback strategy, and the precision and robustness of motor fault diagnosis are remarkably improved. Experimental results show that the method provided by the invention is superior to a current mainstream fault diagnosis method in the aspects of fault diagnosis accuracy and robustness.

The invention provides a text video retrieval method of a fine-grained relation learning network based on energy perception. The method comprises the following steps: giving a query text and a video clip; inputting the query text into a text encoder of the CLIP, inputting the video clip into a text encoder image encoder of the CLIP, and extracting to obtain text embedding and frame embedding; inputting the text embedding and the frame embedding into a fine-grained relation learning network for text enhancement operation to obtain enhanced text embedding; taking the enhanced text embedding as a frame fusion condition to carry out frame fusion operation on the frame embedding to obtain video embedding; calculating the similarity of a text-video pair formed by the query text and the video embedding based on a cosine similarity function; and selecting the text-video pair with the highest similarity as a retrieval output result of text video retrieval. According to the method, the problem of randomness of the random text of single sampling is solved, so that semantic information of text coding is better expanded, and the final retrieval effect is improved.

The invention provides a cross-modal remote sensing image-text retrieval method based on expert-guided trusted learning, and relates to the technical field of information processing and mining of remote sensing big data, the method comprises the following steps: using a feature extractor and an expert feature extractor to respectively extract features described by a remote sensing image and a text; aiming at the extracted features, constructing corresponding Dirichlet distribution based on internal similarity of the features; aiming at the remote sensing image features and the text description features extracted by the feature extractor, respectively constructing Dirichlet distribution based on the similarity of the image to the text and the similarity of the text to the image; and on the basis of the constructed Dirichlet distribution, performing intra-modal relationship learning, inter-modal credible learning and uncertainty consistency learning guided by experts. By the adoption of the scheme, cross-modal retrieval between the remote sensing image and the text description is achieved.

The application discloses a graphite ore grade identification method and device, equipment and medium, and relates to the technical field of graphite ore grade identification. The application introduces Laplacian wavelet convolution instead of a traditional ordinary convolution kernel, realizes parallel extraction of multi-scale features, combines a multi-head attention mechanism to capture scale features of the ore under a global view, constructs a sparse sample relation graph based on an enhanced feature matrix, and uses a Chebyshev graph convolution network to perform multi-order neighborhood information propagation and aggregation on a graph structure to realize grade identification. The process reconstructs the grade identification problem from'single sample independent judgment' to'sample relation learning' under a small sample on the basis of global multi-scale feature extraction, so that the final prediction of each sample node depends not only on its own features, but also on similar feature information of all neighbor samples, thereby realizing high-precision identification of the grade of the graphite ore under a small sample.

The application discloses an uncertainty knowledge graph reasoning method based on semi-supervised confidence distribution learning, comprising the following steps: converting the triple confidence in the uncertainty knowledge graph training data into a confidence distribution; simultaneously learning the embedding of the uncertainty knowledge graph on the labeled data and the pseudo-labeled data generated by a pseudo-labeled data generator by using a relation learner based on confidence distribution learning; generating high-quality pseudo-confidence distribution labels for unlabeled data by using the pseudo-labeled data generator; iteratively training the relation learner based on confidence distribution learning and the pseudo-labeled data generator by using meta-self-training until the two converge; and inputting the data to be completed into the trained relation learner based on confidence distribution learning to perform reasoning, thereby achieving the completion of the uncertainty knowledge graph. The application can capture the supervision information of a small number of confidence or unseen confidence in the labeled data and is suitable for the scene where the triple confidence distribution of the uncertainty knowledge graph is unbalanced.

This invention provides a learning device, an evaluation device, an evaluation system, a learning method, an evaluation method, and a recording medium. The learning device includes: a correspondence receiving unit that receives correspondences between the quality evaluations of each product of an object process and the quality evaluations of each downstream product produced in a downstream process using the products of the object process; a learning processing unit that uses at least one production parameter relating to the production of each product of the object process and the quality evaluations of each downstream product produced using the products of the object process to generate a predictive model that infers the quality evaluation of the downstream products based on the at least one production parameter; a calculation unit that calculates a model evaluation based on at least one of the accuracy or complexity of the predictive model; and a model evaluation sending unit that sends the model evaluation calculated by the calculation unit to the evaluation device, which evaluates at least one upstream process using model evaluations for each of at least one upstream process that is upstream of the downstream process.

The present invention discloses a hierarchical graph-based integrated warehouse and distribution logistics emergency supply prediction system and method, which at least includes a micrograph learning module, a macro-graph learning module, and a spatio-temporal joint prediction module. The micrograph module introduces meta-path aggregation of warehouse and distribution network routing features and adopts multi-view learning to obtain the spatial features of warehouse and distribution sites from the routing view and the event view respectively. The macro-graph learning module uses a lightweight graph convolution method to depict the relationship between warehouse clusters and distribution stations in the form of cities in emergency scenarios and learn the spatial correlation features of warehouse and distribution nodes in the macro dimension. The spatio-temporal joint prediction module captures the temporal correlation of supply data and fuses it with spatial features to accurately predict the supply capacity of future logistics sites. This method analyzes the spatio-temporal correlation features of warehouses and distribution stations in the emergency logistics network to achieve the overall goal of improving the prediction accuracy and enhancing the supply capacity at both ends of the warehouse and distribution in emergency scenarios.

The application belongs to the field of computer vision, and discloses a video description method based on semantic disambiguation structured coding. The application proposes to introduce prior knowledge such as a knowledge graph to construct the relationship between objects in a video (a concept semantic graph), so as to obtain a structured coding of a deeper level of understanding of the semantic relationship of the video. On the basis of the concept semantic graph, according to the guidance of the semantic of the video scene, a relationship most conforming to the current video context is dynamically learned from various relationships of the same pair of objects to eliminate the semantic ambiguity problem existing between the objects, so as to achieve semantic disambiguation structured coding. A cross-domain guidance relationship learning strategy is proposed, which analyzes each object and its relationship in a description sentence to fit the learning of the concept semantic graph in the model, so as to better learn each object and the relationship between the objects in the video. The method of the application can realize more accurate and comprehensive video description.

The present invention proposes a method for classifying ground objects in optical remote sensing images based on multi-level pseudo-relationship learning, which is used to solve the problem that the existing self-training method ignores the potential connections between pixel points in ground object classification. The implementation steps are as follows: obtaining the optical remote sensing image to be classified from a remote device and constructing a multi-level pseudo-relationship network model, obtaining the optimization objective function of the optimized model by constructing a source domain relationship learning loss, a target domain pixel-level pseudo-relationship loss, a source domain local patch-level pseudo-relationship loss, and a target domain local patch-level pseudo-relationship loss, then training the model using a training set, and finally classifying the optical remote sensing image. The present invention realizes the classification of ground objects in optical remote sensing images through multi-level pseudo-relationship learning, improves the classification effect, makes up for the deficiencies of the self-training method, and can be used in application fields such as urban planning, land use, and environmental detection.

The present invention provides a method, application method and system for fusing a large model with a knowledge graph. The method generates knowledge graph embedding information by embedding the acquired knowledge graph into the knowledge graph, and then generates a natural language question based on the knowledge graph embedding information. The knowledge graph embedding information and the natural language question are input into an entity relationship learning model, and the entity representation and relationship representation corresponding to the natural language question are output. The subgraph corresponding to the natural language question is extracted based on the natural language question, the entity representation and the relationship representation, and the subgraph is converted into natural language. The subgraph is then combined with the entity relationship learning model and the knowledge graph embedding information and integrated into the large model to generate a target reasoning model, thereby realizing the fusion of the knowledge graph and the large model. This enables the model to extract key information and conduct in-depth understanding and reasoning, enhances the model's reasoning ability when dealing with complex problems, and further improves the clarity and interpretability of the model's subsequent output content.

The application discloses a dangerous driving behavior detection method based on a line-of-sight direction time relationship learning. A convolutional neural network is designed to estimate the head orientation and the binocular orientation of a driver. In view of the possible inconsistency between the head orientation and the binocular orientation, a head orientation and binocular orientation joint network is designed to estimate the line-of-sight direction of the driver. In view of the problem that the line-of-sight direction changes with time during driving and it is difficult to accurately determine the dangerous line-of-sight direction state, a Gaussian time weight-based line-of-sight direction time relationship learning is designed, a line-of-sight direction time positioning network is constructed, and reliable time positioning of the dangerous line-of-sight direction is realized. When the duration of the dangerous line-of-sight direction exceeds a threshold value, a safety warning is given to the driver. The application can handle the inconsistency between the head orientation and the binocular orientation, can robustly handle different line-of-sight direction time change processes, and can effectively realize dangerous driving behavior detection.

The invention provides a spatial transcriptome cell composition inference method based on graph contrast learning. According to the method, a cross-modal low-dimensional feature spatial data simulation module is constructed, single cell and spatial transcriptome data are respectively mapped to a potential embedding space, feature space difference is reduced through aligned distribution, and structural consistency of cross-modal data is enhanced; designing a double heterogeneous graph construction and potential relation learning module, constructing a feature heterogeneous graph of two cells and spatial points based on gene expression similarity, and capturing a high-level potential relation of spatial data in double graphs by adopting a meta-path potential relation reasoning strategy; and introducing a graph representation optimization mechanism based on structure contrast learning, maximizing the consistency of the cross-modal nodes in the embedding space, and obtaining a final cell composition inference result. The method realizes inference of spatial transcriptome data cell composition, can be used for cell space positioning and tissue microenvironment analysis, and provides a reliable computational analysis basis for related biomedical research.

The invention relates to the technical field of graph neural networks, in particular to a graph data imbalance classification method for synthesizing enhanced nodes, which introduces attention-based feature extraction and neighbor aggregation methods, captures a high-order relationship among nodes by integrating a multi-head attention mechanism through attention-based feature extraction, and obtains a high-order relationship among the nodes; according to the method, global features with more representativeness are learned, the problem of insufficient feature learning is solved, and expression of features and topological information between nodes is enhanced through aggregation and splicing of node features and neighbor aggregation, so that generated samples are more uniform and have subclass representativeness, and the problem of insufficient node representativeness is solved. According to the attention-based feature extraction method, the high-order relationship between the nodes is captured by integrating a multi-head attention mechanism, and the expression of the features and topological information between the nodes is enhanced by aggregating and splicing the node features and neighbor aggregation, so that the generated sample is more uniform and has subclass representativeness; and more valuable guidance is provided for node generation.

The information processing device includes a relational learning unit that learns the relationship between a first image of an object having a plurality of joints and coordinate information, the coordinate information representing the positions of the plurality of joints and being defined in a range extended compared to the perspective of the first image, and the training model is used to estimate the coordinate information of at least one joint located outside the perspective of a second image of a newly acquired object.

The present invention relates to the technical field of graph data mining, and specifically refers to a heterogeneous graph embedding method based on information completion, including: aggregating features of a target node to obtain a preliminary completed feature vector of the target node, and learning the similarity between nodes based on the relationships between nodes in the heterogeneous graph to obtain a target adjacency matrix of the target node in each relationship; cyclically updating the node features to obtain a target feature vector of the node; based on the target adjacency matrix of the target node in each relationship and the target feature vector of the node, performing neighborhood transfer on the target node to obtain a complete completed feature vector of the target node, and aggregating using an attention mechanism to obtain a final node representation of the target node. The present invention completes the missing attribute features of the target node, improves the neighborhood information of the target node, enables the target node with fewer relationship connections to learn more information, thereby obtaining a more complete node feature representation, and further improving the performance of downstream tasks.

Systems and methods are described for grapheme-phoneme correspondence learning. In an example, a display of a device is caused to output a grapheme graphical user interface (GUI) that includes a grapheme. Audio data representative of a sound made by the human user is received based on the grapheme shown on the display. A grapheme-phoneme model can determine whether the sound made by the human corresponds to a phoneme for the displayed grapheme based on the audio data. The grapheme-phoneme model is trained based on augmented spectrogram data. A speaker is caused to output a sound representative of the phoneme for the grapheme to provide the human with a correct pronunciation of the grapheme in response to the grapheme-phoneme model determining that the sound made by the human does not correspond to the phoneme for the grapheme.

The application discloses a kind of robust causal relationship learning method, system, equipment and storage medium, large-scale variable set can be effectively handled, and when variable set scale is larger, the problem is decomposed into multiple small-scale problems and is handled, improve the efficiency of processing large-scale variable set;Meanwhile, the application has good scalability, can be used with any causal algorithm, so that the application can adapt to a variety of different application scenarios and needs;And, the application provides a new way to solve complex causal inference problem, the idea of divide and conquer and the concept of causal cut provide a new perspective and tool for subsequent causal inference research;In addition, the directed causal graph finally obtained by the application has high accuracy, and can improve the effect of the application field.

The invention discloses an accounting term automatic identification method and system based on a neural network. The method relates to the technical field of natural language processing, and comprises the following steps: by constructing a scene-based accounting term corpus and introducing a scene perception mechanism, enabling a model to accurately recognize term differences in different accounting scenes, and solving the problem of low cross-scene recognition accuracy of a traditional method; information dilution in a long text is effectively avoided through a multi-attention Encoder-Decoder model, and context association of accounting terms in a long sentence is accurately captured; through the combination of the composite loss function and the CRF layer, the term category prediction precision is optimized, and the dependency relationship learning of the term tag sequence is enhanced.

The present application relates to a kind of large model atlas question answering method and device based on potential unit fine-tuning, the method includes the following steps: based on the knowledge graph of symbolization and relationship path and the variable of using high-dimensional prompt word representation potential unit, potential relationship learning is carried out between large language model and knowledge graph, and relationship reasoning path is generated, wherein the input layer of large language model is additionally trainable potential unit;And potential unit is randomly initialized by normal distribution, and is fine-tuned with large language model in hidden learning process;Relevance evaluation is carried out to relationship reasoning path, and the most relevant relationship reasoning path is selected;Input natural language question, and the answer in knowledge graph is obtained by the most relevant relationship reasoning path.The present application filters out irrelevant and misleading context fragments using these fine-tuned potential units, while improving response efficiency and performance.

The application relates to a recommendation method based on a knowledge graph and an attention mechanism and belongs to the field of personalized recommendation. The method comprises the following steps: defining a knowledge graph perception recommendation problem, establishing a user and item interaction matrix and a knowledge graph as input; setting a seed set of users and items in a knowledge graph propagation layer, propagating the seed set along adjacent entities, and capturing knowledge-based high-order interaction information of the users and items; learning a corresponding latent relationship representation for each relationship through an attention mechanism in a knowledge perception attention embedding layer to obtain a latent associated entity set; processing the entity set through an aggregator to obtain a corresponding aggregation vector, and predicting a preference score of a user for an item according to the aggregation vector; and designing a loss function to train the above process, which is used for user preference recommendation after the training is completed. The application can more accurately capture the latent relationship between the user and the item, and provide more accurate and personalized recommendation services for the user.

The invention discloses a dynamic asymmetric data relation learning and trend prediction method based on environmental state self-adaption, which comprises the following steps of: a) reading multivariable time sequence data, decoupling endogenous and exogenous characteristics through a dual-channel architecture, and aggregating to generate a global state context and a potential factor; b) constructing a directed influence network by using an asymmetric attention mechanism, and introducing a directed acyclic graph constraint to obtain a dynamic adjacency matrix and an external effect; c) generating a gating signal based on the global state, and adaptively adjusting an endogenous feature weight; and d) fusing the multi-source features to carry out full connection processing, and outputting a prediction result. According to the method, the dynamic asymmetric causal relationship between the data is obviously modeled, the adaptive perception of the change of the environment system is realized, and the prediction accuracy and robustness of the multivariable time sequence in the complex non-stationary environment are improved.