A Construction Method of Aerospace Manufacturing Knowledge Graph Based on Heterogeneous Data Joint Extraction Mode
Through a method based on the joint extraction mode of heterogeneous data, a variety of deep learning algorithms and graph neural networks are used to solve the complexity and transferability of knowledge graphs in the field of aerospace manufacturing, rapid knowledge extraction and decision-making support are achieved, and the application implementation and user experience of knowledge graphs are improved.
Patent Information
- Application Number
- CN202411588190.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-08
- Publication Date
- 2025-08-05
- Estimated Expiration
- 2044-11-08
AI Technical Summary
The existing knowledge graph construction methods are difficult to obtain knowledge in complex industrial scenarios in the field of aerospace manufacturing, and are difficult to migrate to other businesses, neglecting the mining of knowledge decision-making capabilities. The application of traditional methods in this field has the problem of low knowledge integration and utilization.
Using a method based on the joint extraction mode of heterogeneous data, a variety of deep learning algorithms are used to construct knowledge graphs, including top-down design patterns, storage methods combining table structures and graph structures, knowledge inference of multi-task learning models and graph neural networks, combined with semantic search and visual decision support, to achieve rapid extraction and fusion of knowledge.
It realizes the rapid construction and transferability of knowledge graphs in the field of aerospace manufacturing, provides reliable decision support and intelligent question-and-answer functions, and improves the application ability of knowledge graphs in this field and user interaction experience.
Smart Images

Figure CN119514662B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of knowledge management and mining technology in the field of aerospace intelligent manufacturing, and specifically relates to a method for constructing an aerospace manufacturing knowledge graph based on a joint extraction mode of heterogeneous data. Background Art
[0002] Knowledge graphs are a new approach to knowledge representation and management, extending beyond general domains like search and question-answering. A domain knowledge graph construction method focused on specific industrial scenarios and vertical knowledge can provide in-depth data analysis and decision support for specific industries.
[0003] With the continuous progress and development of knowledge and data science, knowledge graphs in industrial verticals are often used to help companies understand and optimize their production processes more deeply, and promote interdisciplinary innovation and decision-making. The aerospace manufacturing field has a strict and rich data model, and is in urgent need of a knowledge management and decision support tool to promote knowledge integration and innovation. However, building a knowledge graph in this field has higher requirements for the richness, depth, and accuracy of aerospace manufacturing knowledge. Traditional knowledge graph construction methods are difficult to use in complex industrial scenarios. Since the knowledge sources are extremely rich and complex, even if a knowledge graph can be built for a certain business, it is difficult to migrate to other businesses in the field, and existing knowledge graph construction methods often ignore the mining of knowledge decision-making capabilities. In response to the difficulties in the aerospace manufacturing field, the present invention proposes a method for constructing an aerospace manufacturing knowledge graph based on a joint extraction model of heterogeneous data. The method uses a variety of deep learning algorithms to quickly extract and reason on structured, semi-structured, and unstructured complex data sources, solving the problem of difficult knowledge acquisition in complex industrial scenarios in the aerospace manufacturing field. Summary of the Invention
[0004] In response to the above-mentioned deficiencies in the existing technologies, the present invention proposes a method for constructing an aerospace manufacturing knowledge graph based on a joint extraction mode of heterogeneous data. A variety of deep learning algorithms are used to establish a modular knowledge graph life cycle for rapid extraction of complex domain knowledge and construction and application of knowledge graphs in various aerospace manufacturing scenarios. The top-down design model improves the professionalism and seriousness of the knowledge graph to provide reliable decision-making support to production line engineers and operators.
[0005] In order to achieve the above technical objectives, the present invention provides the following technical solutions:
[0006] A method for constructing an aerospace manufacturing knowledge graph based on a joint extraction model of heterogeneous data includes the following steps:
[0007] S1. Design and construct the knowledge model of the knowledge graph using automated modeling tools based on top-down theory;
[0008] S2. The underlying storage of the knowledge graph is performed by combining table structure and graph structure;
[0009] S3. Extract and mine knowledge from structured, semi-structured, and unstructured data;
[0010] S4. Perform data model layer fusion and data instance layer fusion on data from different sources;
[0011] S5. Fast knowledge reasoning based on graph neural networks for knowledge discovery and knowledge graph completion;
[0012] S6. Combine the unique application forms of knowledge graphs with data and business scenarios in the aerospace manufacturing field to provide intelligent question-answering and visual decision support based on semantic search.
[0013] Furthermore, step S1 specifically includes:
[0014] S11. Design an aerospace manufacturing knowledge model based on a top-down approach. Define the ontology concept classes, relationships, attributes, and instances of the knowledge graph under the constraints of expert knowledge. Ontology concept classes are the basic elements of the knowledge graph structure. They include entities, classes, attributes, relationships, etc., and are used to organize and express the knowledge system in the aerospace manufacturing field.
[0015] S12. Use automated modeling tools to shield specific ontology description languages and quickly construct ontology models in the aerospace manufacturing field at the conceptual level.
[0016] Furthermore, step S2 specifically includes:
[0017] S21. Use a relational database to store the knowledge graph knowledge model metadata, and store ontology definitions, categories, attributes, relationships, etc. in the form of data tables;
[0018] S22. Use the Resource Description Framework (RDF) to store triple data of the knowledge graph, i.e., entities, attributes, and relationship instances, and simultaneously map the triple data to the graph database;
[0019] S23. Establish relational database, and synchronize data between RDF and graph database.
[0020] Furthermore, step S3 specifically includes:
[0021] S31, for structured aerospace manufacturing data, uses R2RML language to directly map relational data into RDF datasets;
[0022] S32. Develop a multi-task learning model for semi-structured and unstructured aerospace manufacturing data that can simultaneously extract entities, relations, and events. This model uses a unified input layer to accept textual information and convert it into word embeddings. A bidirectional long short-term memory network and transformer are used in the shared layer to capture word order and contextual information. Self-attention or hierarchical attention mechanisms are applied after the shared layer to focus on the most task-relevant parts of the text. After the shared layer and the attention mechanism are integrated, entity extraction layers, relation extraction layers, and event extraction layers are designed. A multi-task joint loss function is defined to optimize the multi-task learning model.
[0023] S33, use the probability model to disambiguate entities and solve the entity reference problem in the text by defining the feature function f(e j ,c j )Entity e j and category c j Mapped to a feature vector, for the Markov model, define the state transition probability P(cj|cj-1), calculate the entity e i Belongs to category c j The probability P(c j |e i ), choose so that P(c j |e i )The largest category c j As e i The disambiguation results are iteratively optimized using the cross entropy loss function.
[0024] More specifically, in step S32, the multi-task joint loss function optimizes the multi-task learning model as follows:
[0025] Select θ that minimizes the multi-task joint loss function m is the optimal parameter of the multi-task learning model, and the formula is expressed as:
[0026]
[0027] Among them, θ m * Represents the optimal parameters of the multi-task learning model, L total represents the multi-task joint loss function; the multi-task joint loss function is defined as follows:
[0028] L total =L entity (Y entity ,Y entity_true )+L relation (Y relation ,Y relation_true )+L event (Y event ,Yevent_true );
[0029] Among them, L entity 、L relation and L event Represents the independent loss functions of entities, relations and events respectively; Y entity_true 、Y relation_true and Y event_true Represent the true values of entities, relations, and events respectively; Y entity 、Y relation and Y event Represents predicted values of entities, relations, and events;
[0030] The predicted value is obtained by extracting the function, and the formula is expressed as:
[0031] Y entity =f entity (H);
[0032] Y relation =f relation (H);
[0033] Y event =f event (H);
[0034] Among them, f entity 、f relation and f event Represent the extraction functions of entities, relations, and events respectively; H is the fusion output of the sharing layer and the attention layer, and its formula is expressed as:
[0035] H=Bi-LSTM(X)+Attention(Bi-LSTM(X));
[0036] Among them, X represents the input information after embedding processing, Bi-LSTM represents the bidirectional long short-term memory network of the shared layer, and Attention represents the attention function of the attention layer.
[0037] Furthermore, step S4 specifically includes:
[0038] S41. At the data model layer, expert knowledge and high-confidence structured knowledge mapping from aerospace manufacturing are used to merge concepts, merge concept hierarchies, and merge concept attribute definitions.
[0039] S42. At the data instance layer, a deep learning-based method is used to identify and match the same entities in different data sources. The text is converted into feature word vectors through a deep learning model, and instance matching is achieved based on cosine similarity. Optimization and model training are performed through contrast loss. After successful matching, different instances of the same entity are merged into a single entity.
[0040] More specifically, the specific process of optimizing and training the model by contrast loss in step S42 is as follows:
[0041] Choose θ that minimizes the contrast loss c To compare the optimal parameters of the learning model, the formula is expressed as:
[0042]
[0043] Among them, θ c * represents the optimal parameters of the contrastive learning model, L is the contrastive loss, and its calculation formula is:
[0044]
[0045] Among them, y i is a weight term to ensure that only negative samples contribute to the loss function, and are the positive and negative samples of the i-th instance pair in the batch, respectively, and f is a deep learning model used to convert entities into embedding vectors.
[0046] Furthermore, step S5 specifically includes:
[0047] S51. Train a graph neural network model to represent entities and relationships in the knowledge graph as a graph structure, where entities are nodes and relationships are edges. Information transfer is accomplished by aggregating information from neighboring nodes to update the state of each node. Knowledge reasoning is performed using the embedded representations of entities and relationships learned by GNN, and a loss function is used to supervise model training.
[0048] S52. Use the trained graph neural network model to perform knowledge reasoning and knowledge graph completion under the supervision of expert knowledge when building and maintaining the knowledge graph.
[0049] More specifically, the loss function used in step S51 to train the supervised model is:
[0050] Select θ with the minimum loss as the optimal parameter of the supervised model, and the formula is expressed as:
[0051] θ * =argmin θ L;
[0052] Among them, L is the loss function, and its calculation formula is:
[0053]
[0054] Among them, v i ,v j is an entity, It is v i ,v j The true label of the relationship between Is entity v i ,v j The predicted value of the relationship between , where the predicted value reasoning method is as follows:
[0055]
[0056] where f readout is the readout function, and the readout function is calculated as follows:
[0057]
[0058] Where N(v) is the set of neighbor nodes of v, c uv is the weight or coefficient of the edge between nodes u and v, W (t) is the weight matrix at time step t, σ is the nonlinear activation function, Represents the feature representation of node u at layer t.
[0059] Furthermore, step S6 specifically includes:
[0060] S61. Use semantic search-based intelligent question-answering technology to understand user intent and perform contextual analysis in aerospace manufacturing scenarios. Provide personalized search results and recommendations based on user preferences and historical behavior. Provide explainable search results to help users understand the reasoning process of the search algorithm.
[0061] S62. Promote knowledge discovery through complex queries and decision understanding, use visualization, reasoning, and retrieval technologies in aerospace manufacturing scenarios, enhance user interactive experience, and help users quickly understand business models.
[0062] Based on the above technical solution, the present invention has the following beneficial effects:
[0063] This invention provides a complete set of knowledge graph construction paradigms, which solves the problems of difficult knowledge integration and low utilization in aerospace manufacturing scenarios, making it possible to build knowledge graphs in the aerospace manufacturing field.
[0064] Based on the joint extraction of structured, semi-structured and unstructured complex heterogeneous data, the richness of knowledge sources and the transferability of construction methods are guaranteed;
[0065] Through a variety of deep learning and machine learning methods, it provides a full-process knowledge extraction, knowledge fusion, and knowledge discovery model. It can cope with the challenges posed by various knowledge sources and data formats to knowledge extraction, and solve the problems of difficult application and implementation of knowledge graphs in the aerospace manufacturing field and poor task transferability of existing construction methods. Based on a top-down logic, it ensures the scientific and serious nature of building knowledge graphs in this field.
[0066] At the same time, the intelligent question-answering and visual decision-making support functions of the knowledge graph are utilized to provide users with a complete set of intelligent and fast aerospace manufacturing knowledge understanding and knowledge mining solutions, and the knowledge intelligent decision-making function of the knowledge graph is used to further assist the transformation of the aerospace manufacturing business. BRIEF DESCRIPTION OF THE DRAWINGS
[0067] Figure 1 This is the overall flow chart of the aerospace manufacturing knowledge graph construction method based on the heterogeneous data joint extraction mode proposed in the present invention. DETAILED DESCRIPTION
[0068] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0069] Although the steps in the present invention are arranged with numbers, they are not intended to limit the order of the steps. Unless the order of the steps is clearly stated or the execution of a step requires other steps as a basis, the relative order of the steps can be adjusted. It is understood that the term "and / or" used herein refers to and covers any and all possible combinations of one or more of the associated listed items.
[0070] like Figure 1 As shown in FIG, a method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction mode proposed by the present invention is given, which specifically includes the following steps:
[0071] S1. Design and construct the knowledge model of the knowledge graph using automated modeling tools based on top-down theory;
[0072] As a preferred implementation of step S1, step S1 specifically includes:
[0073] S11. Design aerospace manufacturing knowledge model based on top-down theory and define the ontology concepts of the knowledge graph under the constraints of expert knowledge, including classes, relationships, attributes and instances;
[0074] S12. Use automated modeling tools to shield specific ontology description languages and quickly construct ontology models in the aerospace manufacturing field at the conceptual level.
[0075] S2. The underlying storage of the knowledge graph is performed by combining table structure and graph structure;
[0076] As a preferred implementation of step S2, step S2 specifically includes:
[0077] S21. Use a relational database to store the metadata of the knowledge graph knowledge model, including ontology definitions, categories, attributes, relationships, and other information;
[0078] S22. Use RDF to store entities, attributes, and relationship instances of the knowledge graph, and simultaneously map triple data to the graph database;
[0079] S23. Establish relational database, and synchronize data between RDF and graph database.
[0080] In this embodiment, the mapping relationship between RDF and graph database is constructed to facilitate various data queries in industrial scenarios and provide quick visualization support; and the data synchronization between relational database, RDF and graph database is established to ensure that the update of knowledge model and specific knowledge instances can be carried out without conflict.
[0081] S3. Extract and mine knowledge from structured, semi-structured, and unstructured data;
[0082] As a preferred implementation of step S3, step S3 specifically includes:
[0083] S31, for structured aerospace manufacturing data, uses R2RML language to directly map relational data into RDF datasets;
[0084] S32. Develop a multi-task learning model for semi-structured and unstructured aerospace manufacturing data that can simultaneously extract entities, relations, and events. This model uses a unified input layer to accept textual information and convert it into word embeddings. A bidirectional long short-term memory network and transformer are used in the shared layer to capture word order and contextual information. Self-attention or hierarchical attention mechanisms are applied after the shared layer to focus on the most task-relevant parts of the text. After the shared layer and the attention mechanism are integrated, entity extraction layers, relation extraction layers, and event extraction layers are designed. A multi-task joint loss function is defined to optimize the multi-task learning model.
[0085] More specifically, the optimization process is as follows:
[0086] The optimal parameter of the multi-task learning model is selected to minimize the multi-task joint loss function. The formula is expressed as:
[0087] θ * =argmin θ Ltotal ;
[0088] Among them, θ * Represents the optimal parameters of the multi-task learning model, L total represents the multi-task joint loss function; the multi-task joint loss function is defined as follows:
[0089] L total =L entity (Y entity ,Y entity_true )+L relation (Y relation ,Y relation_true )+L event (Y event ,Y event_true );
[0090] Among them, L entity 、L relation and L event Represents the independent loss functions of entities, relations and events respectively; Y entity_true 、Y relation_true and Y event_true Represent the true values of entities, relations, and events respectively; Y entity 、Y relation and Y event Represents predicted values of entities, relations, and events;
[0091] The predicted value is obtained by extracting the function, and the formula is expressed as:
[0092] Y entity =f entity (H);
[0093] Y relation =f relation (H);
[0094] Y event =f event (H);
[0095] Among them, f entity 、f relation and f event Represent the extraction functions of entities, relations, and events respectively; H is the fusion output of the sharing layer and the attention layer, and its formula is expressed as:
[0096] H=Bi-LSTM(X)+Attention(Bi-LSTM(X));
[0097] Among them, Bi-LSTM represents the bidirectional long short-term memory network of the shared layer, and Attention represents the attention function of the attention layer.
[0098] S33, use the probability model to disambiguate entities and solve the entity reference problem in the text by defining the feature function f(e j ,c j )Entity e j and category c j Mapped to a feature vector, for the Markov model, define the state transition probability P(cj|cj-1), calculate the entity e i Belongs to category c j The probability P(c j |e i ), choose so that P(c j |e i )The largest category c j As e i The disambiguation results are iteratively optimized using the cross entropy loss function.
[0099] S4. Perform data model layer fusion and data instance layer fusion on data from different sources;
[0100] As a preferred implementation of step S4, step S4 specifically includes:
[0101] S41. At the data model layer, expert knowledge and high-confidence structured knowledge mapping from aerospace manufacturing are used to merge concepts, merge concept hierarchies, and merge concept attribute definitions.
[0102] S42. At the data instance layer, a deep learning-based method is used to identify and match the same entities in different data sources. The text is converted into feature word vectors through a deep learning model, and instance matching is achieved based on cosine similarity. Optimization and model training are performed through contrast loss. After successful matching, different instances of the same entity are merged into a single entity.
[0103] More specifically, the specific process of optimization and model training through contrast loss is:
[0104] Select θ with the minimum contrast loss as the optimal parameter of the deep learning model, and the formula is expressed as:
[0105] θ * =argmin θ L
[0106] Among them, L is the contrast loss, and its calculation formula is:
[0107]
[0108] Among them, y i Is a label, the value is 1 or 0, and are the positive and negative samples of the i-th instance pair in the batch, and f is the deep learning model used to convert entities into embedding vectors.
[0109] In this embodiment, positive samples refer to sample pairs that are similar or related in some sense, and negative samples refer to sample pairs that are dissimilar or unrelated in some sense. This loss function encourages the model to bring the feature representations of positive samples closer together, while pushing the feature representations of negative samples further apart.
[0110] S5. Fast knowledge reasoning based on graph neural networks for knowledge discovery and knowledge graph completion;
[0111] As a preferred implementation of step S5, step S5 specifically includes:
[0112] S51. Train a graph neural network model to represent entities and relationships in the knowledge graph as a graph structure, where entities are nodes and relationships are edges. Information transfer is accomplished by aggregating information from neighboring nodes to update the state of each node. Knowledge reasoning is performed using the embedded representations of entities and relationships learned by GNN, and a loss function is used to supervise model training.
[0113] More specifically, the loss function used to train the supervised model is:
[0114] Choose θ with the minimum loss g is the optimal parameter of the graph neural network model, and the formula is expressed as:
[0115] θ g * =argmin θ L;
[0116] Among them, θ g * represents the optimal parameters of the graph neural network model, L is the loss function, and its calculation formula is:
[0117]
[0118] Among them, v i ,v j is an entity, It is v i ,v j The true label of the relationship between Is entity v i ,v j The predicted value of the relationship between , where the predicted value reasoning method is as follows:
[0119]
[0120] in, and For entity node v i With v j The feature representation, f readout is the readout function, and the readout function is calculated as follows:
[0121]
[0122] Where N(v) is the set of neighbor nodes of v, c uv is the normalization coefficient, W (t) is the weight matrix at the time step, and σ is the nonlinear activation function. Since the function is updated in real time, is the update rule of the function;
[0123] S52. Use the trained graph neural network model to perform knowledge reasoning and knowledge graph completion under the supervision of expert knowledge when building and maintaining the knowledge graph.
[0124] S6. Combine the unique application forms of knowledge graphs with data and business scenarios in the aerospace manufacturing field to conduct intelligent question answering and visual decision support based on semantic search;
[0125] As a preferred implementation of step S6, step S6 specifically includes:
[0126] S61. Use semantic search-based intelligent question-answering technology to understand user intent and perform contextual analysis in aerospace manufacturing scenarios. Provide personalized search results and recommendations based on user preferences and historical behavior. Provide explainable search results to help users understand the reasoning process of the search algorithm.
[0127] S62. Promote knowledge discovery through complex queries and decision understanding, use visualization, reasoning, and retrieval technologies in aerospace manufacturing scenarios, enhance user interactive experience, and help users quickly understand business models.
[0128] Thus, this embodiment has realized the construction of an aerospace manufacturing knowledge graph based on a joint extraction model of heterogeneous data, and completed the vertical implementation of the knowledge graph in the complex field of aerospace manufacturing. The method proposed in this invention is based on the knowledge graph construction paradigm of multiple deep learning methods, and jointly extracts and applies knowledge from structured, semi-structured, and unstructured knowledge sources to achieve the rapid construction of knowledge graphs in various aerospace manufacturing businesses. Through top-down business logic, the construction of the knowledge graph is carried out under the guidance of expert knowledge, without causing confusion in the knowledge structure and logic. At the same time, through intelligent question-answering and visual decision support, the knowledge graph is helped to quickly extract knowledge, understand knowledge, and make knowledge decisions in aerospace manufacturing scenarios.
[0129] In summary, the present invention proposes a knowledge graph construction method based on a joint extraction mode of heterogeneous data, which can adapt to various complex knowledge sources and data modes, and solve the problems of difficult implementation, poor migration and poor interpretability of knowledge graphs in the field of aerospace manufacturing. This knowledge graph construction method can be applied to a variety of aerospace manufacturing task scenarios and provide efficient knowledge decision support.
[0130] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above and that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims, not the foregoing description, and all variations within the meaning and range of equivalents of the claims are intended to be included therein. Any reference sign in a claim should not be construed as limiting the claim to which it relates.
[0131] In addition, it should be understood that although this specification is described in terms of implementation methods, not every implementation method contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.
Claims
1. A method for constructing an aerospace manufacturing knowledge graph based on a joint extraction model of heterogeneous data, characterized in that: The following steps are involved: S1. Design and construct the knowledge model of the knowledge graph using automated modeling tools based on top-down theory; S2. The underlying storage of the knowledge graph is performed by combining table structure and graph structure; S3. Extract and mine knowledge from structured, semi-structured, and unstructured data; specifically: S31, for structured aerospace manufacturing data, uses R2RML language to directly map relational data into RDF datasets; S32. Develop a multi-task learning model for simultaneous entity, relation, and event extraction from semi-structured and unstructured aerospace manufacturing data. This model uses a unified input layer to accept textual information and convert it into word embeddings. A bidirectional long short-term memory network and transformer are used in the shared layer to capture word order and contextual information. Self-attention or hierarchical attention mechanisms are applied after the shared layer to focus on the most task-relevant parts of the text. After integrating the shared layer and the attention mechanism, entity, relation, and event extraction layers are designed. A multi-task joint loss function is defined to optimize the multi-task learning model. S33, use the probability model to disambiguate entities and solve the entity reference problem in the text by defining the feature function f(e j ,c j )Entity e j and category c j Mapped to a feature vector, for the Markov model, define the state transition probability P(cj|cj-1), calculate the entity e i Belongs to category c j The probability P(c j |e i ), choose so that P(c j |e i )The largest category c j As e i The disambiguation result is iteratively optimized using the cross entropy loss function; S4. Perform data model layer fusion and data instance layer fusion on data from different sources; S5. Fast knowledge reasoning based on graph neural networks for knowledge discovery and knowledge graph completion; S6. Combine the unique application forms of knowledge graphs with data and business scenarios in the aerospace manufacturing field to provide intelligent question-answering and visual decision support based on semantic search.
2. The method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction model according to claim 1 is characterized in that: Step S1 specifically includes: S11. Design aerospace manufacturing knowledge model based on top-down theory and define the ontology concepts of the knowledge graph under the constraints of expert knowledge, including classes, relationships, attributes and instances; S12. Use automated modeling tools to shield specific ontology description languages and quickly construct ontology models in the aerospace manufacturing field at the conceptual level.
3. The method for constructing an aerospace manufacturing knowledge graph based on a joint extraction mode of heterogeneous data according to claim 1 is characterized in that: Step S2 specifically includes: S21. Use a relational database to store the knowledge graph knowledge model metadata, and store ontology definitions, categories, attributes, relationships, etc. in the form of data tables; S22. Use the Resource Description Framework (RDF) to store triple data of the knowledge graph, i.e., entities, attributes, and relationship instances, and simultaneously map the triple data to the graph database; S23. Establish relational database, and synchronize data between RDF and graph database.
4. The method for constructing an aerospace manufacturing knowledge graph based on a joint extraction mode of heterogeneous data according to claim 1 is characterized in that: The optimization process in step S32 is specifically as follows: Select θ that minimizes the multi-task joint loss function m is the optimal parameter of the multi-task learning model, and the formula is expressed as: Among them, θ m * Represents the optimal parameters of the multi-task learning model, L total represents the multi-task joint loss function; the multi-task joint loss function is defined as follows: L total =L entity (AND entity ,AND entity_true )+L relation (AND relation ,AND relation_true )+L event (AND event ,AND event_true ); Among them, L entity , L relation and L event Represents the independent loss functions of entities, relations and events respectively; Y entity_true 、Y relation_true and Y event_true Represent the true values of entities, relations, and events respectively; Y entity 、Y relation and Y event Represents predicted values of entities, relations, and events; The predicted value is obtained by extracting the function, and the formula is expressed as: Y entity =f entity (H); Y relation =f relation (H); Y event =f event (H); Among them, f entity 、f relation and f event Represent the extraction functions of entities, relations, and events respectively; H is the fusion output of the sharing layer and the attention layer, and its formula is expressed as: H=Bi-LSTM(X)+Attention(Bi-LSTM(X)); Among them, X represents the input information after embedding processing, Bi-LSTM represents the bidirectional long short-term memory network of the shared layer, and Attention represents the attention function of the attention layer.
5. The method for constructing an aerospace manufacturing knowledge graph based on a joint extraction mode of heterogeneous data according to claim 1 is characterized in that: Step S4 specifically includes: S41. At the data model layer, expert knowledge and high-confidence structured knowledge mapping from aerospace manufacturing are used to merge concepts, merge concept hierarchies, and merge concept attribute definitions. S42. At the data instance layer, a deep learning-based method is used to identify and match the same entities in different data sources. The text is converted into feature word vectors through a deep learning model, and instance matching is achieved based on cosine similarity. Optimization and model training are performed through contrast loss. After successful matching, different instances of the same entity are merged into a single entity.
6. The method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction model according to claim 5 is characterized in that: The specific process of optimizing and training the model by contrast loss in step S42 is as follows: Choose θ that minimizes the contrast loss c To compare the optimal parameters of the learning model, the formula is expressed as: Among them, θ c * represents the optimal parameters of the contrastive learning model, L is the contrastive loss, and its calculation formula is: Among them, y i is a weight term to ensure that only negative samples contribute to the loss function, and are the positive and negative samples of the i-th instance pair in the batch, respectively, and f is a deep learning model used to convert entities into embedding vectors.
7. The method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction model according to claim 1 is characterized in that: Step S5 specifically includes: S51. Train a graph neural network model to represent entities and relationships in the knowledge graph as a graph structure, where entities are nodes and relationships are edges. Information transfer is accomplished by aggregating information from neighboring nodes to update the state of each node. Knowledge reasoning is performed using the embedded representations of entities and relationships learned by GNN, and a loss function is used to supervise model training. S52. Use the trained graph neural network model to perform knowledge reasoning and knowledge graph completion under the supervision of expert knowledge when building and maintaining the knowledge graph.
8. The method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction model according to claim 7 is characterized in that: The specific training of the supervised model using the graph neural network loss function in step S51 is: Choose θ with the minimum loss g is the optimal parameter of the graph neural network model, and the formula is expressed as: <h2 style=";text-align:left;direction:ltr">θ<h2 style=";text-align:left;direction:ltr"> g <h2 style=";text-align:left;direction:ltr"> * <h2 style=";text-align:left;direction:ltr"> =argmin<h2 style=";text-align:left;direction:ltr"> θ <h2 style=";text-align:left;direction:ltr"> L; Among them, θ g * represents the optimal parameters of the graph neural network model, L is the loss function, and its calculation formula is: Among them, v i ,v j is an entity, It is v i ,v j The true label of the relationship between Is entity v i ,v j The predicted value of the relationship between , where the predicted value reasoning method is as follows: in, and For entity node v i With v j The feature representation, f readout is the readout function, and the readout function is calculated as follows: Where N(v) is the set of neighbor nodes of v, c uv is the weight or coefficient of the edge between nodes u and v, W (t) is the weight matrix at time step t, σ is the nonlinear activation function, Represents the feature representation of node u at layer t.
9. The method for constructing an aerospace manufacturing knowledge graph based on a heterogeneous data joint extraction model according to claim 1 is characterized in that: Step S6 specifically includes: S61. Use semantic search-based intelligent question-answering technology to understand user intent and perform contextual analysis in aerospace manufacturing scenarios. Provide personalized search results and recommendations based on user preferences and historical behavior, and explain search results to help users understand the reasoning process of the search algorithm. S62. Promote knowledge discovery through complex queries and decision understanding, use visualization, reasoning, and retrieval technologies in aerospace manufacturing scenarios, enhance user interactive experience, and help users quickly understand business models.
Citation Information
Patent Citations
Extraction method of entity relationship of electronic medical record, based on BLSTM and attention mechanism
CN108536754A
Healthy diet-oriented multi-modal knowledge graph service platform construction method
CN115714001A