Knowledge graph construction method and system based on multi-source database

A knowledge graph and construction method technology, applied in database management systems, database indexes, relational databases, etc., can solve the problems of cumbersome process, wrong table configuration, failure to build knowledge graph, etc., to simplify the creation process, simplify operation steps, improve The effect of operational efficiency

Pending Publication Date: 2022-03-18
山东合天智汇信息技术有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when constructing a knowledge graph traditionally, it is necessary to manually define the source data, and then perform multiple steps such as governance and extraction of data from different sources. The process is relatively cumbersome; in the case of multiple data resources, some departments have the same data. However, due to the authority of the department, the data seen by each department is limited, and it is impossible for different departments to build different knowledge graphs and organize the same data; in the case of multi-source data sources, the original data must be guaranteed The structure and data are not destroyed, and the fields in the metadata in the knowledge map are further standardized. Using the traditional method, it is necessary to manually standardize the fields in each table, and input the normalized fields into the dictionary configuration table at the specified location. In the process of manual construction, problems such as manual errors and wrong table configurations are prone to occur; when the multi-source data is in a disordered and complicated format, the form is not uniform, and the total amount of various types of data is large, various problems will occur when processing data synchronization , resulting in failure to build the knowledge map

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Knowledge graph construction method and system based on multi-source database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Such as figure 1 As shown, this embodiment provides a method for building a knowledge map based on a multi-source database. By setting rules for the fields in the table in the source database, the rules define which fields can be used to construct entities in the knowledge map, that is, define entities Metadata fields; at the same time, which fields between metadata and metadata can construct the relationship in the knowledge map, that is, the relational metadata field. By defining metadata rules to create a model that extracts data from various data sources and converts table fields into corresponding metadata configurations, and compares the data one by one and converts them into entities, so that various data resources can be automated using SQL statements Build a knowledge graph and normalize the knowledge.

[0038] Step 1. Data governance and metadata creation: Judge the validity of all source databases, and obtain all tables in each valid source database, and eac...

Embodiment 2

[0063] This embodiment provides a knowledge graph construction system based on a multi-source database, which specifically includes the following modules:

[0064] The validity judgment module is configured to: judge the validity of all source databases, specifically: obtain data source configuration parameters, and send the data source configuration parameters to each source database, and judge the source availability of the database;

[0065] A metadata acquisition module configured to: acquire all tables in each source database, and use each table as a piece of metadata;

[0066] A field extraction module, which is configured to: obtain a field extraction instruction, extract the fields of each table, and use it as a field of corresponding metadata;

[0067] An entity relationship building module, which is configured to: for any two metadata, extract fields with a matching relationship, traverse the entities in the metadata, and build all entity relationships between the t...

Embodiment 3

[0071] This embodiment provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the multi-source database-based knowledge map construction method as described in the first embodiment above are implemented .

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a knowledge graph construction method and system based on a multi-source database, and the method comprises the steps: obtaining all tables in each source database, and taking each table as metadata; obtaining a field extraction instruction, extracting the field of each table, and taking the field as the field of the corresponding metadata; for any two pieces of metadata, extracting fields with a matching relationship, traversing entities in the metadata, and constructing all entity relationships between the two pieces of metadata based on the fields with the matching relationship; and taking all the entities as nodes of the knowledge graph and the entity relationships as edges of the knowledge graph to obtain the knowledge graph. The establishment process of the knowledge graph is simplified, and the establishment efficiency is improved.

Description

technical field [0001] The invention belongs to the technical field of knowledge graph construction, and in particular relates to a multi-source database-based knowledge graph construction method and system. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] In the face of massive data, traditional relational databases can no longer meet the needs of analysis. Distributed graph databases can clearly reveal various complex relationships, especially for industries such as intricate social networks, logistics, and financial risk control. as obvious. [0004] However, when constructing a knowledge graph traditionally, it is necessary to manually define the source data, and then perform multiple steps such as governance and extraction of data from different sources. The process is relatively cumbersome; in the case of multiple data resources, som...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/36G06F16/28G06F16/25G06F16/22
CPCG06F16/367G06F16/2282G06F16/284G06F16/254
Inventor 田立娜高军王可鑫段文良
Owner 山东合天智汇信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap