Knowledge data calculation system and method, server and storage medium

A data computing and data storage module technology, applied in the field of data processing, can solve the problem of high development cost, achieve the effect of saving development cost and easy horizontal expansion

Inactive Publication Date: 2018-04-20
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Different developers may have different data computing needs. At present, developers need to build a complete set of computing architecture according to their own computing needs, and the development cost is relatively high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Knowledge data calculation system and method, server and storage medium
  • Knowledge data calculation system and method, server and storage medium
  • Knowledge data calculation system and method, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] figure 1 It is a schematic diagram of the structure of the knowledge data calculation system provided by Embodiment 1 of the present invention. This embodiment provides a general knowledge data calculation framework, which is applicable to the calculation of knowledge data. Such as figure 1 As shown, the system includes:

[0029] Data storage module 100, for storing knowledge data and knowledge map;

[0030] The data calculation module 200 is used to provide developers with an interface for developing data processing strategies, and perform calculations on the knowledge data to be processed according to the data processing strategies defined by the developers;

[0031] The knowledge map update module 300 is configured to update the knowledge map in the data storage module 100 according to the processed data.

[0032] Among them, the data storage module 100 can be implemented based on a distributed database to support high-level (such as tens of billions, hundreds of ...

Embodiment 2

[0040] On the basis of the above-mentioned embodiments, this embodiment provides an implementation manner of the data calculation module 200, and the data calculation module 200 includes: a flow calculation sub-module and / or a batch calculation sub-module. According to the actual scene requirements, the knowledge data computing system can set up a streaming computing sub-module (suitable for streaming computing scenarios), or a batch computing sub-module (suitable for batch computing scenarios), and can also set up a streaming computing sub-module at the same time And batch computing sub-modules (applicable to both streaming computing scenarios and batch computing scenarios).

[0041] figure 2It is a schematic structural diagram of the knowledge data computing system provided by Embodiment 2 of the present invention, such as figure 2 As shown, the data computing module 200 includes: a stream computing sub-module 210 and a batch computing sub-module 220 .

[0042] The strea...

Embodiment 3

[0061] On the basis of the above embodiments, this embodiment provides a preferred implementation of the knowledge data computing system, such as image 3 As shown, the system is divided from bottom to top: infrastructure layer, computing framework layer and offline strategy layer.

[0062] The infrastructure layer is mainly used to provide the application (APP) operating environment, high-level storage functions, and image retrieval services.

[0063] Among them, KGBase (equivalent to the data storage module 100 in the above-mentioned embodiment) is obtained based on the open-source Hbase and Hadoop encapsulation, so as to realize the high-level data storage function, and the storage format of the knowledge graph data is defined based on the W3C JSON-ID standard .

[0064] GI (Graph Index, graph index, equivalent to the knowledge map update module 300 in the above-mentioned embodiment) provides a graph retrieval service for map data in KGBase, that is, edge calculation is pe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention discloses a knowledge data calculation system and method, a server and a storage medium. The knowledge data calculation system comprises a data storage module, a data calculation module and a knowledge graph updating module, wherein the data storage module is used for storing knowledge data and knowledge graphs; the data calculation module is used for providing the interface of a development data processing strategy for a developer and performing calculation on to-be-process knowledge data according to the data processing strategy defined by the developer; the knowledge graph updating module is used for updating the knowledge graphs in the data storage module according to the processed data. The knowledge data calculation system has the advantages that a universal knowledge data calculation framework is provided, the system supports the data processing strategy defined by the strategy developer, development cost is lowered, and data processing requirements in different scenes are satisfied.

Description

technical field [0001] Embodiments of the present invention relate to data processing technology, and in particular to a knowledge data computing system, method, server and storage medium. Background technique [0002] Knowledge graph (Knowledge Graph, KG) is a structured semantic knowledge base, which is used to describe concepts and their relationships in the physical world in symbolic form. Its basic unit is the "entity-relationship-entity" triplet, and entity And its related attribute-value pairs, and the entities are connected with each other through the relationship to form a network knowledge structure. Through the knowledge map, the web can be transformed from web page links to conceptual links, and users can search by topics instead of strings, so as to realize real semantic retrieval. The search engine based on knowledge maps can feedback structured knowledge to users in a graphical way , users do not have to browse a large number of web pages, they can accurately...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/367
Inventor 王杰
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap