Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Deep layer data processing method and system combined with knowledge base

A technology of data processing and knowledge base, applied in the field of deep data processing combined with knowledge base, can solve the problems of consuming a lot of time and space, low efficiency, incomplete knowledge, etc., and achieve the effect of high-efficiency parameter update

Active Publication Date: 2014-01-08
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF3 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the natural language system developed under the framework of Markov logic cannot solve these requirements well. First, multi-level is the basic organizational structure of large-scale knowledge representation, but in the process of generating candidate rules, only the relationship between two predicates is usually considered. In the case of common concept variables, the inherent hierarchical relationship between concepts and the possible overlap and intersection of the described scope are ignored. Therefore, under the constraints of the given rule length, it is easy to lose a lot of important semantic information and affect all The quality of the generated logical rules; secondly, as an important part of knowledge representation, the scale of automatic acquisition of uncertain rules is directly limited by the complexity of parameter learning algorithms (that is, assigning appropriate weights to logical rules), although in principle both The layer is enough to express any function, but the efficiency is very low when expressing most functions, and the existing methods usually need to calculate the instantiation and value of all candidate clauses during the optimization process, which will consume a lot of time and space overhead, so it is not suitable for automatic processing of large-scale knowledge; re-generalization and activation are the concrete manifestation of knowledge application ability, but the probabilistic reasoning about complex relationships has not fully considered effective knowledge generalization at the entity or relationship level, Therefore, it is difficult to deal with the problem of incomplete knowledge such as incomplete evidence coverage. In addition, the current activation strategy is more based on the value of the instance tuple and its logical rules, and has not considered the relationship between the target tuple and the instance tuple or logical rules. degree, so it is easy to generate a large number of weakly related or even irrelevant rules or tuples, which brings huge computational overhead for uncertain reasoning and affects the efficiency of semantic analysis
Therefore, existing semantic analysis systems still have deficiencies in many aspects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep layer data processing method and system combined with knowledge base
  • Deep layer data processing method and system combined with knowledge base
  • Deep layer data processing method and system combined with knowledge base

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0031] First of all, it needs to be explained that the knowledge base of the computing brain is composed of an ontology base, a fact base and a rule base. The ontology base stores the structured tuples between concepts and their weights, and the fact base stores the information between instances. The structured tuples of the rule base store logical rules and their weights, and all predicates, instances and concepts are uniquely identified semantically.

[0032] figure 1 It is a flow chart of a deep data processing method combined with a knowledge base according to one aspect of the present invention. Next, semantic analysis is taken as an example to illustrate the method of the present invention, as figure 1 As shown, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a deep layer data processing method combined with a knowledge base. The method comprises the following steps that concept tuple sets in a body base are merged; link routes of predicates in different types and corresponding logic rule sets are obtained; the logic rule sets are screened preliminarily, candidate rule sets are obtained; a deep layer probabilistic graphical model is obtained; structuring tuples are obtained based on data to be processed and are mapped to a layering concept space; target tuples are generated, semantic extension is carried out; logic rule sets and evidence tuple sets are obtained; a Markov logical net is subjected to instantiation, the conditional probability for target tuple founding is computed, and data processing results are obtained. The invention further provides a deep layer data processing system which comprises a structuring module, a conceptualization module, a target generating module, an extension module, an activating module and a probability computing module. Context and background knowledge can be fully merged, and accordingly, the purpose of semantic comprehension is really achieved.

Description

technical field [0001] The invention relates to the fields of natural language processing and artificial intelligence, and more specifically, relates to a text understanding-oriented deep data processing method combined with a knowledge base. Background technique [0002] With the increasing popularity of network informatization, data is rapidly expanding with unprecedented breadth and depth, and it is becoming more and more important to enhance the ability to analyze and extract knowledge from unstructured text. In addition to the large scale of texts from the real world, the more important challenge is the complexity and uncertainty of representing and reasoning knowledge. The former is reflected in the high degree of heterogeneity of knowledge, which includes not only facts and concepts about each object, but also general reasoning rules and ontological relations; the latter stems from the objective reality of knowledge itself and the subjective level of knowledge, and a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/243G06F16/24575
Inventor 郝红卫孙正雅梁倩王桂香
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products