CN-DBpedia-based entity identification and linking system and method

Abstract

The present invention discloses a CN-DBpedia-based entity identification and linking system and method. The system comprises an entity linking module and an entity identification module; the entity linking module comprises a synonym matching unit and an entity linking unit; and the entity identification module comprises a tokenizer, a word probability calculation unit, and an entity discriminatingunit. According to the technical scheme of the present invention, a semantic relationship between an entity and a word is constructed, so that the relationship with the entity can be mined in a few of context; a machine learning-based entity recognition algorithm is combined with an unsupervised word segmentation algorithm, the rationality of entity name division is considered from the perspective of globality, the vocabulary space of word segmentation is expanded, and the word formation probability of entity words can be calculated by using a more reasonable algorithm; and with a linking first and then identification manner, the semantic information of the text is fully utilized in the entity identification, and better word segmentation and entity identification are realized.

Description

technical field [0001] The invention belongs to the technical field of data services, and in particular relates to a CN-DBpedia-based entity identification and linking system and method. Background technique [0002] The advent of the era of big data has brought unprecedented data dividends to the rapid development of artificial intelligence. Under the "feeding" of big data, artificial intelligence technology has made unprecedented progress. Its progress is prominently reflected in related fields such as knowledge engineering represented by knowledge graph and machine learning represented by deep learning. As the dividends of deep learning for big data are exhausted, the ceiling of the effect of deep learning models is increasingly approaching. On the other hand, a large number of knowledge graphs continue to emerge, but these treasure houses containing a large amount of human prior knowledge have not been effectively utilized by deep learning. Integrating knowledge graph...

AI Technical Summary

Problems solved by technology

The present invention can solve the problem of entity linking with less contextual information in short texts

Images