Chinese named entity extraction method based on multi-annotation framework and fusion features

Abstract

The invention discloses a Chinese named entity extraction method based on a multi-annotation framework and fusion features. The Chinese named entity extraction method comprises the steps that: firstly, Chinese characters are coded based on a pre-training language model; then, word information and word segmentation mark information are introduced for each Chinese character through dictionary matching, and dictionary features are constructed; on the basis, according to the meaning of the Chinese character in the matched word, phonetic notation is carried out on the Chinese character by using Chinese pinyin software, and pinyin features are constructed; thirdly, the dictionary features and the pinyin features are fused into Chinese character codes on the basis of a click-ride attention mechanism, Chinese character semantic codes combining the dictionary features and the pinyin features are obtained, and the recognition capacity for the Chinese named entity boundary is improved; and finally, the advantages of sequence labeling and index labeling are combined, two labeling tasks are jointly learned through a multi-task learning model, and the accuracy of Chinese named entity extraction is improved.

Description

technical field [0001] The invention belongs to the field of artificial intelligence and natural language processing, and in particular relates to a method for extracting Chinese named entities based on a multi-label framework and fusion features. Background technique [0002] With the rapid development of Internet technology, the explosive growth of data information in various industries has promoted the development of intelligent analysis and mining services and innovative applications of big data in the industry, and further promoted the development of my country's digital economy. These data information contain a large amount of unstructured text. Extracting structured and effective information from these unstructured texts has become the focus of the industry, and it involves a basic task in the field of natural language processing: named entities extract. [0003] Early research work on named entity recognition was mainly based on dictionaries and rules. These methods...

AI Technical Summary

Problems solved by technology

[0007] Purpose of the invention: In view of the problems and deficiencies in the prior art above, the purpose of the present invention is to propose a Chinese named entity extraction method based on multiple annotation frameworks and fusion features, so as to solve the problem that the existing Chinese named entity extraction method has a single annotation framework. , resulting in the problem of being limited to a single annotation framework, and the lack of utilization of word information, resulting in the difficulty of identifying entity boundaries

Images