Chinese organization name abbreviation recognition system adopting context feature matching

Abstract

The invention discloses a Chinese organization name abbreviation recognition system adopting context feature matching. The system is characterized by including firstly, training to obtain an organization name unique feature set and an intersected feature set of distractor word context features and organization name context features; adopting the features for recognizing abbreviations of organization names; screening the abbreviations of the organization names by means of setup of a distractor word list and extended operations. The Chinese organization name abbreviation recognition system adopting context feature matching has the advantages that recognition of the abbreviations is independent of full names of organizations and composition forms of the abbreviations of the organization names, and the abbreviations of the organization names can be recognized only according to the context features of the organization names.

Description

technical field [0001] The invention relates to the technical field of natural language processing, in particular to a recognition system for organization names and abbreviations based on context features. Background technique [0002] Named entity recognition has become a basic task in natural language processing, and plays an important role in information extraction, syntactic analysis, and machine translation. Person names, place names, and organization names are the three most important types of named entities. At present, the identification research of the first two types has been extensive and detailed, and it is of great significance to accurately and efficiently identify organization names. In the text, abbreviations are a common grammatical phenomenon. However, due to the characteristics of various composition forms, weak regularity, and the possibility of multiple abbreviations for the same full name, it is difficult to identify them. [0003] At present, the iden...

AI Technical Summary

Problems solved by technology

However, no matter which identification method is used, the abbreviation of the institution name depends on the full name. If the full name corresponding to the abbreviation of the institution name is not included in the corpus, the abbreviation of the institution name will not be recognized.

In addition, the Chinese characters that make up the abbreviation by default also come from the full name and are in the same order as in the full name, which makes it difficult to recognize the abbreviation that does not meet the above conditions

Images