Evaluating method and evaluating system targeting Chinese name identifying system

Abstract

The invention relates to an evaluating method and an evaluating system targeting a Chinese name identifying system in the natural language processing field. The evaluating method comprises the following steps of: evaluating file generating: extracting an appointed number of sentences from a sentence bank and replacing names in the sentences with the names in a name bank to generate an evaluating file; data recording: recording the line numbers of the sentences in the evaluating file, all the names in the sentences and the initial positions of the names in the sentences; identifying: carrying out name identification on the evaluating file by the Chinese name identifying system to be evaluated; judging: comparing identified results with the recorded data according to a preset judging standard and judging whether the name identifying system correctly identifies the names or not; and evaluating index calculating: forming evaluating indexes for evaluating the Chinese name identifying system according to the judging results of the judging step. The invention realizes the evaluating automation of the Chinese name identifying system, enables different identifying systems to have comparability, and discovers problems existing in an identifying algorithm.

Description

Technical field: [0001] The invention relates to an evaluation method for a Chinese name recognition system, which belongs to the field of natural language processing. Background technique: [0002] With the development of information technology, especially the rapid development of the Internet in recent years, a large number of new information has emerged, and the data on the Web is growing at a rate of several million pages per day. At present, the Web has become one of the main means for humans to obtain information. In the face of massive, large-scale, unstructured language text information, how to quickly and effectively obtain the required information and knowledge has become the focus of natural language processing research. Named entity recognition, especially Chinese person name recognition, plays an important role in information retrieval, information extraction, machine translation, and text classification. It can significantly improve the performance of information r...

AI Technical Summary

Problems solved by technology

[0005] (1) It is time-consuming, laborious and inevitable to make manual statistics every time

[0006] (2) The number of sentences and fixed names are not representative, and the statistical results are not sufficient to objectively reflect the accuracy and recall of the recognition system

[0007] (3) The number of evaluations is too small, which cannot reflect the stability of the system well

Images