Chinese named entity recognition model and creation method and application thereof

Abstract

The invention provides a Chinese named entity recognition model, a creation method thereof and a method applied to the field of network space security. The application of the Chinese named entity recognition model is based on transfer learning and a deep neural network, and comprises the following steps: firstly, training a Bert-BiLSTM-CRF model on four general data sets recognized in the field ofChinese named entity recognition, and fully learning general knowledge features; performing model migration, training the TBBC (Trans-Bert-BiLSTM-CRF) model subjected to transfer learning on a self-labeled network space security domain data set, and obtaining a trained TBBC model; learning to obtain features of the domain knowledge, outputting the model, finally obtaining a TBBC model with a practical application value, and performing Chinese named entity identification. Tests show that the accuracy, recall rate and F1 value of the obtained TBBC model are obviously improved; the Chinese namedentity recognition performance is greatly improved, and the practical problems of insufficient training data and low recognition performance when named entity recognition tasks are carried out in a specific field can be effectively relieved.

Description

technical field [0001] The present invention relates to the field of natural language processing, in particular to a Chinese named entity recognition model based on transfer learning and deep neural network model and its construction method and application. Background technique [0002] Named entity recognition has always been an important research task in the fields of information extraction and natural language processing. The main task is to extract words or phrases that can reflect specific or abstract entities that exist in the real world from unstructured text, such as Names of people, places, and organizations, etc., the current mainstream identification target entities are "three major categories (entity, time, and numbers), seven small categories (personal names, place names, organization names, institution names, time, date, currency) and percentage). Named entity recognition technology has been developed so far and has been widely used in many fields such as infor...

AI Technical Summary

Problems solved by technology

[0009] In view of the lack of Chinese named entity recognition data and poor recognition performance in the field of cyberspace security, the present invention proposes a Chinese named entity recognition model based on transfer learning and deep neural network and its construction method, and its application to the network A Method for Chinese Named Entity Recognition in the Field of Space Security

Images