Model training method and device and named entity recognition method and device

Abstract

The embodiment of the invention provides a model training method and device and a named entity recognition method and device. The model training method comprises steps of during model training, replacing a first named entity in the first sample sequence with a first preset character to obtain a second sample sequence, and determining a text fragment containing the first preset character from the second sample sequence; recursively determining implicit vectors of a plurality of segmented words in the second sample sequence by adopting a first recurrent neural network, and determining representation vectors of the text fragments; constructing Gaussian distribution based on the representation vector through a variational auto-encoder, and determining a global implicit vector for the text segment; adopting a first recurrent neural network, the global implicit vector serving as an initial implicit vector, determining a decoding implicit vector of the segmented words in the text segment in arecursive mode, and determining prediction values of the segmented words in the text segment; and determining a prediction loss value based on the difference and the distribution difference between the segmented words in the text fragment and the prediction value of the segmented words, and updating the first recurrent neural network and the variational auto-encoder in the direction of reducing the prediction loss value.

Description

technical field [0001] One or more embodiments of this specification relate to the technical field of natural language processing, and in particular to methods and devices for model training and named entity recognition. Background technique [0002] In the field of natural language processing technology, the classification of named entities (Entity) in text sequences is an important direction of research. Named entities have the nature of nouns in the part of speech, including person names, organization names, place names, and all other entity categories identified by names. Broader named entities also include categories such as numbers, dates, currencies, addresses, and more. Accurate recognition of the categories of named entities can improve the accuracy and effectiveness of natural language processing. [0003] Usually, a training set is used to train a model for recognizing named entities, and after the model is trained, a test set is used to test the model. A major...

AI Technical Summary

Problems solved by technology

This sparsity of training data brings great challenges to model training

Images