Chinese language processing model and method based on deep neural network

Abstract

The invention discloses a Chinese language processing model and method based on a deep neural network, and the model comprises three parts of a semantic coding network, a part-of-speech analysis network, and a semantic decoding network, wherein the semantic coding network and the part-of-speech analysis network are connected through an attention network and the semantic decoding network. The semantic coding network and the part-of-speech analysis network firstly process the word vectors generated by a source text, the semantic coding network outputs a semantic information vector of the sourcetext, and the part-of-speech analysis network outputs a part-of-speech information vector of the source text and connects the semantic information vectors and the part-of-speech information vectors ina concat () mode to serve as the input of the attention network, the attention network generates the background vectors containing all information of the source text according to the input information to serve as the input of the semantic decoding network, and the semantic decoding network calculates according to the background vector to obtain the probability distribution of all candidate words,and outputs each element of the target text one by one according to the probability distribution, so that the text mapping accuracy and the system performance are improved.

Description

technical field [0001] The invention relates to a Chinese language processing model and method based on a deep neural network, and belongs to the technical field of natural language intelligent processing. Background technique [0002] At present, the research of natural language processing is a model that can perform language representation and language application, establish a computing framework to realize such a language model, and propose various methods to improve this model, design various practical systems based on this model, and explore these practical systems. System evaluation techniques. [0003] The ultimate goal of natural language processing is to allow machines to understand and generate natural language, specifically, to study a cognitive machine that humans can communicate with in their own language. However, Chinese natural language processing studies the representation and application of Chinese language. In the field of natural language processing usin...

AI Technical Summary

Problems solved by technology

However, Chinese natural language processing studies the representation and application of Chinese language. In the field of natural language processing using neural networks, there are often strict requirements on the length of input sequences and output sequences, which is not consistent with Chinese language processing in practical applications. conform to

Images