Natural language processing-based multi-language analysis method and device

Abstract

The invention discloses a natural language processing-based multi-language analysis method and device. The method comprises the following steps of: selecting to input a natural language text information language category through a language detection training model; obtaining word embedding expression information of corresponding words which can be recognized by a computer through a trained word vector model, and extracting a keyword of the obtained word embedding expression information through a TF-IDF manner; calculating an article vector and a category vector of each preset category according to the keyword and a keyword weight, and calculating a similarity between an article of natural language text information and each preset category so as to determine a text classification result ofthe natural language text information; and inputting the word embedding expression information of the natural language text information into a trained convolutional neural network and a parallel-framework text emotion analysis model of a bidirectional gate circulation unit, and obtaining a final emotion tendency value through calculation. According to the method and device, the problem that traditional multi-language analysis method needs to know domain knowledges of related linguistics and needs plenty of manpower to carry out operation is solved.

Description

technical field [0001] This application relates to the technical fields of data mining, machine learning, artificial intelligence, and multilingual text analysis technology applications, and in particular to a multilingual analysis method and device based on natural language processing. Background technique [0002] With the vigorous development of Internet information, it is necessary to process various languages ​​in Internet information. Natural language processing (NLP) is the field of interaction between computers and human (natural) language that computer science, artificial intelligence, and linguistics focus on. It is an important direction in the field of computer science and artificial intelligence. The research scope of natural language processing covers various theories and methods that can realize effective communication between humans and computers in natural language. The fields involved include natural semantic understanding, retrieval, information extraction...

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a multilingual analysis method and device based on natural language processing to solve the problem that the traditional multilingual analysis method needs to understand the domain knowledge of related linguistics, and requires a lot of manual operations, and has a single field and is difficult to analyze multilingual Technical issues of rapid adaptation to the scene

Images