Text processing model construction method and text processing method

Abstract

The invention relates to a text processing model construction method and a text processing method. The text processing model construction method comprises the steps of obtaining a text training sample, and performing word segmentation processing on the text training sample to obtain a plurality of target segmented words and a classification result of each target segmented word; calling a classification model to perform coding processing on the text training sample to obtain a text vector, and performing coding processing on the target segmented word to obtain a first word vector of the target segmented word; processing the first word vector through a threshold function cached in a classification model to obtain a second word vector; and training a classification model through the second word vector, the first word vector, the text vector and a classification result of the target word segmentation to obtain a text processing model. In this way, interaction between the text and the target segmented word is strengthened, threshold control is conducted on the text vector through the word vector, the feature dimension of the vector irrelevant to the word can be restrained, and therefore high-precision classification of the word in the text is supported.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a text processing model construction method, device, computer equipment and storage medium, and a text processing method, device, computer equipment and storage medium. Background technique [0002] With the development and application of computer technology, text analysis and processing technology has been widely used. In application scenarios such as title understanding and discourse sentence structure understanding, it is necessary to distinguish the weight of different words and determine the core words of the text. Taking video as an example, the video title is an important part of the video content. It is one of the core tasks of the entire video search system to complete text analysis and strengthen the understanding of video semantic information through the title text combined with natural language processing technology. [0003] The word weight task refers to...

AI Technical Summary

Problems solved by technology

The word weight task can be modeled through the classification model, but the traditional classification model has the problem of low classification accuracy

Images