Text classification method, computing device and computer storage medium

Abstract

The invention discloses a text classification method, computing equipment and a computer storage medium, and the method comprises the steps: carrying out the training of an unsupervised corpus, extracting the semantic features of all characters in the unsupervised corpus and the semantic features of all common words, and obtaining a corpus feature set; performing word segmentation processing on the labeled sample corpus to obtain a word segmentation processing result, and determining common words and non-common words contained in the word segmentation processing result; carrying out segmentation processing on the non-common words to obtain each character contained in the non-common words; semantic features corresponding to common words contained in the word segmentation processing result and semantic features corresponding to all characters contained in non-common words are obtained from the corpus feature set; training to obtain a violation classification model according to the obtained semantic features and the annotation information of the annotated sample corpus; and based on the violation classification model, performing classification processing on the to-be-classified text.According to the method, semantic-level content classification can be realized, and the text classification accuracy is improved.

Description

technical field [0001] The invention relates to the technical field of text classification, in particular to a text classification method, computing equipment and computer storage media. Background technique [0002] Books, articles and other creative content need to be reviewed before they are released online to filter out sensitive content such as pornography, terrorism, and politics. In the prior art, it is usually to build a sensitive word library, and search for sensitive words in the text to be reviewed by string matching, so as to filter out sensitive content, which can liberate manpower. [0003] However, the inventor found that the prior art has at least the following deficiencies in the process of realizing the present invention: on the one hand, with the development of language habits, the sensitive lexicon will continue to expand, which increases the maintenance difficulty and cost of the sensitive lexicon, and will cause Text review is taking longer and longer;...

AI Technical Summary

Problems solved by technology

[0003] However, the inventor found that the prior art has at least the following deficiencies in the process of realizing the present invention: on the one hand, with the development of language habits, the sensitive lexicon will continue to expand, which increases the maintenance difficulty and cost of the sensitive lexicon, and will cause Text review is taking longer and longer; on the other hand, in order to avoid content review, content creators will use allusion, borrowing, etc. to transfer sensitive information. This kind of vocabulary is normal on the surface, but it involves sensitive information on the semantic level. , which cannot be discovered by string matching alone

Images