Weak supervision-oriented text classification system, method and device

Abstract

The invention discloses a weak supervision-oriented text classification system, method and device. The weak supervision-oriented text classification system comprises the following modules: an acquisition module for acquiring to-be-labeled text data uploaded by a user and a provided category label set from a database; the text classification module is used for determining a pre-trained natural language model according to the to-be-labeled text data uploaded by the user in the acquisition module, classifying the to-be-labeled text data by using the determined model and outputting a labeling result; the text labeling module is used for generating a labeling result corresponding to the to-be-labeled text data according to the labeling result output by the text classification module, so that labeling of the to-be-labeled text data is completed. In other words, the user only needs to provide the to-be-labeled text data and the category label set, the labeling result with high accuracy can be achieved, and the text data labeling cost is greatly reduced.

Description

technical field [0001] The invention relates to the fields of natural language processing and text classification, in particular to a weakly supervised text classification system, method and device. Background technique [0002] Text is the largest carrier for human beings to transmit information. Information is generated all the time and widely exists in every corner. The demand for efficiently mining the information you need from massive amounts of information has increased dramatically. Text classification can automatically identify the input information category from a given set of category labels, which provides a solid technical foundation for solving the above needs. The traditional method for realizing text classification is a fully supervised method, which needs to obtain a large amount of labeled data for deep learning model training, so as to obtain a text classification model with good generalization performance. However, the labeling process usually costs a lot...

AI Technical Summary

Problems solved by technology

However, the labeling process usually costs a lot of manpower, financial resources and time

Images