Method and system for constructing text label system, method and system for completing iteration and storage medium

Abstract

The invention belongs to the field of natural language processing, and relates to a method and a system for establishing a text label system and completing iteration, and a storage medium. The methodcomprises the following steps that firstly, a label system is preliminarily built, class labels are concluded, at least one feature word used for describing labels is configured for each label, and aprimary label system and a configuration word bank of the primary label system are formed; the label system is verified and coverage conditions of the current label system and the configuration lexicon thereof are evaluated; the label system is improved and text clustering and information extraction are carried out on the text data which is not covered by the configuration word bank of the currentlabel system again to obtain a new batch of feature words and description words; and the current label system is compared with the configuration word bank thereof based on the text similarity to merge the feature words with high similarity, and class labels are named for newly discovered description words to obtain a latest label system. According to the invention, automatic extraction and integration of labels are realized, the constructed system can be self-perfected and optimized, and manual intervention is reduced.

Description

technical field [0001] The invention belongs to the field of natural language processing, and specifically relates to a method, system and storage medium for building a text label system and improving iteratively. Background technique [0002] Under the wave of big data, the data information that people come into contact with every day is increasing exponentially. As a high-level description of a certain information subject, tags can liberate people from a large amount of redundant information. The huge amount of data makes it too expensive and difficult to manually summarize labels, and subjective bias will also affect the accuracy of label recognition, especially in the field of natural language processing. Therefore, it is particularly important to use text mining technology to realize intelligent recognition of text labels. [0003] At present, most of the patent documents are the application of the existing labeling system in vertical search, index evaluation, marketi...

AI Technical Summary

Problems solved by technology

Regardless of pre-preparation or post-maintenance, this method requires the deep participation of business personnel, the labor cost is too high, and it does not have the function of self-iterative update

Images