Text classification model construction method and text classification method and device

A text classification and classification model technology, which is applied in text database clustering/classification, unstructured text data retrieval, semantic analysis, etc., can solve problems such as poor generalization ability of classification, and improve generalization ability and classification effect Effect

Pending Publication Date: 2021-01-05
GOSUN GUARD SECURITY SERVICE TECH
View PDF8 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Therefore, the technical problem to be solved by the present invention is to overcome the defect in the prior art that the semantic features of the text are extracted according to the text classification model to classify the text and the generalization ability of the text is poor, thereby providing a text classification model construction method and a text classification method and device

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text classification model construction method and text classification method and device
  • Text classification model construction method and text classification method and device
  • Text classification model construction method and text classification method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0076] As an optional implementation of the embodiment of the present invention, the text classification model construction method also includes:

[0077] The pre-training text data acquisition module is used to acquire the pre-training text data. The fields and classification tasks of the pre-training text data are the same as those of the training text data; see the relevant descriptions of the corresponding steps in the embodiments for specific implementation methods, and will not repeat them here.

[0078] The training module is used to input the pre-trained text data into the machine learning model for training to obtain the reading comprehension model. For the specific implementation manner, refer to the relevant description of the corresponding steps in the embodiment, and details are not repeated here.

[0079] As an optional implementation manner of the embodiment of the present invention, the first input module 32 includes:

[0080] The word segmentation module is u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text classification model construction method and device and a text classification method and device, and the method comprises the steps: obtaining training text data and a plurality of pieces of preset label attribute information corresponding to a field to which the training text data belongs; inputting the training text data and a plurality of pieces of preset label attribute information into a reading understanding model to obtain text interaction representation between each piece of training text data and each piece of preset label attribute information; inputting each text interaction representation into the feature extraction model to obtain text key features; inputting the text key features into an initial classification model for classification and identification to obtain a probability value of each piece of training text data belonging to each piece of preset label attribute information, and obtaining a classification result according to the probability value; and training model parameters of the initial classification model according to a classification result until a loss function value of the initial classification model meets a target condition to obtain a target text classification model.

Description

technical field [0001] The present invention relates to the technical field of data processing and machine learning, in particular to a text classification model building method, a text classification method and a device. Background technique [0002] Text classification refers to the use of computers to automatically classify and mark text collections according to certain classification systems or standards. In related technologies, when classifying text, the semantic features of the text are usually extracted according to the text classification model, but this method requires a large number of training samples, and the text data corresponding to different text label categories is unbalanced, resulting in the generalization of the model Therefore, it is urgent to propose a text classification model construction method to reduce training samples and improve model generalization ability. Contents of the invention [0003] Therefore, the technical problem to be solved by t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/35G06F16/36G06F40/30
CPCG06F16/35G06F16/36G06F40/30
Inventor 肖刚
Owner GOSUN GUARD SECURITY SERVICE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap