Quick text classification method for corpus

A technology of text classification and classification method, applied in the field of fast text classification of corpus, can solve the problems of inconvenient corpus in-depth analysis and research, cannot improve the efficiency and accuracy of corpus classification, and achieve the effect of improving classification speed and classification accuracy.

CN112328790APending Publication Date: 2021-02-05BOHAI UNIV
6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2021-02-05

Smart Images

  • Figure 1
    Figure 1
Patent Text Reader

Abstract

The invention discloses a quick text classification method for a corpus. The method comprises the following steps: selecting an existing corpus needing to be used; extracting information data in the corpus, and preprocessing the information data; inputting a preprocessing result into the vector space model; carrying out feature word processing; selecting a classifier for the feature words; evaluating the effect of the classifier; and utilizing a classifier to classify the corpus. According to the quick text classification method for the corpus, corpora in the corpus can be quickly and accurately classified, so that the corpus classification efficiency and accuracy can be improved, and researchers and scholars can conveniently and deeply analyze and research the corpora.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of corpus text classification, in particular to a fast text classification method for corpus. Background technique

[0002] Corpus refers to a large-scale electronic text library that has been scientifically sampled and processed. Its role is to enable researchers to carry out relevant language theory and application research by using computer analysis tools. Since corpora are the basic resources that carry language knowledge, corpus It is one of the main data bases for researchers and scholars to carry out linguistic research, and the corpus stores the language materials that have actually appeared in actual use. Therefore, the corpus is also one of the important theoretical sources of linguistic research methods. It is mainly used in With the continuous development of the times and the continuous improvement of computer technology in dictionary compilation, language teaching, traditional language research ...

Examples

Embodiment Construction

[0024] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments.

[0025] Such as figure 1 As shown, the fast text classification method of the corpus, the classification method includes the following steps:

[0026] (1) Select the existing corpus that needs to be used;

[0027] (2) Extract information data in the corpus, and preprocess the information data;

[0028] (3) Input the preprocessing result into the vector space model;

[0029] (4) carry out feature word processing;

[0030] (5) Select a classifier for the feature words;

[0031] (6) Evaluate the effect of the classifier;

[0032] (7) Use a classifier to classify the corpus.

[0033] The existing corpus in step (1) specifically refers to the Chinese corpus, and its corpus type is specifically a monolingual type.

[0034] The information data in ...