Text event classification method based on CHI feature selection

Abstract

The present invention discloses a text event classification method based on CHI feature selection, which comprises the classification model training process aiming at training corpora and the text classifying process. According to the method, classification of text event information is finally implemented by analyzing language description features in a Chinese text event, using a CHI value as a topic feature vector and aiming at the selected training corpora to form feature files and a training template, wherein the model training process comprises the following steps of: (1) selecting the text training corpora; (2) preprocessing the text corpora; (3) selecting category features and generating a feature file set; (4) generating a text feature vector, carrying out normalization processing and generating a feature vector file; and (5) carrying out SVM model training. The text classifying process is similar with the model training process. The method adopted by the present invention can be widely applied to the identifying, classifying, analyzing and monitoring process of Chinese text data mining and analysis efficiency and analysis accuracy of Chinese text natural language processing can be effectively promoted.

Description

technical field [0001] The invention belongs to the field of data mining of geographic information, and specifically discloses a text event classification method based on CHI feature selection. Background technique [0002] With the explosive growth of Internet resources, classification technology has become a field of concern and a research hotspot. According to relevant survey reports of global technology research and consulting companies, at least 95% of human-computer interaction information in the next 10 years will be text language, in which events are the basic unit of people's cognition and understanding of the world, including the time and space of human description of event information. The attribute element information and the semantic relationship between each element of the event. [0003] However, the effective use of event information and knowledge discovery in text has become an urgent problem in the field of text data mining. Text classification can not on...

AI Technical Summary

Problems solved by technology

At present, methods such as classification system, pattern matching and machine learning are mostly applied to text classification, but there is a lack of a complete classification method for events in text

Images