Method of Tibetan language webpage text classification based on semanteme

Abstract

The invention relates to a method of Tibetan language webpage text classification based on semanteme. The method of the Tibetan language webpage text classification based on the semanteme comprises the following steps: firstly, extracting text messages which are used for charactering a webpage from the Tibetan language webpage, then carrying out word classification processing on the text messages, and expressing words obtained by means of the word classification processing as a word vector space, secondly, mapping the words expressed through the word vector space to a concept of a semanteme space according to a preset Tibetan language classification body to obtain a semanteme space of a text to be classified, and at last adopting a classification algorithm to classify the semanteme space of the text to be classified according to a preset semanteme space of a training sample set. The method of the Tibetan language webpage text classification based on the semanteme carries out preprocessing on the webpage and adopting a KNN classification algorithm of the text similarity of a weighting semantic net to achieve real-time and high-efficiency classification of the Tibetan language webpage.

Description

technical field [0001] The invention relates to data preprocessing technology, in particular to a semantic-based Tibetan web page text classification method. Background technique [0002] With the rapid development of informatization and economicization in Tibetan areas, the scale of Tibetan netizens and webpages is growing at an alarming rate. The Internet has become a carrier for Tibetan information transmission and sharing, and a place for Tibetan people to express their opinions. Inappropriate remarks may trigger public opinion, and negative information will pose a greater threat to social and public safety. Tibetan webpage text classification technology is the premise and basis for the realization of Tibetan network public opinion monitoring technology, and has important research value. [0003] Semantic text classification based on the Tibetan web is a key technology for processing and organizing a large amount of web text data. It can automatically determine the text...

AI Technical Summary

Problems solved by technology

However, the lack of resources in the Tibetan ontology knowledge base restricts the application research based on the semantic level of Tibetan

Moreover, in the traditional Web text classification method, Tibetan words are considered to be independent, ignoring semantic problems such as synonyms and hyponym relations between words, and a lot of important information is lost, resulting in inaccurate classification results and a large amount of calculation.

Images