Webpage text classification method and device and webpage text identification method and device

Abstract

The embodiment of the invention provides a webpage text classification method and device and a webpage text identification method and device. The webpage text classification method comprises the steps of collecting text data in a webpage; carrying out word segmentation on the text data and obtaining basic segmentation words; calculating first attribute values and second attribute values of the basic segmentation words; calculating feature values of the basic segmentation words according to the first attribute values and second attribute values; screening feature segmentation words from the basic segmentation words according to the feature values; calculating weights corresponding to the feature segmentation words; and taking the weights as the feature vectors of the corresponding feature segmentation words and training a classification model through adoption of the feature vectors. According to the embodiment of the invention, the feature extraction objectivity and accuracy are effectively ensured; the influences of features on the classification are taken into consideration; the webpage text classification accuracy is improved; and a user can obtain valid information timely and accurately from massive texts.

Description

technical field [0001] The present application relates to the technical field of text classification, and in particular to a method for classifying web page text, a device for classifying web page text, a method for recognizing web page text, and a device for recognizing web page text. Background technique [0002] In today's information society, various forms of information have greatly enriched people's lives, especially with the large-scale popularization of the Internet, the amount of information on the network is growing rapidly, such as various electronic documents, emails and web pages Flooded on the network, resulting in information clutter. In order to quickly, accurately and comprehensively find the information we need, text classification has become an important way to effectively organize and manage text data, and has attracted more and more attention. [0003] Webpage text classification refers to determining the category of the corresponding webpage according ...

AI Technical Summary

Problems solved by technology

[0004] Due to the polymeaning, ambiguity, heterogeneity and other characteristics of massive texts, the selection of classification features in the existing technology is unsatisfactory. For example, the role of some invalid words is often exaggerated, or some The important attributes of some feature word segmentation, resulting in extremely low accuracy of web page text classification

Images