System for automatic classification analysis for website based on website content

Abstract

The invention discloses a system for automatic classification analysis for websites based on website contents. The system comprises a capture module, a website text content analysis module, a word segmentation module, a feature training extracting module and a website classification module. The feature training extracting module selects a plurality of features words with maximum weights by calculating importance degree, distinction degree and feature keyword weight of every candidate feature word and sorting the candidate feature words according to the feature keyword weights, wherein the feature keyword weights are used as weightings after the normalization of the selected feature words and a website classification vector template is created according to the given sets of the selected feature words and the feature keyword weights. The website classification module is used for generating a feature spatial vector according to the given set of the selected feature words and the weightings which are obtained by the feature training extracting module and identifying the classification of a website by calculating the similarity between the feature spatial vector and the feature spatial vector of the website. The system is capable of effectively solving the problem of network information in a mess and allowing users to searching information for positioning conveniently and accurately.

Description

technical field [0001] The invention belongs to the field of data mining and machine learning, and relates to a system for automatically classifying and analyzing websites based on website content. Background technique [0002] Since the 1990s, the Internet has developed at an astonishing speed, and it has accommodated a large amount of various types of original information, including web pages, texts, images, multimedia, etc. How to grasp effective information in the vast amount of information is always It is one of the main goals of information processing. Website classification can effectively improve the accuracy rate of Web information. The classification search engines represented by Yahoo, Sohu, etc. use manual classification methods, which are difficult to implement due to their low efficiency, slow update speed, and high maintenance costs. Effectively track and manage a large number of dynamically changing websites on the Internet. Contents of the invention [0...

AI Technical Summary

Problems solved by technology

Website classification can effectively improve the accuracy rate of Web information. The classification search engines represented by Yahoo, Sohu, etc. use manual classification methods, which are difficult to implement due to their low efficiency, slow update speed, and high maintenance costs. Effectively track and manage a large number of dynamically changing websites on the Internet

Images