A bad webpage intelligent detection method based on a deep belief network algorithm

Abstract

The invention discloses a bad webpage intelligent detection method based on a deep belief network algorithm. The method include the following steps: Constructing a hierarchical structure model of thediscrimination indexes: in order to enrich the types of webpage characteristics and more accurately identify bad webpages, extracting content, links, quality and hidden characteristics of the webpages, and establishing a corresponding bad webpage discrimination index system; setting the judgement index sample set of the bad webpage; Carrying out index set balancing processing based on an SMOTE algorithm. content of web page, links, quality and hidden features are extracted, and a corresponding bad webpage discrimination index system is established; the bad webpage discrimination index is reduced; A sample data set is subjected to balance processing operation by adopting the SMOTE technology, so that the classification effect of the classifier is not influenced by a plurality of types of samples in the sample data set, the DBN is used as the classifier, the processed samples are used as the input of the classifier to obtain the detection result, and the high efficiency of the classifieris verified.

Description

technical field [0001] The invention relates to an intelligent detection method for bad webpages, in particular to an intelligent detection method for bad webpages based on a deep belief network algorithm. Background technique [0002] With the development of science and technology, the Internet is also showing a trend of rapid development, and search engines, as one of the important applications for users to use the Internet, have become an indispensable and important component for users to query information. According to a report released by the China Internet Network Information Center, in June 2017, the number of Internet users in China had increased to 751 million. As an essential part of the Internet, search engines are one of the most widely used Internet applications, and have gradually become an important channel for users to obtain and access Internet resources. [0003] The user can send a query request through the browser. According to the user's request, the se...

AI Technical Summary

Problems solved by technology

[0004] Bad webpages greatly reduce the user experience of search engines, thereby reducing the trust of search engines, and also bring a series of threats to the security of the entire Internet, for example: some websites that carry viruses, when users open the corresponding Viruses or important personal information will be stolen after the webpage

Images