An intelligent detection method for bad web pages based on deep belief network algorithm

Abstract

The invention discloses a bad web page intelligent detection method based on a deep belief network algorithm, comprising the following steps: constructing a hierarchical structure model of discriminant indicators: in order to enrich the types of web page features and identify bad web pages more accurately, the content of the web page, Links, quality and hidden features and established the corresponding bad web page identification index system; bad web page identification index sample set; index set balance processing based on SMOTE algorithm; extracted content, links, quality and hidden features of web pages and established corresponding To reduce the bad webpage discrimination index system, the SMOTE technology is used to balance the sample data set first, so that the classification effect of the classifier is not affected by the majority of samples in the sample data set. It is proposed to use DBN As a classifier, the processed samples are used as the input of the classifier to obtain the detection results, which verifies the efficiency of the classifier.

Description

technical field [0001] The invention relates to an intelligent detection method for bad webpages, in particular to an intelligent detection method for bad webpages based on a deep belief network algorithm. Background technique [0002] With the development of science and technology, the Internet is also showing a trend of rapid development, and search engines, as one of the important applications for users to use the Internet, have become an indispensable and important component for users to query information. According to a report released by the China Internet Network Information Center, in June 2017, the number of Internet users in China had increased to 751 million. As an essential part of the Internet, search engines are one of the most widely used Internet applications, and have gradually become an important channel for users to obtain and access Internet resources. [0003] The user can send a query request through the browser. According to the user's request, the se...

AI Technical Summary

Problems solved by technology

[0004] Bad webpages greatly reduce the user experience of search engines, thereby reducing the trust of search engines, and also bring a series of threats to the security of the entire Internet, for example: some websites that carry viruses, when users open the corresponding Viruses or important personal information will be stolen after the webpage

Images