Intelligent anti-crawler system and method for multi-layer threat interception

Abstract

The invention provides an intelligent anti-crawler system and method for multi-layer threat interception, and the system comprises an information collection module, a risk discrimination module, and arisk processing module, and the information collection module collects the browser operation environment information and click track information of a user; the risk discrimination module is used forcomprehensively judging the browser environment, the network information, the IP information and the user behavior of the user according to the information acquired by the information acquisition module, and judging whether the access user is a malicious user, a high-risk user or a normal user; and the risk processing module is used for intercepting malicious users and pushing verification codes to high-risk users according to the judgment result of the risk judgment module. The method has the beneficial effects that the multi-dimensional detection capability is provided, and the real-time performance and the accuracy are greatly improved; intelligent interception is adopted, and the error sealing rate is remarkably reduced.

Description

technical field [0001] The invention relates to the technical field of Internet security, in particular to an intelligent anti-crawler system and method for multi-layer threat interception. Background technique [0002] Crawlers originated from search engines. They are a program that automatically grabs information from the Internet according to certain rules. They are also called web spiders and network robots. Nowadays, data resources are becoming more and more precious. Data has become the only choice for many companies to make up for their inherent data shortcomings and improve their valuation. Crawlers can be divided into web crawlers and interface crawlers according to their functions, and can be divided into legal crawlers and malicious crawlers according to their authorization status. In order to prevent data leakage, anti-crawler technology came into being. [0003] At present, anti-crawler solutions mostly focus on the interception of User-Agent and IP, relying o...

AI Technical Summary

Problems solved by technology

Moreover, the current cost of IP is very low, which has caused a large number of websites to suffer from crawlers, and some websites do not even have basic anti-crawler solutions

[0004] In general, the current anti-crawler confrontation method is too simple and difficult to maintain, resulting in the need to continuously update the IP list, which is difficult to maintain, has a high rate of false seals, and has few discriminant factors and is not flexible enough

Images