Intelligent website content capture-preventing method and system based on content delivery network

Abstract

The invention discloses an intelligent website content capture-preventing method and system based on a content delivery network, which can reduce the problem that a normal client end cannot visit a website due to misjudgment and can automatically cancel a visiting-prohibiting state. According to the technical scheme. The intelligent website content capture-preventing method comprises the steps of: receiving a client request and monitoring a visiting behavior of the client end by a content delivery network system; judging whether a visiting frequency of the client end exceeds a preset threshold or not, if not, directly returning the requested content; otherwise, continuously judging whether the current requesting time of the client end is more than the sum of the time how much the visiting frequency is exceeded last time and the preset grab-preventing state duration or not; if so, returning the requested content; and if not, returning to a client end verification code page; judging whether the client end submits a correct verification code or not, if so, returning the requested content, and if not, judging whether the times the client end submits illegal verification codes exceed a set value or not, if not, returning to the client end verification code page, otherwise, indicating that the client end is a grab machine, prohibiting visiting of the client end, and returning 403 response.

Description

technical field [0001] The present invention relates to Internet data security technology, in particular to website security technology based on a content distribution network (CDN network), that is, a method and system for intelligent anti-grabbing of website content. Background technique [0002] The basic idea of ​​website content intelligent anti-crawling technology is that when a client initiates a content request to a website, the intelligent content anti-crawling module of the CDN system begins to monitor the client’s access behavior characteristics. When the client’s access behavior is abnormal, the CDN system will According to the judgment result given by the intelligent anti-grabbing module, it is judged whether the client belongs to a normal netizen or a crawling machine, and responds to the corresponding content. [0003] The current anti-grabbing implementation scheme for website content is as follows: figure 1 shown. After the origin station receives the clie...

AI Technical Summary

Problems solved by technology

[0005] 1. Judging based on the IP of the client, the granularity is too coarse. At present, many companies only export one IP or a few IPs to the outside world, which is prone to misjudgment, causing other clients to be unable to access the website;

[0006] 2. The judgment basis is not flexible enough and can only be judged according to its access frequency;

[0007] 3. The processing method is not intelligent enough. After it is judged as a machine, it cannot automatically lift the forbidden status

Images