Anti-crawler method based on access behaviors

An anti-crawler and behavioral technology, applied in the field of anti-crawler based on access behavior, can solve the problem that the anti-crawler method is difficult to distinguish malicious requests, and achieve the effect of reducing reusability, low cost, and improving security

Inactive Publication Date: 2018-02-16
SICHUAN CHANGHONG ELECTRIC CO LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the present invention is: provide an anti-crawler method based on acces

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Anti-crawler method based on access behaviors

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] In website development, the development model of MVC is generally followed, and the front end is responsible for the display of data. The displayed pages can be divided into static resources and dynamic resources. During deployment, static resources and dynamic resources are deployed separately. A normal complete request model includes both access to static resources and access to dynamic resources. Dynamic resources are the content that crawlers are interested in. Based on this, the following embodiments determine those that do not conform to the normal request model as malicious requests (crawlers).

[0017] Therefore, the embodiment provides an anti-crawler method based on access behavior, such as figure 1 shown, including steps:

[0018] A. In the website design stage, use the MVC model to separate and deploy static resources and dynamic resources;

[0019] B. Through manual analysis and / or log analysis and / or traffic analysis, obtain the ratio T of the number o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of information security, and discloses an anti-crawler method based on access behaviors in order to solve the problem that it is difficult for the existing anti-crawler method to distinguish malicious requests. The method includes the following steps: in the stage of website design, static resources and dynamic resources are separately deployed in an MVC mode; the quantity ratio T of static resources to dynamic resources of a normal request within a specified time is obtained through analysis; when a website receives an access request from a client, the website analyzes whether the number of resources to be accessed within the specified time for the access request is in accordance with the quantity ratio T; if the number of resources to be accessed withinthe specified time for the access request is not in accordance with the quantity ratio T, the access request is regarded as a malicious request, and the request of the client is banned for a period of time; and if the number of resources to be accessed within the specified time for the access request is in accordance with the quantity ratio T, the access request is regarded as a normal request and is handled the same way a normal request is handled. The anti-crawler method of the invention is suitable for website development.

Description

technical field [0001] The invention relates to the field of information security, in particular to an anti-crawler method based on access behavior. Background technique [0002] With the development of the Internet today, every website has some public data for normal users to browse, but they do not want to be obtained by malicious crawlers. For example, the prices of commodities in e-commerce data are for normal users to browse, and they do not want to be easily obtained by competitors . [0003] A web crawler (also known as a web spider, a web robot, and more often referred to as a web chaser in the FOAF community) is a program or script that automatically grabs information on the World Wide Web according to certain rules. [0004] In the field of anti-crawlers, the following methods are often used: Method 1, through statistics on the IP address of the requester, when the access frequency or number of visits reaches a certain threshold, the request of this IP is blocked....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/10H04L63/1408H04L63/1425H04L63/1441H04L67/02
Inventor 付强
Owner SICHUAN CHANGHONG ELECTRIC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap