Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for detecting reptile behavior

A detection method and a technology of a detection device, which are applied in the Internet field, can solve problems such as the number of session connections exceeding the threshold and false detection, and achieve the effects of improving accuracy and detection efficiency, and protecting network information content

Active Publication Date: 2019-04-19
BEIJING SHU AN XINYUN TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing method, when the IP address of the client normally accesses the IP address of the server, the number of session connections will also exceed the threshold, so the existing method is easy to cause false detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for detecting reptile behavior
  • Method and device for detecting reptile behavior

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.

[0044] figure 1 It is a flow chart of the crawler behavior detection method in the embodiment; the method includes:

[0045] Step 101, obtaining the user's log infor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a crawler behavior detection method and device. The method includes: acquiring user log information, extracting URLs of URLs accessed by the user from the log information, and determining information patterns of each URL; It is determined whether the user is a crawler or not according to the distribution of the information patterns of the URLs visited by the user within a period of time. The invention can effectively improve the crawler detection accuracy and detection efficiency, and protect network information content.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a crawler behavior detection method and device. Background technique [0002] The web crawler technology starts from the URL (Uniform Resource Locator, Uniform Resource Locator) of one or more web pages, obtains the URL on the initial web page, and grabs web page information. [0003] In the prior art, the method for detecting reptiles is mostly realized by setting a threshold value, that is, counting the number of session connections when the IP address of the client accesses the IP address of the server end at the same time, if the number of session connections during access exceeds the threshold value set, Then it is considered that the client corresponding to the IP address is crawling the webpage through the web crawler. [0004] In the existing method, when the IP address of the client normally accesses the IP address of the server, the number of session connections w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/951G06F16/955
Inventor 陈峰从磊
Owner BEIJING SHU AN XINYUN TECH CO LTD