Unlock instant, AI-driven research and patent intelligence for your innovation.

A kind of anti-crawler method, server and client

A server and client technology, applied in the field of information security, can solve problems such as website information leakage, achieve the effect of improving security performance and avoiding leakage

Active Publication Date: 2020-07-03
QILIN HESHENG NETWORK TECH INC
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides an anti-crawler method, server and client to solve the problem of website information leakage caused by existing crawler crawling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A kind of anti-crawler method, server and client
  • A kind of anti-crawler method, server and client
  • A kind of anti-crawler method, server and client

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] figure 1 It is a schematic flowchart of an anti-crawler method provided in the embodiment of this application. The method is applied to a server, and the method can be as follows.

[0061] Step 102: Perform random processing on the original data according to preset random rules to obtain random data corresponding to the original data.

[0062] Step 104: Determine an out-of-order identifier corresponding to a preset out-of-order rule.

[0063] Wherein, the out-of-order identifier is used to convert the out-of-order data into the original data when the client performs web page display

[0064] In the embodiment of the present application, before the original data is processed out of order according to the preset out-of-order rules to obtain the out-of-order data corresponding to the original data, it also includes:

[0065] Randomly generate preset out-of-order rules according to the original data;

[0066] A preset out-of-sequence rule is randomly generated for a certa...

Embodiment 2

[0090] On the client side opposite to the server, in order to allow normal access to the webpage, when rendering the webpage source code obtained from the server, it is necessary to convert the out-of-order data contained in the webpage source code into the original data in order to obtain the target webpage for the user Browse normally.

[0091] figure 2 It is a schematic flowchart of another anti-crawler method provided in the embodiment of this application. The method is applied to the client, and the method can be as follows.

[0092] Step 201: Send a web page access request for accessing a target web page to a server.

[0093] Step 202: Receive the web page source code corresponding to the target web page returned by the server.

[0094] When the client wants to access the target webpage, it can send a webpage access request for accessing the target webpage to the server according to the link address of the target webpage. After receiving the webpage access request, ...

Embodiment 3

[0110] image 3 It is a schematic structural diagram of an electronic device provided in an embodiment of the present application. Such as image 3As shown, at the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. Wherein, the memory may include a memory, such as a high-speed random-access memory (Random-Access Memory, RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. Of course, the electronic device may also include hardware required by other services.

[0111] The processor, the network interface and the memory can be connected to each other through an internal bus, which can be an ISA (Industry Standard Architecture, industry standard architecture) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnection standard) bus or an EISA (Extended Industry StandardArchitecture, extended industry standard arch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an anti-crawling method, a server, and a client. The method comprises the following steps: in the server, performing out-of-order processing on the original data according to apreset out-of-order rule to obtain out-of-order data corresponding to the original data, and determining an out-of-order identifier corresponding to the preset out-of-order rule, wherein the out-of-order identifier is used for converting the out-of-order data into the original data when the client displays a webpage; generating a webpage source code corresponding to the out-of-order data according to the out-of-order data and the out-of-order identifier; and after a webpage access request sent by the client is received, returning the webpage source code to the client, so that the client displays the original data. Therefore, when the client is crawled by a crawler, the webpage source code obtained by the crawler is the out-of-order data, and the client displays the original data corresponding to the out-of-order data to the user, so that the leakage of the original data can be avoided, the normal browsing of the user is not affected, and the security performance of the website is effectively improved.

Description

technical field [0001] The present application relates to the technical field of information security, in particular to an anti-crawler method, server and client. Background technique [0002] A web crawler (referred to as a crawler) is a program that searches for a web page through the link address of the web page, and automatically obtains the content of the web page according to certain rules. [0003] The current crawler technology is very common. Through the set rules, the crawler can easily grab some important information in the source code of the webpage, such as commodity prices, merchant phone numbers, commodity ratings or key parameters of commodities, etc., causing website information leakage and reducing Website Security Features. Contents of the invention [0004] The embodiment of the present application provides an anti-crawler method, server and client to solve the problem of website information leakage caused by crawler crawling. [0005] An embodiment o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/1441H04L67/02
Inventor 苏思洋李涛
Owner QILIN HESHENG NETWORK TECH INC