Anti-crawler data query method and device as well as client and server

Abstract

The invention provides an anti-crawler data query method and device as well as a client and a server, relating to the field of internet communication technology. The anti-crawler data query method is applied to the client, and comprises the following steps: communicating with the server to obtain the service time of the server; issuing an encryption string and a timestamp when accessing a server interface each time, and simultaneously marking an operation system and a unique equipment identifier of the client for the server to perform verification, wherein the encryption string is a key, a formatted timestamp and application keywords that are encrypted by using MD5; setting a unique key value of the client to a web page control for an HTML5 end to verify the web page control; and supplying the encryption string and the timestamp to the HTML5 end to ensure that the HTML5 end carries the encryption string and the timestamp to request services from the server to further achieve data query. Thereby, non-login users can query data freely, the phenomenon that a large amount of data is crawled by abnormal users can also be prevented, the pressure of operation and maintenance layers can be reduced, and junk data of interface layers can be reduced.

Description

technical field [0001] The invention relates to the technical field of Internet communication, in particular, to an anti-crawler data query method and device, as well as a client and a server. Background technique [0002] Many companies or enterprises use crawlers to collect data, that is, analyze the interfaces exposed in websites or apps, simulate interface parameters, access the interfaces, and crawl data. Then the company that owns the data source will set the operation and maintenance visits, or seal the account to prevent its own data from being captured. At present, the common anti-climbing solution can only solve the problem of users who must log in. When it is found that the interface is frequently called by a fixed account, it will be processed manually. In addition, according to the timeliness, the processing is not very good. Many mobile phones can change the time of their own mobile phones. In many cases, it may cause unnecessary anti-climbing and accidental i...

AI Technical Summary

Problems solved by technology

Since the total number of visits is fixed, if the number of real active users suddenly increases on a certain day, or the number of visits suddenly increases during activities on a certain day, normal users will be accidentally injured.

Images