Network anti-crawling configuration method and anti-crawling method

Abstract

The invention relates to a network anti-crawling configuration method and an anti-crawling method, and the method comprises the steps: randomly capturing a font file according to a business request of a request font css, generating corresponding css, and returning the css to a request end of the business request; judging whether a service interface of a request service belongs to a configuration item or not according to the request service of the service request, and if yes, confusing content needing to be confused based on a randomly captured font file and then returning the confused content to the request end; the configuration item is set based on information content needing anti-crawling and comprises a service interface for crawling the information content; the service request comprises the fingerprint ID of the request end. Compared with the prior art, the network anti-crawling method has the advantages that the interfaces do not need to be transformed, the service interfaces can be uniformly set, each service interface does not need to be independently developed, the time cost and the labor cost of development are saved, and the efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to a network anti-climbing configuration method and an anti-climbing method. Background technique [0002] Nearly half of the traffic on the Internet is created by crawlers. These crawlers are benign or malicious. Well-intentioned crawlers can increase website traffic, increase exposure, and have been discovered by more people, such as general search engines. Malicious crawlers can cause website information leakage, affect users' normal access, and even crash the system. [0003] In related technologies, the robots protocol is used to guide the reptiles in good faith, which ones can be crawled and which ones cannot. For malicious crawlers, there are mainly verification codes, human-computer interaction recognition, font anti-crawling and other means to prevent or reduce information leakage. [0004] The anti-climbing methods in related technologies either have high techn...

AI Technical Summary

Problems solved by technology

[0004] The anti-climbing methods in related technologies either have high technical access requirements, or have an impact on user experience, or require modification of existing interfaces, resulting in intrusive modification of existing stock systems, and require access to each service They are all developed separately, which affects the subsequent delivery rhythm of the project, and makes the corresponding system not pure enough, which violates the definition of microservices in the industry. The time cost and labor cost of development are high, and the efficiency is low.

Images