Site content pickup-preventing method

Abstract

The invention provides a site content pickup-preventing method. The site content pickup-preventing method comprises the following steps: firstly, establishing a pickup-judging rule; secondly, acquiring client-side information by a WEB server side, and transferring the acquired client-side information to a pickup-preventing system server; thirdly, verifying the client-side information transferred by the WEB server side by the pickup-preventing system server; fourthly, returning a verifying identification result to the WEB server side; and finally, determining whether to execute data query on a request page or output a prompt of access rejection by the WEB server side. By the site content pickup-preventing method, through strict establishment of a verification process, pickup of site data is effectively prevented by verifying the request of a client side; and besides the verification process, a periodical automatic updating mechanism is established, data in both a blacklist table and a client state table is ensured to be updated in real time and the operation of the whole process is more effectively and stably ensured.

Description

technical field [0001] The invention relates to a method for preventing website content from grabbing. Background technique [0002] "Crawling" mentioned in this article refers to a way for programs to obtain data from other websites in accordance with specified rules. [0003] In the early years, a search engine system appeared on the Internet, a platform formed by crawling website content to achieve massive data. This technology obtains the website address through various channels, and crawls the content of the webpage according to the URL. The obtained content is analyzed and finally the corresponding data information is obtained; at the same time, there are also other non-search engine platforms for data capture. Competitors or other related companies can bring business value to them by capturing specific information content. [0004] The other kind of crawling is malicious. Competitors exist regardless of corporate websites or personal websites. In order to paralyze co...

AI Technical Summary

Problems solved by technology

[0005] According to the above mentioned search engine capture, business value capture, or malicious attack capture, there are two main problems: one is that large-scale data theft will bring certain business impacts to website operations, and there may be some Exposure of private data will have a negative impact on individuals or companies; second, whether it is normal crawling or malicious attack crawling, it will indirectly or directly affect the performance of the website server, thereby reducing the stability of the website, especially malicious ones. Attacks and crawling directly damage the interests of websites and enterprises

For the crawled websites, especially those with original content, these operations occupy a large amount of network resources of the crawled websites and reduce the speed and efficiency of the network; on the other hand, they also infringe Intellectual property rights of the crawled website, thus harming the interests of the crawled website

Images