Management method, device and system of website access request

A website access and management method technology, applied in the field of website access request management, can solve the problems of reducing access frequency, incompleteness, and inability to effectively manage website access requests, and achieve the effect of ensuring safety

Inactive Publication Date: 2016-03-23
TCL CORPORATION
View PDF4 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above-mentioned anti-crawler measures are not perfect. Web crawler designers can often avoid existing anti-crawler measures by adopting some targeted strategies, such as: using proxy technology to simulate browser visits to reduce visit freq

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Management method, device and system of website access request
  • Management method, device and system of website access request
  • Management method, device and system of website access request

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0027] see figure 1 , figure 1 It is a schematic flowchart of a method for managing website access requests provided by the first embodiment of the present invention, and the method can be applied to a Web (web page) server to realize management of website access requests from terminal devices. The terminal device may be a mobile terminal d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a management method, device and system of a website access request. The method comprises the following steps: intercepting a website access request initiated from terminal equipment; if the website access request is not initiated through a browser, identifying the website access request as a website crawler request, and refusing the website access request; if the website access request is initiated through the browser, analyzing and judging whether the website access request is a suspect network crawler request according to the relevant access parameters of all website access requests initiated from the terminal equipment in a preset duration or not; if the website access request is the suspect network crawler request, generating a two-dimensional code used for identity verification, and returning the two-dimensional code to the terminal equipment; and if the terminal equipment passes the identity verification, releasing the website access request, identifying the website access request as the website crawler request if the terminal equipment does not pass the identity verification, and refusing the website access request. The management method, device and system can effectively prevent network crawlers from crawling website data through ways that the network crawler pretends to be a browser and utilizes the IP (Internet Protocol) address agent or IP address rotation.

Description

technical field [0001] The invention belongs to the technical field of computers and networks, and in particular relates to a method and device for managing website access requests. Background technique [0002] A web crawler is a program or script that automatically grabs information on the World Wide Web according to certain rules. With the development of search engine technology, web crawlers have become a very popular web search technology. Except for Google, Yahoo, Microsoft, and Baidu, which specialize in search, almost every large portal website has its own search engine. A variety of crawler systems used by unknown companies to crawl website data. For a content-driven website, it is inevitable to be patronized by web crawlers. [0003] Some intelligent search engine crawlers crawl website data at a reasonable frequency and consume less website resources. But many bad web crawlers often send hundreds or even thousands of requests to repeatedly crawl website data. T...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F21/41H04L29/06
CPCG06F16/958G06F21/41H04L63/105
Inventor 邓宏栋
Owner TCL CORPORATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap