Unlock instant, AI-driven research and patent intelligence for your innovation.

Account resource management device and method and data acquisition system and method

A data acquisition system and resource management technology, applied in the field of account resource management devices, can solve problems such as accidental injury, and achieve the effect of avoiding browsing interception restrictions

Active Publication Date: 2020-04-28
北京百分点科技集团股份有限公司
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The above-mentioned interception restriction strategy combining IP and cookies makes it impossible for the site to automatically browse public content through a very basic and simple crawler program, so that a group of people who abuse technology can be effectively blocked, but at the same time it also accidentally hurts the good use of technology people who do normal analysis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Account resource management device and method and data acquisition system and method
  • Account resource management device and method and data acquisition system and method
  • Account resource management device and method and data acquisition system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0038] see figure 1, the embodiment of the present disclosure provides an account resource management device. The account resource management device includes: an account resource management module 13 , a task scheduling module 15 and multiple account login modules 11 . Wherein, each of the account login modules 11 corresponds to a download analysis service node 20 and corresponds to a group of login IPs. Then each of the account login modules 11 and each of the download analysis service nodes 20 corresponds to the same group of login IPs.

[0039] Each account login module 11 is used to obtain the login IP and each account resource corresponding to it to s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an account resource management device and method and a data acquisition system and method. The technical scheme provided by the invention is that the method comprises the steps: for each account, employing different fixed login IPs and login Header information for simulated login; after login, correlating and storing the obtained Cookie information, the login IP and the login Header information, so that a user is simulated to surf the Internet by using a fixed browser in one place, the situation that one account, cookie corresponding to multiple IPs and a single IP areused by a large number of users is avoided, and therefore the situation that the user is limited by browsing interception is avoided. Moreover, each account login module corresponds to one download analysis service node and one group of login IPs, so the load balance of a plurality of download analysis service nodes can be controlled by controlling the login IP allocation corresponding to each download analysis service node.

Description

technical field [0001] The present disclosure relates to the technical field of data collection, and in particular, to an account resource management device and method, and a data collection system and method. Background technique [0002] Due to the existence of a large number of malicious people who ignore the law and abuse Internet crawling technology in the current Internet, the website defense strategy is gradually upgraded. As a result, an interception and restriction strategy combining IP and cookies has emerged: by verifying whether the cookies of tourist users and login users often change the access IP, if so, restrict the browsing of the cookies of the IP; verify whether a single IP is logged in by a large number of users, and Frequent browsing, if so, the IP user will be restricted from browsing. [0003] The above-mentioned interception restriction strategy combining IP and cookies makes it impossible for the site to automatically browse public content through a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/0815H04L63/083H04L67/1023
Inventor 苏萌左云鹏佘彬陈煜东李亚博刘译璟于帮付
Owner 北京百分点科技集团股份有限公司