Data capture method, system and routing server

A crawling server and data capture technology, applied in the computer field, can solve problems such as reducing data capture speed and stability, export speed limit, complex structure, etc., and achieve the effect of improving data capture speed and stability

Active Publication Date: 2016-01-20
TENCENT TECH (SHENZHEN) CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when the target website and the server that captures data are in different operators, for example, the target website is in a telecom operator, while the server that captures data is in a mobile operator, due to the complex structure of the networks of different operators, the export speed Issues such as limitations will reduce data capture speed and stability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data capture method, system and routing server
  • Data capture method, system and routing server
  • Data capture method, system and routing server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0021] see figure 1 , figure 1 The basic flowchart provided for the embodiment of the present invention. like figure 1 As shown, the method includes:

[0022] Step 101, after receiving the query request sent by the client, the routing server queries the routing information for grabbing data according to the routing table in the set storage space, the routing information includes the identifier of the operator, and sends it to the client end.

[0023] The specific description of this step 101 can be found in figure 2 Steps 201 to 204 are shown.

[0024] Step 102, the client sends a capture request to the capture server in the operator corresponding to the operator identifier, and the capture server captures the data after receiving the captu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data grab method, a system and a routing server, wherein the method includes that the routing server determines routing information for grabbing data based on already set routing lists in memory space, after receiving search request sent by the client, wherein the routing information containing identification of operators is sent to the client; the client sends grab requests to grab servers of operators corresponding to the operator identification, and the grab servers grab the data after receiving the grab requests. According to the data grab method, the system and the routing server, data grab speed and stability can be generally improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data capture method, system and routing server. Background technique [0002] Currently, for each service, the servers implementing the service are deployed in the same computer room, wherein the computer room only corresponds to one operator, that is, all the servers in the computer room are in the same operator. In this way, when the service needs to obtain the data of the target website, it can directly use the server in the computer room to grab the corresponding data and provide it to the service. [0003] However, when the target website and the server that captures data are in different operators, for example, the target website is in a telecom operator, while the server that captures data is in a mobile operator, due to the complex structure of the networks of different operators, the export speed Limitations and other issues will reduce the speed and stability of da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/743G06F17/30
Inventor 阮曙东张开翔曾鹏云
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap