Internet data pulling method and system
An Internet and data technology, applied in the field of network communication, can solve problems such as the unavailability of the transfer server, affect the speed and efficiency of Internet data pulling, and cannot guarantee the network quality of the transfer server, and achieve the effect of improving the pulling speed and efficiency.
Active Publication Date: 2013-06-19
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF7 Cites 13 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] Because the network quality of the transit server may be different for different network resources, for example, the speed of Beijing IDC and Shenzhen IDC accessing a certain network is very different, and in the above-mentioned data pull platform, the background server is only randomly selected from the transit server list A transit server, which cannot guarantee the network quality of the selected transit server, or even the selected transit server is unavailable, which will affect the speed and efficiency of Internet data fetching
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0021] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.
[0022] The present invention provides an Internet data pulling system, mainly as figure 2 Shown:
[0023] see figure 2 , figure 2 The system structure diagram provided for the embodiment of the present invention. Such as figure 2 As shown, the system may include: a quality detection server, a transfer scheduling server, a transfer server and a database.
[0024] Wherein, the quality detection server is used to periodically detect the availability and network access quality of each transit server in the transit server list, and record them in the database;
[0025] The database is used to store a list of transit servers, and the availability and network access quality of each transit server detected by the quality detection server;
[002...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides an internet data pulling method and a system. The system comprises a quality detection server, a data base, a transit scheduling server and a transit server. The quality detection server is used for periodically detecting usability and network access quality of all transit servers in lists of the transit server and recording the usability and the network access quality to the data base. The data base is used for storing the lists of the transit server and the usability and the network access quality, detected by the quality detection server, of all the transit servers. When a data pulling task needs carrying out, the transit scheduling server is used for scheduling out the transit server which is usable and optimal in the network access quality to carry out the data pulling task according to a principle of balancing scheduling of the transit server. The transit server is used for carrying out the data pulling task under scheduling of the transit scheduling server.
Description
technical field [0001] The invention relates to network communication technology, in particular to a method and system for pulling Internet data. Background technique [0002] In network communication, in order to obtain data on the Internet, it is necessary to rely on a relay server, and the relay server participates in Internet data fetching. [0003] see figure 1 , figure 1 Pull platform diagrams for existing data. figure 1 The data pulling platform shown mainly includes a background server and a transit server. Among them, the background server is a resident server process, which saves a list of all transit servers, and randomly selects a transit server from the list when Internet data needs to be pulled, and initiates a transit data pull request to the transit server. After receiving the request sent by the background server, the transit server sends the request to the web server of the Internet at the same time, receives the Internet data returned by the web server...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L29/08G06F17/30
Inventor 吴飞蒋悦
Owner TENCENT TECH (SHENZHEN) CO LTD