Individual oriented acquisition cloud service system
A technology of cloud service and collector, which is applied in the computer field to meet the collection requirements
Active Publication Date: 2013-11-20
江苏联著实业股份有限公司
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In this way, when users need to have personalized configuration according to their own needs, they will not be satisfied.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0036] Specific embodiments of the present invention will be further described in detail below.
[0037] Such as figure 1 and figure 2 As shown, the personalized directional collection cloud service system of the present invention includes a client, a cloud management platform, a directional collection execution terminal and a collection result database. Among them, the client includes multiple acquisition configuration clients and content extraction clients; the cloud management platform includes modules such as task scheduling management, customer management, and webpage data management; the directional acquisition execution end includes multiple webpage collectors, and each webpage collector Both include a webpage directional collector, a link queue pool and a webpage analysis module. The task scheduling management module includes task testing and distribution sub-modules and URL seed database; the customer management module includes customer management sub-modules and c...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an individual oriented acquisition cloud service system, which comprises an oriented acquisition executing end and a plurality of clients, wherein the clients are used for outputting an acquisition theme and an initial URL (Uniform Resource Locator) according to user setting; and the oriented acquisition executing end comprises a plurality of webpage orientated acquisition devices. The individual oriented acquisition cloud service system is characterized by further comprising a cloud service-based cloud management platform which is used for receiving the acquisition theme and the initial URL, transmitting the acquisition theme and the initial URL to the oriented acquisition end, extracting a URL relevant to the acquisition theme according to a webpage acquired by the oriented acquisition end, outputting the URL to the oriented acquisition end and transmitting the webpage acquired by the oriented acquisition end to the clients. In the individual oriented acquisition cloud service system, individual oriented acquisition is realized through the strong and efficient computing capacity of a cloud service. The individual oriented acquisition cloud service system has the characteristics of high speed, high efficiency, capability of meeting various individual acquisition requirements, and the like.
Description
technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a personalized orientation collection system. Background technique [0002] The directional acquisition system is a kind of web spider, and it is the core part of the network data acquisition system. It obtains all the subject-related content by continuously grabbing massive web content from known information sources on the Internet (ie, network links, URL: Universal Resource Locator). The advantages and disadvantages of the directional acquisition system are mainly reflected in the speed and quality of its crawling web content, as well as the matching degree of the crawled content and the collected theme. At present, most web spiders are stand-alone versions. The management of information sources and collection topics is relatively simple. Usually, the administrator performs simple configuration on the server side. After configuration, all users are under the cons...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
Inventor 王楠
Owner 江苏联著实业股份有限公司