Network resource data acquisition system and realization method thereof

A technology of data acquisition system and network resources, applied in the direction of network data retrieval, network data indexing, digital transmission system, etc., can solve the problems of unsatisfactory data integration and sharing, difficult to use, etc., to achieve accuracy and timeliness, The effect of achieving flexibility

Active Publication Date: 2017-04-26
中科瑞通科技股份有限公司
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The Web is a huge treasure trove of resources. At present, the number of pages has exceeded 200 billion, and it is growing steadily at an astonishing rate every hour. There are a lot of valuable information you need, such as government announcement content information, national economic data information, financial information, etc. Information, social information, consumption information, etc., but because these key information exist in a large number of HTML web pages in the form of semi-structured or free text, it is difficult to use them directly, and it cannot meet the requirements of data integration and sharing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Network resource data acquisition system and realization method thereof
  • Network resource data acquisition system and realization method thereof
  • Network resource data acquisition system and realization method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] Such as figure 1 As shown, the present invention adds resource information in the system database; configures network acquisition rules; tests the acquisition rules; publishes resource configuration information; adds task information, selects resource names, sets task operation period and task start time; starts task Just run it. The system of the present invention includes a resource configuration management module, a task configuration management module, a data management module, and a monitoring management module; the resource configuration management module includes a resource basic information maintenance module, a resource configuration information maintenance module, a resource rule testing module, and resource information release / revocation module; the resource basic information maintenance module is used to save and modify the resource basic information table, and automatically generates the resource collection information table according to the input resource ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the computer application technology field, and especially relates to a network resource data acquisition system and a realization method thereof. The system consists of a resource configuration management module, a task configuration management module, a data management module, and a monitoring management module. The method comprises the following steps: adding resource information in a system database; configuring network acquisition rules; testing the acquisition rules; issuing resource configuration information; adding task information, selecting resource names, and setting a task running period and the task running start time; and starting task running. With the method, worker in enterprises can quickly create a network data acquisition resource, flexibly configure the task acquisition time and the running period, and monitor and query acquired data. Therefore, the method is suitable for acquiring all types of network resource data for enterprises.

Description

technical field [0001] The invention relates to the field of computer application technology, in particular to a network resource data collection system and its implementation method. Background technique [0002] The Web is a huge treasure trove of resources. At present, the number of pages has exceeded 200 billion, and it is growing steadily at an astonishing rate every hour. There are a lot of valuable information you need, such as government announcement content information, national economic data information, financial information, etc. Information, social information, consumption information, etc., but because these key information exist in a large number of HTML web pages in the form of semi-structured or free text, it is difficult to use them directly, and it cannot satisfy the integration and sharing of data. Contents of the invention [0003] One of the technical problems solved by the present invention is to provide a network resource data collection system, whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08G06F17/30
CPCH04L41/145H04L67/10G06F16/951G06F16/958
Inventor 陈德淼季统凯
Owner 中科瑞通科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap