Network resource data acquisition system and realization method thereof

Abstract

The invention relates to the computer application technology field, and especially relates to a network resource data acquisition system and a realization method thereof. The system consists of a resource configuration management module, a task configuration management module, a data management module, and a monitoring management module. The method comprises the following steps: adding resource information in a system database; configuring network acquisition rules; testing the acquisition rules; issuing resource configuration information; adding task information, selecting resource names, and setting a task running period and the task running start time; and starting task running. With the method, worker in enterprises can quickly create a network data acquisition resource, flexibly configure the task acquisition time and the running period, and monitor and query acquired data. Therefore, the method is suitable for acquiring all types of network resource data for enterprises.

Description

technical field [0001] The invention relates to the field of computer application technology, in particular to a network resource data collection system and its implementation method. Background technique [0002] The Web is a huge treasure trove of resources. At present, the number of pages has exceeded 200 billion, and it is growing steadily at an astonishing rate every hour. There are a lot of valuable information you need, such as government announcement content information, national economic data information, financial information, etc. Information, social information, consumption information, etc., but because these key information exist in a large number of HTML web pages in the form of semi-structured or free text, it is difficult to use them directly, and it cannot satisfy the integration and sharing of data. Contents of the invention [0003] One of the technical problems solved by the present invention is to provide a network resource data collection system, whi...

AI Technical Summary

Problems solved by technology

[0002] The Web is a huge treasure trove of resources. At present, the number of pages has exceeded 200 billion, and it is growing steadily at an astonishing rate every hour. There are a lot of valuable information you need, such as government announcement content information, national economic data information, financial information, etc. Information, social information, consumption information, etc., but because these key information exist in a large number of HTML web pages in the form of semi-structured or free text, it is difficult to use them directly, and it cannot meet the requirements of data integration and sharing.

Images