Visual collection system and method based on network resources

Abstract

The invention relates to the technical field of computer networks, and discloses a visual collection system and method based on network resources, and the system comprises a configuration module, a collection module, a classification indexing module, and a data storage module. And the configuration module comprises a configuration program which can call a browser, so that the browser renders and presents a page to be configured, nodes of the page to be configured can be conveniently clicked, page data extraction and processing rules are generated, and a visual operation environment is realized. The collection module comprises a collection program, is used for accessing a to-be-collected page and extracting data according to a page data extraction and processing rule; the classification indexing module comprises a classification unit; wherein the data storage module can establish a knowledge classification system of a page to be collected according to content characteristics of the pageto be collected, classify collected data according to the knowledge classification system and index keywords according to texts in the collected data, and the data storage module comprises a storagedatabase which can store the collected data.

Description

technical field [0001] The present invention relates to the technical field of computer network, in particular to a visual collection system and collection method based on network resources. Background technique [0002] In recent years, with the continuous and rapid development of information technology and the Internet, Internet information has become more and more prominent in society and life. Among them, the website contains a lot of valuable information, such as announcement content information, economic data information, financial information, social information, consumption information, etc. Therefore, in order to obtain information quickly and effectively, it is necessary to effectively collect and collect network resource information. categorized. [0003] The current network resource collection method uses programmers to write specific codes to collect, process and save the content of designated websites. However, when faced with the problem of collecting too ma...

AI Technical Summary

Problems solved by technology

However, the input of regular expressions or XPath mentioned above requires users to understand the relevant technologies before they can operate the collection tool and complete the collection work, which makes the learning cost higher and ordinary users cannot use it normally.

Images