Webpage information collection system and method

Abstract

The invention provides a webpage information collection system, which comprises a keyword generation module (10) capable of generating keywords according to a document specified by a user; an information collection module (20) which is used for collecting source codes attached to the webpage information; a rule storage module (30) which is preset with corresponding rules of keywords and source codes of webpage information; a database (50) which is used for storing the keywords and the collected webpage information and the source codes; and a judging module (40) which is used for judging whether the keyword and the webpage information source code conform to the corresponding rule or not based on the keyword and the collected source code information, and correspondingly storing the keyword, the webpage information and the source code into the database if the keyword and the webpage information source code conform to the corresponding rule. According to the method and the device, the required webpage information can be comprehensively and accurately collected. The invention further provides a webpage information collection method.

Description

technical field [0001] The present invention relates to a webpage information collection system and a webpage information collection method, in particular to a webpage information collection system and a webpage information collection method supporting industry structure analysis. Background technique [0002] In recent years, with the popularization of the Internet, there has been an increasing number of companies and individuals disclosing information to web sites. Collecting information published on websites (hereinafter referred to as webpage information) for marketing strategies and corporate strategy formulation is increasing. This requires proper classification and arrangement of the collected web page information. Due to the high cost of manual sorting, a method of classifying and sorting website information according to target files to be sorted has appeared in the prior art. [0003] In the existing method, information is classified / arranged by using web page inf...

AI Technical Summary

Problems solved by technology

However, there are often cases where information directly related to information cannot be obtained, such as representations, fluctuations, and lexical notation errors in the content of web page information.

[0005] When web page information does not include rules related to required background knowledge, sometimes it is difficult to distinguish relevant information

As a result, sometimes irrelevant webpage information is collected, and sometimes relevant webpage information cannot be collected

Images