Vertical search based network data excavation method

Abstract

The present invention discloses a network data mining method based on a vertical search. Firstly, the method of the vertical search is adopted to search data from a network; the information gained is preprocessed, the structured data after purging through the data is saved in a data base; an analysis is performed to the data in the data base to find a rule, therefore to construct a model, and a matching is performed to the feature vector of a collection and the feature vector of a target sample, herefrom, the degree of association of the relevant collection information is gained; a prediction is performed to an unknown data, and an evaluation is delivered by being compared with a actual result, therefore to perform a revision to an original model parameter, and the authoritative information is supplied to a user. The present invention adopts a network data mining method of a vertical search to gain the relevant information, the relevant specialized information can be effectively gained, the repeated information and the spam information are little, and the enquiry of a user specialization can be met.

Description

technical field [0001] The invention relates to a method for collecting network data, in particular to a method for mining network data based on vertical search. Background technique [0002] With the rapid development of network communication technology, the World Wide Web has become a huge distributed information space containing potentially valuable knowledge. Network data contains many useful, potential, but not easy to find knowledge and patterns. People urgently need Discover and master the methods and tools that enable access to these knowledge and patterns. Search engines collect and discover information in the Internet, understand, extract, organize and process information, and provide retrieval services for users, while network data mining uses data mining technology to mine useful patterns and hidden meanings from network data. information. So search engines provide data preparation for web data mining, which is an advanced application of search engines. [000...

AI Technical Summary

Problems solved by technology

[0005] (1) Information disorder leads to less effective information

Since most of the network data exists in the unstructured webpage text, it is difficult to effectively organize the network data, and there are a lot of repetitive information and spam information, forming strong noise, causing users to query information like looking for a needle in a haystack

[0006] (2) Information search lacks professional division, industry boundary and user range and level distinction, which cannot satisfy user's customizable and professional query

Images