Classified site mining method and device and searching method and system

Abstract

The invention discloses a classified site mining method and device and a searching method and system. The classified site mining method includes the steps of classifying a site to be mined to determine one or more basic sites belonging to the category; extracting webpage content in the basic site, and mining links, recommended and / or quoted in the webpage content in the basic sites, of the other sites; adding one or more links of the other sites into a site set of the category. According to the technical scheme, the recommendation and quotation relationship of the basic site are utilized for mining the other sites belonging to the same site category with the basic site, and the site set of the category is obtained. According to the technical scheme, the classified site mining method and device and the searching method and system have the advantages of being simple and visual in principle, overcoming defects that in the prior art, operation is complicated, and practicability is poor, being more convenient and effective, being higher in the recall rate and accuracy rate, enabling users to obtain rapid, effective and accurate searching results of the classified sites in the searching process, and meeting searching requirements of the users.

Description

technical field [0001] The invention relates to the technical field of data mining, in particular to a method and device for mining classified sites and a search method and system. Background technique [0002] When a search engine needs to include specific types of Internet resources, it is often necessary to classify the sites. For example, when it is necessary to collect some IT technology resources, it is often necessary to dig out some IT technology sites first, and then adopt a specific strategy to crawl the resource pages on the website according to the characteristics of these sites. [0003] In the prior art, to mine specific types of sites, it is first necessary to classify the content of the sites, which is the first step in the collection work. At present, the classification of sites is generally based on the method of keyword matching, that is, first set some keywords, and then calculate whether these keywords are included in the webpage. The type of all web p...

AI Technical Summary

Problems solved by technology

[0004] The above scheme has the following defects: 1. First, a large number of keywords need to be determined with the method of keyword matching, and the determination process of keywords is very tedious, requires manual participation, and the comprehensiveness of keywords cannot be guaranteed

2. Due to the problem of synonyms in keyword matching, that is, the same meaning may have different expressions, resulting in poor interaction and low accuracy in the matching process

3. The web page keyword matching program is relatively complicated, and requires a lot of calculations for all web pages, which is time-consuming and labor-intensive, and poor in implementability

Images