Method for automatically analyzing Internet web page

Abstract

The invention relates to a method for automatically analyzing an Internet web page and belongs to the field of web page analyzing. According to the method for automatically analyzing the Internet web page, a user uses vertical search to extract structural data of a web page involved in an industry and builds a template according to the extracted structural data, wherein the concrete steps are as follows: (1) selecting a representative web page involved by the industry, carrying out word segmentation on the representative web page when the word segmentation word bank of the industry is the newest, and showing to the user; (2) providing regular expression matching items according to the graphical display of the web page word segmentation result; (3) selecting data which needs extraction according to the regular expression matching items and setting data names; (4) automatically generating a structural data extracting program according to a regular expression, and building a vertical search template; (5) labeling the vertical search template, and automatically analyzing all the web pages involved in the industry according to the vertical search template. The method for automatically analyzing the Internet web page uses the word segmentation, regular expression and label analyzing technology to obtain a vertical search engine and realize intelligent web page analysis.

Description

technical field [0001] The invention relates to a method for automatically analyzing Internet webpages, belonging to the field of webpage analysis. Background technique [0002] The vast number of Internet users obtain information by searching on the web to obtain results. It is impossible to provide services for classification and screening according to industry characteristics, and it is impossible to classify and display. However, it is impossible to judge which content the user wants to find in this search. Users need to spend It takes a long time to find the information you need in the results. The vertical search is a search service for the information on the website. The information on the website is directly added by the users of the website to each category of the website. Although the classification is clear, the search scope is narrow, and even The organizational form and webpage structure of each website of the same type are very different, and it is quite diffi...

AI Technical Summary

Problems solved by technology

[0002] The vast number of Internet users obtain information by searching on the web to obtain results. It is impossible to provide services for classifying and filtering according to industry characteristics, and it is impossible to classify and display. However, it is impossible to judge which content the user wants to find in this search. Users need to spend It takes a long time to find the information you need in the results

The vertical search is a search service for the information on the website. The information on the website is directly added by the users of the website to each category of the website. Although the classification is clear, the search scope is narrow, and even The organizational form and webpage structure of each website of the same type are very different, and it is quite difficult to extract the required information from them. Users need to cooperate with other search engines to learn comprehensive information.

Images