System and method for identifying text floor of webpage

Abstract

The invention discloses a system for identifying a text floor of a webpage. The system comprises a webpage analysis and layout module, a node identifying module, a floor dividing module and a mobile terminal page generation module, wherein the webpage analysis and layout module is suitable for analyzing a source code of the webpage and carrying out layout calculation on a paring result to generate a DOM (Document Object Model) tree; the node identifying module is suitable for traversing from a root node of the DOM tree to identify a text node and a garbage word node in the DOM tree; the floor dividing module is suitable for dividing the text node identified according to the floor of the webpage; and the mobile terminal page generation module is suitable for generating a mobile terminal page. According to the system and the method for identifying the text floor of the webpage, after conventional content of webpage of Internet is identified and extracted, BBS text, news text and commends can be effectively extracted, the representing characteristics of floors of the text in the original webpage can be restored, the representing effect maintains the original characteristics of multiple floors so as to provide excellent reading experience for users.

Description

technical field [0001] The invention relates to the Internet field, in particular to a method for identifying the floor of a webpage text. Background technique [0002] With the development and popularization of mobile terminals, people increasingly use mobile terminals to browse webpages. However, since most of the websites on the Internet do not do special processing for the display of mobile terminals, the display of most web pages on mobile terminals is distorted, resulting in extremely poor reading experience for users. [0003] The current method to improve the user's reading experience is to extract and rearrange the text of the webpage, and then re-display it to the user. The effect is better for news and information webpages with large sections of content, but user comments will be discarded. For forums where the text is divided into multiple "buildings", the effect is even worse: only the text of a certain building can be recognized or not. text. The spam inform...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the current text extraction technology's dependence on the largest text segment and the poor handling of multi-"building" content, so that when text extraction and rearrangement are performed on web pages, not only the news text can be identified and extracted, but also the news text can be extracted. Able to identify the comment content of news comments, and identify multi-"floor" content in forums

Images