A webpage text extraction method based on a logic link block

A technology of logical links and texts, applied in the computer field, can solve the problems of high HTML normative requirements and inability to handle the text of web pages well, and achieve the effect of high recall rate

Active Publication Date: 2019-05-10
WENZHOU UNIV OUJIANG COLLEGE
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0048] In view of the fact that current methods based on HTML tag trees have high requirements for HTML normativeness, and methods based on text density and other information cannot handle the problems such as short webpage texts, the present invention proposes a news, blog and other information based on logical link blocks. Extraction method of webpage text extraction template (Content Extraction based on Logical LinkBlocks, CELLB)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A webpage text extraction method based on a logic link block
  • A webpage text extraction method based on a logic link block
  • A webpage text extraction method based on a logic link block

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] In order to facilitate those of ordinary skill in the art to understand and implement the present invention, the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the implementation examples described here are only used to illustrate and explain the present invention, and are not intended to limit this invention.

[0072] Generally speaking, almost most websites, such as news, blogs and other types of websites, in their specific content details pages, except for the middle part of the webpage, which is mainly used to display the main content of the page, around the main content (usually in the main content The lower or right side of the website), there will also be a large number of related links, these related links are related page links matched by the website recommendation system or automatic matching program (for example, it may be called "related news", "recommende...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a webpage text extraction method based on a logic link block, and the method only depends on the current webpage in the process of extracting a webpage template and a text, anddoes not need heuristic rule support, so that the method has good universality; the extraction process of the webpage template does not need manual intervention, and the automation degree is high; the analysis process is simple, and label analysis does not need to be carried out on the webpage, so that the analysis speed is high, the anti-interference performance is high, and the method can better adapt to a Web page with nonstandard design; the method also has a better extraction effect on pages with very short text contents; and finally, the template extracted by the method is simple in form and easy to use. Therefore, it is determined that the method has potential application value in the aspect of Web page text extraction, can be used for text extraction of various news, blogs or webpages with similar structures, and also has wide application prospects in other Web information processing and mining fields with low requirements for link block fine granularity.

Description

technical field [0001] The invention belongs to the field of computer technology, and relates to a web page text extraction method, in particular to an extraction method (Content Extraction based on Logical Link Blocks, CELLB). Background technique [0002] Web page information extraction refers to extracting specific information content from web pages according to specific analysis and application requirements. These specific information contents not only include some superficial content directly from web pages, but also deep content formed based on specific analysis of web pages. Web page text extraction is one of the main directions of this research. It has a long research history and many related methods. Document 1 summarizes webpage extraction methods into five categories based on Wrapper, template, machine learning, visual layout features, and HTML features. Among them, Wrapper and template methods are generally considered to be less versatile, and generally require...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/958
Inventor 王贤明
Owner WENZHOU UNIV OUJIANG COLLEGE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap