Webpage keywords extracting method, device and system

An extraction method and keyword technology, which is applied in the Internet field, can solve problems such as large amount of calculation, reduced accuracy of keyword extraction, and failure to extract keywords, so as to achieve the effects of improving accuracy, reducing calculation amount, and reducing web page analysis

Active Publication Date: 2013-06-05
HUAWEI TECH CO LTD
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] It is necessary to analyze the webpage, extract the text of the webpage, analyze the webpage, and extract the text of the webpage. The algorithm is complex and the calculation is large
And because the webpages on the Internet are extremely irregular, the effect of extracting the text of the webpage is only good for a specific type of webpage, such as the productized Chinese Academy of Sciences, Massive, etc. webpage theme extraction components, but they are all only for specific types webpage, and webpage text extraction is closely related to keyword extraction. If the extracted webpage text contains other information such as advertisements and copyrights, the advertisements, copyrights and other information may not be extracted as the text; or some important content has not been extracted. Extracted, the accuracy of keyword extraction will be greatly reduced
Therefore, the existing web page analysis method has a large amount of calculation, and the accuracy of keyword extraction is not high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Webpage keywords extracting method, device and system
  • Webpage keywords extracting method, device and system
  • Webpage keywords extracting method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0032] like figure 1 As shown, the embodiment of the present invention provides a web page keyword extraction method, including:

[0033] S101, crawling Internet web pages;

[0034] In one embodiment, the webpage may be crawled by a crawling tool (such as a web spider, a web crawler, etc.). In one embodiment, a web crawler based on breadth traversal retrieval can be used to crawl Internet web pages; in one embodiment, for larger web pages, optimization can b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a webpage keywords extracting method, comprising the following steps: crawling an internet webpage; extracting an anchor text of the crawled webpage and extracting a URL (uniform resource locator) of the anchor text and the surrounding text of the anchor text; extracting keywords from the anchor text and the surrounding text of the anchor text according to the pre-formulated rules; and correlating the keywords with the URL of the anchor text, so as to use the keywords as the webpage keywords of the webpage directed by the URL of the anchor text. The embodiment of the invention also discloses a webpage keywords extracting device and a system. By adopting the technical scheme, the calculation amount for extraction of the webpage keywords can be reduced, and the accuracy for the keywords extraction is improved.

Description

technical field [0001] The invention relates to the field of the Internet, in particular to a method, device and system for extracting web page keywords. Background technique [0002] The extraction of web page keywords is a hot issue in Internet applications under the background of massive data. Extract appropriate keywords for web pages, which can be used to prompt and summarize the content of web pages. Webpage keyword extraction is widely used in keyword-based precise advertising, webpage summarization, webpage retrieval, and user behavior analysis. [0003] Traditional approaches (eg, KEA keyword extraction method) tend to extract keywords from web page text. First crawl the webpage, then analyze the webpage, extract the title, metadata (webpage metadata) information and text of the webpage. Then segment the words, remove the stop-word (stop words) to get the candidate keywords, then extract the characteristics of the candidate keywords, and score the candidate keywo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 陆元飞刘刚朱汝维
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap