Webpage analysis method and device, electronic equipment and medium

A technology for web page parsing and web page data, applied in the field of web page parsing

Pending Publication Date: 2020-10-20
BEIJING XUEZHITU NETWORK TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when faced with the data analysis tasks of many different websites (pages), due to the variety of page structure and layout, it is necessary to write a specific analysis method for each page, which results in a lot of relatively repetitive development work

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Webpage analysis method and device, electronic equipment and medium
  • Webpage analysis method and device, electronic equipment and medium
  • Webpage analysis method and device, electronic equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of this application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art witho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a webpage analysis method and device, electronic equipment and a medium. The method comprises the following steps: obtaining a document object model of a to-be-analyzed target webpage; loading a target page analysis rule configured by a user according to a preset format; obtaining a label type in the target page analysis rule; and for each label type, adopting an analysis mode corresponding to the label type to analyze the webpage data belonging to the label type in the document object model. According to the embodiment of the invention, the universality of webpage analysis can be improved, and a large amount of repeated development work of developers is reduced.

Description

technical field [0001] The present application relates to the technical field of web page analysis, in particular to a web page analysis method, device, electronic equipment and media. Background technique [0002] At present, the webpage parsing method is to write a set of independent parsing modules according to the structure of the specific webpage. It is difficult to reuse code when parsing different web pages, which will cause a lot of repetitive work for developers. And the analysis of the webpage is all done by the developer. If the requirements need to be changed (for example, issues such as webpage revision), frequent communication between the user and the developer is often required. [0003] In the data collection work, the web page data that needs to be parsed has two main forms of structural layout on the page: list ( ),sheet( 、 ) and other row-level labels. However, when faced with the data analysis tasks of many different websites (pages), due to the va...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/955G06F16/958G06F16/906G06F8/38G06F8/41
CPCG06F8/38G06F8/427G06F16/906G06F16/9562G06F16/958
Inventor 张淼刘建辉陈瑞
Owner BEIJING XUEZHITU NETWORK TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap