Webpage data analysis method, analysis device, electronic equipment and storage medium

CN122309825BActive Publication Date: 2026-11-03ANHUI FEISHU INFORMATION TECHNOLOGY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202610771045.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2026-06-01
Publication Date
2026-11-03
Estimated Expiration
2046-06-01

AI Technical Summary

Technical Problem

Existing technologies suffer from low parsing accuracy and difficulty in adapting to changes in web page structure when processing complex or heterogeneous web pages, making rule updates difficult and failing to meet the high-concurrency processing requirements of large-scale web page data.

Method used

By extracting structural information and performing cluster analysis on multi-source web page files, a front-end routing table is generated. Web page data is clustered into clusters based on structural similarity, and parsing scripts within the clusters are scheduled based on the routing table for batch parsing, achieving efficient and accurate web page parsing.

Benefits of technology

It improves the accuracy and efficiency of webpage parsing in scenarios involving large-scale data cleaning, reduces the cost of manually writing rules, and enhances system scalability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122309825B_ABST
    Figure CN122309825B_ABST
Patent Text Reader

Abstract

The application provides a webpage data analysis method, an analysis device, an electronic equipment and a storage medium, and belongs to the technical field of data processing. The structural information of a webpage file after multi-source unification is extracted, and the target cluster number is adaptively calculated. Mass webpages are clustered into webpage clusters by using structural similarity, and the corresponding relationship between the webpage, the webpage cluster and the analysis script is recorded in a front-end routing table. The data omission problem caused by forcibly analyzing heterogeneous webpages with the same set of rules in the traditional mode is broken, and the high cost of manually writing rules page by page is also avoided. Through the routing table as the hub scheduling, the cluster analysis script specially adapted to a certain structural feature can be accurately called to batch analyze the same cluster webpages. The complex heterogeneous webpage analysis task is reduced to multiple groups of high-cohesion isomorphic webpage concurrent analysis tasks, thereby greatly improving the accuracy, execution efficiency and system scalability of webpage analysis in a large-batch data cleaning scene.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Structured processing method of distributed network information

    CN104598536A