A hierarchical testing method for a crawler program, a terminal device, and a storage medium
By using a layered testing method to perform multi-dimensional automated testing of web crawlers, the problem of inaccurate testing results in existing technologies is solved, enabling efficient and accurate deployment of web crawlers.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GUANGZHOU JUNBO NETWORK TECH INC
- Filing Date
- 2026-03-12
- Publication Date
- 2026-07-17
AI Technical Summary
Existing web crawler testing methods rely on manual extraction and comparison, resulting in inaccurate test results, limited data coverage, and an inability to fully test the amount and structure of data, thus affecting the actual performance of the web crawler.
A layered testing approach was adopted, including requirement-table field validation, total data integrity validation, reporting-table field validation, and reporting-source content validation. Automated tools were used to perform multi-dimensional testing on the output data of the crawler program to ensure design consistency, data integrity, and content accuracy.
It achieves efficient and accurate automated detection of web crawler programs, ensuring the effectiveness of web crawler programs after they are deployed online, and improving the comprehensiveness and efficiency of detection.
Smart Images
Figure CN122412286A_ABST