Implementation method of adaptive dynamic web crawler system based on machine learning
A technology for dynamic web pages and an implementation method, applied in the computer field, can solve the problems of increasing the writing workload of dynamic webpage crawler programs, increasing the workload, and lacking reusability, and achieving the effect of reducing the writing workload.
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0016] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments, but not as a limitation of the present invention.
[0017] figure 1 It is a schematic structural diagram of an adaptive dynamic web crawler system based on machine learning according to an embodiment of the present invention. Such as figure 1 As shown, the adaptive dynamic webpage crawler system based on machine learning includes a dynamic webpage path selection module 11 , a dynamic webpage path adaptive training module 12 and a dynamic webpage data capture module 13 .
[0018] The dynamic web page path selection module 11 is configured to obtain a set of interaction paths of all China Unicoms according to the input information.
[0019] Wherein, the input information of the dynamic webpage path selection module 11 includes one or more of the entry webpage address, the target webpage address, the initial input data used in the intera...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com