Method and device for improving quality of crawler proxy and computer readable storage medium
A storage medium and quality technology, applied in computing, multi-programming devices, program control design, etc., can solve the problems of inability to identify the quality and usable status of agents, waste of network and server resources, and failure of crawler requests to reduce occupation. , Effective management, ensure the effect of success
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0040] Embodiments of the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solutions of the present invention more clearly, and therefore are only examples, rather than limiting the protection scope of the present invention.
[0041] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application shall have the usual meanings understood by those skilled in the art to which the present invention belongs.
[0042] Such as figure 1 As shown, the present invention proposes a kind of method that promotes crawler agent quality, comprises the following steps:
[0043] Set different priorities for several proxy pools;
[0044] The agent pool is invoked based on the agent pool priority and its utilization rate.
[0045] Such as figure 2 As shown, the present invention proposes a kind of m...
PUM

Abstract
Description
Claims
Application Information

- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com