URL Fetch Retry Mechanism for Proxy-Based Connection Failures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication over the Internet is hindered by network issues such as congestion, load balancing, and unpredictable behavior, leading to lost, duplicated, or out-of-order data packets, which TCP protocols struggle to handle efficiently, resulting in connection failures and suboptimal data retrieval.
Innovation Solution
A system and method for retrying content fetching using direct or indirect schemes, including different proxy servers, IP addresses, or intermediate devices, to ensure reliable data transfer by re-establishing connections and optimizing data retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If TCP protocol is used for reliable data delivery, then data integrity is improved, but network congestion and packet loss handling becomes inefficient
Solution Approach 1:
The patent introduces a retry mechanism that acts as an intermediary layer between the TCP protocol and the network. When TCP encounters congestion or packet loss, the retry mechanism automatically retransmits failed requests through alternative paths or proxy servers, bypassing TCP's inefficiency in handling these specific network conditions while maintaining data integrity
2Speed
If direct fetching scheme is used, then data retrieval speed is improved, but reliability under network congestion deteriorates
Solution Approach 1:
The patent implements a dynamic fetching mechanism that adapts between direct and indirect schemes based on real-time network conditions. The system monitors connection status and automatically switches from direct fetching (for speed) to indirect fetching through proxy servers (for reliability) when congestion or failures are detected, optimizing both speed and reliability
3Reliability
If single proxy server is used for indirect fetching, then connection reliability is improved, but device complexity increases
Solution Approach 1:
The patent implements a self-service retry mechanism where the system automatically manages proxy server selection and connection retry logic without requiring complex external management. The mechanism includes built-in intelligence to select appropriate proxy servers, manage connection states, and automatically retry failed requests, reducing the need for complex external control systems
Data Source
AI summary
A method for overcoming intermittent, temporary, or other fetching failures by using multiple attempts for retrieving a content from a web server to a client device is disclosed. The URL fetching may use direct or non-direct fetching schemes, or a combination thereof. The non-direct fetching method may use intermediate devices, such as proxy server, Data-Center proxy server, tunnel devices, or any combination thereof. Upon sensing a failure of a fetching action, the action is repeated using the same or different parameters or attributes, such as by using different intermediate devices, selected based on different parameters or attributes, such as different countries. The repetitions are limited to a pre-defined maximum number or attempts. The fetching attempts may be performed by the client device, by an intermediate device in a non-direct fetching scheme, or a combination thereof. Various fetching schemes may be used sequentially until the content is retrieved.