Proxy Server Merging HTTP Requests to Reduce Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The significant latency associated with downloading resources from a content server, particularly due to the need for separate requests and processing of dependent resources like images and videos, which increases TCP connection setup and slow-start procedures.
Innovation Solution
A client intercepts HTTP requests and redirects them to a proxy server within a content delivery network (CDN), allowing for caching, reduced TCP connection overhead, and efficient parsing of resources, enabling immediate delivery from local caches or CDN servers, and maintaining persistent connections for faster data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If separate HTTP requests are used for each resource, then resource downloading can be completed, but latency increases significantly due to TCP connection setup and slow-start procedures
Solution Approach 1:
The patent merges multiple separate HTTP requests into a single request by collecting resource identifiers (URLs, paths, or hashes) and sending them together to the origin server. The server processes all resources in one response, eliminating the need for multiple TCP connection setups and slow-start procedures, thus reducing latency while maintaining resource download capability
Solution Approach 2:
The system performs preliminary action by collecting and buffering multiple resource identifiers before sending the combined request to the origin server. This allows the client to prepare the complete resource list in advance, enabling the server to process all resources efficiently in a single operation rather than waiting for sequential requests
2Reliability
If multiple separate requests are sent for dependent resources, then all resources can be obtained, but TCP connection overhead increases
Solution Approach 1:
The patent combines multiple resource requests into a single HTTP request that carries multiple resource identifiers. The origin server processes all requested resources in one connection and returns them in a single response, eliminating the need to manage multiple TCP connections while ensuring all required resources are obtained
Solution Approach 2:
The system introduces an intermediary mechanism (the combined request format and server-side processing logic) that mediates between the client's need for multiple resources and the network's TCP connection overhead. This intermediary layer aggregates requests and manages the single connection, reducing complexity while maintaining resource completeness
Data Source
AI summary
A method of delivering content to a device is disclosed. The method includes receiving a request by a proxy server, wherein the request is received by a local client and transferred by the local client to the proxy server, and wherein the request comprises a request for content available at a content server sent from an application to the content server. The method further includes parsing the content and identifying a task associated with the content by the proxy server. The method further includes delivering the content and information associated with the identified task from the proxy server to the local client, wherein the content is further delivered from the local client to the application.