Hybrid Data Transfer Mechanism for Random Access and High Speed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current HTTP/TCP implementations are not optimized for small byte-range requests, leading to increased network latency and compromised download speeds when accessing data files over the Internet, as they multiply the per-request cost of network latency.
Innovation Solution
A hybrid approach combining bulk data requests and small data requests using HTTP/TCP, where bulk requests leverage TCP's adaptive congestion control for high-speed data transfer and small requests enable random access, optimizing data transfer rates and reducing network latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If byte-range requests are used to randomly access data files, then random access capability is improved, but network latency increases due to multiple small requests
Solution Approach 1:
The patent segments the data access pattern into two distinct types: bulk data requests for sequential access and byte-range requests for random access. This segmentation allows each request type to be optimized independently, with bulk requests minimizing latency and byte-range requests providing random access capability.
Solution Approach 2:
The patent dynamically switches between bulk transfer mode and byte-range request mode based on the access pattern. When sequential access is detected, bulk transfer is used; when random access is needed, byte-range requests are issued. This dynamic adaptation resolves the contradiction by selecting the appropriate access method for each specific scenario.
2Productivity
If bulk data requests are used to achieve high download speeds, then transfer rate is improved, but random access capability deteriorates
Solution Approach 1:
The patent merges two previously separate data access mechanisms (bulk transfer and byte-range requests) into a unified hybrid approach. This combination allows the system to leverage the high speed of bulk transfer while maintaining the random access capability of byte-range requests, resolving the contradiction between transfer rate and access flexibility.
Solution Approach 2:
The patent creates a universal data access framework that can handle both sequential bulk transfer and random byte-range access through a single integrated system. This multi-functional approach eliminates the need to choose between bulk transfer and random access, allowing both capabilities to coexist and be used as appropriate.
3Measurement precision
If multiple small data requests are issued to access specific data ranges, then random access precision is improved, but server load increases
Solution Approach 1:
The patent applies partial action by issuing byte-range requests only for the specific data portions that need random access, rather than transferring entire files. This partial approach maintains precise data range access while minimizing the overall server load compared to complete file transfers.
Data Source
AI summary
The present invention includes apparatuses, methods, computer readable media and systems comprising means for rapid data acquisition from a server are discussed herein. This rapid data acquisition can be achieved using a combination of bulk data requests and small data requests. A hybrid approach that uses simultaneous bulk and small data requests can provide random access to data files while achieving the high download speeds of a large data transfer.