Large File Transfer via Encrypted Decentralized Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing HTTP file transfer methods for large digital content face challenges with increased bandwidth usage, time consumption, and network interruptions, leading to HTTP connection timeout errors and compromised security, particularly in managing error recovery and resuming file transfers.
Innovation Solution
A system that determines the size of digital content captured by a content capture device and selects an initial destination for transmission based on size attributes and network conditions, using decentralized storage for large files, encrypting the content, and transmitting a content identifier (CID) for retrieval, while smaller files are transmitted directly to the enterprise content management system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If HTTP file transfer is used for large digital content, then file transfer capability is provided, but bandwidth usage increases and transfer time is consumed
Solution Approach 1:
The patent segments the file transfer process into two distinct parts: (1) transferring a small metadata package containing file information and hash values, and (2) separate peer-to-peer file sharing for the actual large content. This segmentation allows the metadata to be efficiently transferred via HTTP while the large content uses a more bandwidth-efficient P2P mechanism, resolving the contradiction between providing file transfer capability and minimizing bandwidth consumption.
Solution Approach 2:
The patent introduces a metadata package as an intermediary that mediates between the HTTP transfer system and the P2P file sharing system. This metadata package contains essential file information and cryptographic hash values, allowing the system to verify and share large files without requiring continuous HTTP connection management, thus reducing bandwidth overhead while maintaining transfer capability.
2Productivity
If HTTP file transfer is used for large digital content, then file transfer is enabled, but network interruptions cause connection timeout errors
Solution Approach 1:
The patent performs preliminary actions by first transferring and verifying the metadata package containing cryptographic hash values before initiating the actual large file transfer. This preliminary verification step allows the system to detect potential transfer issues early and switch to P2P sharing, preventing connection timeout errors that would occur with direct HTTP transfer of large files over unstable networks.
Solution Approach 2:
The metadata package serves as an intermediary that enables the system to verify file integrity and coordinate the transfer process without maintaining long-lived HTTP connections. By using the metadata package to orchestrate the transfer and then switching to P2P sharing, the system avoids the connection stability issues inherent in HTTP transfers of large files across interruptible networks.
3Duration of action of moving object
If connection time-out limits are increased to allow large file transfer, then transfer time is extended, but system security is compromised
Solution Approach 1:
The patent segments the transfer process so that only small metadata packages are transferred via HTTP with extended time limits, while large files are transferred through P2P sharing. This segmentation allows the system to have extended duration for metadata verification without exposing the entire large file transfer to security risks associated with prolonged HTTP connections.
Solution Approach 2:
The metadata package acts as an intermediary that enables secure verification of large files without requiring prolonged HTTP connections. By verifying file integrity through cryptographic hash values in the metadata and then using P2P sharing for the actual transfer, the system extends effective transfer duration while maintaining security through avoided exposure to slow HTTP attack vectors.
4Productivity
If manual configuration changes are made to increase maximum file size limits, then large file transfer is enabled, but time and effort are consumed
Solution Approach 1:
The metadata package serves as an intermediary that enables large file transfer capability without requiring manual configuration changes to HTTP server limits. By transferring only small metadata packages via HTTP and using P2P sharing for large content, the system achieves large file transfer capability while avoiding the time-consuming manual configuration process entirely.
Solution Approach 2:
The patent changes the fundamental parameter of what is transferred via HTTP from large files to small metadata packages. This parameter change eliminates the need to adjust maximum file size limits in HTTP server configurations, as the metadata packages naturally fit within existing limits while enabling large file transfer through the P2P mechanism.
5Ease of operation
If HTTP file transfer is used for small digital content, then satisfactory export results are achieved, but bandwidth efficiency is reduced for larger files
Solution Approach 1:
The patent implements a dynamic transfer mechanism that automatically selects between HTTP metadata transfer and P2P file sharing based on file size characteristics. For small files, the entire transfer can be handled efficiently via HTTP, while for large files, the system dynamically switches to P2P sharing, thus maintaining ease of operation while optimizing bandwidth usage according to the actual content size.
Solution Approach 2:
The patent segments the transfer approach based on file size, using HTTP for lightweight metadata exchange and P2P for heavy content transfer. This segmentation allows the system to maintain the simplicity and ease of operation of HTTP transfers for small content while achieving bandwidth efficiency for large files through selective use of P2P sharing.
Data Source
AI summary
Embodiments provide systems and methods for securely transferring large objects. A computer-implemented method, for example, includes determining whether digital content captured by a content capture device currently qualifies as a large file for transmission, based on a size attribute and a current transmission parameter associated with currently transmitting objects from a content capture system to an enterprise content management system. If the digital content qualifies as a large file, the digital content is encrypted and transmitted to a decentralized storage system for storage, and a content identifier that identifies the encrypted digital content stored in the decentralized storage system is transmitted to the enterprise content management system. Otherwise, the digital content is transmitted from the content capture system to the enterprise content management system.