Encrypted Large Document Transfer via Decentralized Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing content capture systems face challenges in efficiently transferring large files due to bandwidth and time constraints, leading to HTTP connection timeouts and network interruptions, which can compromise system security and require manual configuration changes.
Innovation Solution
A system that determines the size of digital content captured by a content capture device and selects an initial destination for transmission based on size attributes, using decentralized storage for large files, encrypting the content, and transmitting a content identifier (CID) for retrieval, while smaller files are transmitted directly to the receiving system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If HTTP file transfer is used for large digital content, then the content can be transmitted to the receiving system, but bandwidth consumption increases and connection timeout errors occur
Solution Approach 1:
The patent segments large file transfers into smaller chunks that can be transmitted independently. Instead of transmitting the entire large file over HTTP, the system divides it into manageable segments, transmits them separately, and reassembles them at the destination. This reduces bandwidth consumption per connection and eliminates timeout errors associated with large single-file transfers.
Solution Approach 2:
The patent introduces an intermediary storage system (such as a content delivery network or intermediate server) that receives large files from the source system and makes them available to the receiving system. This intermediary handles the bulk data transfer, freeing the original HTTP connection from carrying large payloads and reducing bandwidth pressure on the primary communication channel.
2Loss of time
If time limits for connection time-outs are increased to accommodate large files, then large content can be transferred, but system security is compromised due to slow HTTP attacks
Solution Approach 1:
The patent implements dynamic time-out configurations that adapt based on file size. For large files, the system uses segmented transmission with individual time-outs for each segment, rather than a single extended time-out. This maintains security by limiting the maximum exposure time per connection while still allowing large file transfers through multiple shorter-lived connections.
Solution Approach 2:
The patent employs periodic transmission of data segments with regular intervals and time-outs between segments. Instead of maintaining a single long-lived connection, the system establishes multiple periodic connections, each with its own time-out limit. This approach allows large files to be transferred over time while maintaining security through frequent connection termination and renewal.
3Adaptability or versatility
If manual configuration changes are made to increase maximum file size limits, then large content transfer is enabled, but considerable time and effort are consumed
Solution Approach 1:
The patent implements a self-configuring system that automatically detects file sizes and selects appropriate transmission methods without requiring manual configuration changes. The system includes built-in logic to determine whether to use segmented transmission, intermediate storage, or direct HTTP transfer based on the file size, eliminating the need for administrators to manually adjust configuration settings for different file sizes.
Solution Approach 2:
The patent dynamically changes transmission parameters based on file size characteristics. Instead of requiring manual configuration changes to enable large file transfer, the system automatically adjusts parameters such as segment size, transmission method, and buffer allocation based on the detected file size. This allows the system to adapt to different file sizes without administrative intervention.
4Reliability
If HTTP connection time-outs are reset due to network interruptions, then the connection can be reestablished, but the export operation must restart from the beginning
Solution Approach 1:
The patent implements preliminary segmentation of files into chunks with individual identifiers and position markers before transmission begins. Each segment is independently numbered and marked with its position in the overall file structure. This preliminary organization allows the system to resume transmission from the specific segment where a failure occurred, rather than restarting the entire file transfer from the beginning.
Solution Approach 2:
The patent incorporates feedback mechanisms where the receiving system acknowledges receipt of each transmitted segment and reports which segments have been successfully received. If a connection timeout occurs, the transmitting system receives feedback about which segments were successfully transferred and can resume by sending only the remaining segments, significantly reducing retransfer time after network interruptions.
Data Source
AI summary
Embodiments provide systems and methods for securely transferring large objects. A computer-implemented method, for example, includes determining whether digital content captured by a content capture device currently qualifies as a large file for transmission, based on a size attribute and a current transmission parameter associated with currently transmitting objects from a content capture system to an enterprise content management system. If the digital content qualifies as a large file, the digital content is encrypted and transmitted to a decentralized storage system for storage, and a content identifier that identifies the encrypted digital content stored in the decentralized storage system is transmitted to the enterprise content management system. Otherwise, the digital content is transmitted from the content capture system to the enterprise content management system.