Secure Block Read Write Protocol for Remote Files
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote file operations are inefficient as they require transferring entire files for modifications, leading to high temporal costs and delays, especially with large files, due to the inability to upload or download only specific portions and the sequential nature of file transfer protocols.
Innovation Solution
The solution involves moving encryption and compression capabilities from the client remote drive interface layer to the data transfer layer, allowing block-level requests and operations, enabling secure and efficient transfer of only modified file portions, with matching decryption and decompression at the server to maintain block sizes and allow direct access to selected blocks for updating or reading.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire file is transferred for modification, then the file can be updated on the server, but the transfer time and bandwidth consumption increase significantly
Solution Approach 1:
The patent divides the file into multiple blocks and implements block-level operations. Instead of transferring the entire file for modification, only the specific blocks that need updating are transferred. The file structure is segmented into block units that can be independently manipulated, allowing partial file updates to reduce transfer time and bandwidth consumption while maintaining file update completeness.
2Quantity of substance
If file compression is applied before transfer, then the transfer size is reduced, but the block offset mapping between original and compressed files becomes unpredictable
Solution Approach 1:
The patent performs compression operations on individual blocks before transfer, and maintains a mapping table that records the relationship between original block offsets and compressed block offsets. This preliminary action of pre-compressing blocks and pre-establishing offset mappings allows the system to know exactly where each block will be located in the compressed file, enabling precise block-level operations even after compression.
3Device complexity
If the data transfer layer transfers files sequentially, then the protocol implementation is simple, but large file transfers experience significant delays
Solution Approach 1:
The patent segments the file transfer process into independent block-level operations. Instead of transferring the entire file sequentially, multiple blocks can be transferred in parallel or out of order. Each block is treated as an independent transfer unit with its own metadata containing offset information, allowing the data transfer layer to optimize transfer sequences and improve efficiency while maintaining protocol simplicity through standardized block handling.
4Productivity
If block-level operations are implemented on compressed files, then transfer efficiency improves, but the complexity of managing compressed block structures increases
Solution Approach 1:
The patent introduces a metadata layer that acts as an intermediary between the compressed file structure and the block operations. This metadata contains information about block offsets, sizes, and compression parameters, allowing the system to manage compressed blocks without directly manipulating the complex compressed data structure. The metadata serves as a simplified interface that reduces the complexity of managing compressed block structures while enabling efficient block-level operations.
Data Source
AI summary
A file transfer system including a client and a server capable of updating portions of the file stored on the server. The system is capable of uploading portions of a file before the file has been specified at the client side. The files are stored in raw at the client and the server, which preserves the block list mapping. The file transfer protocol is capable of compressing and encrypting transferred data. As a result, the partial file writes are possible while maintaining current bandwidth usage. The write request data structure is provided with additional features in the form of flags and fields to provide reliable transmission of partial file data.