File Upload Offloading via Requestor Hash Key
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional cloud computing systems face challenges in securing user files during the upload process and ensuring the security of other files on servers, especially in distributed systems.
Innovation Solution
The method involves offloading upload processing of a file in a distributed system using a key that includes a hash created using attributes of the requestor and/or the file, allowing the file to be uploaded to a non-indexing file storage system instead of a transactional database.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If file upload processing is performed using a transactional database, then data integrity and access control are maintained, but upload time and system resources are consumed
Solution Approach 1:
The system segments the upload process into two distinct paths: one for files that need transactional database storage (maintaining data integrity) and another for files that can be stored in non-indexing file storage systems (reducing upload time). The decision to use either path is based on file attributes such as size, type, and content analysis, allowing optimal performance for different file types.
Solution Approach 2:
The system changes the storage parameter from transactional database to non-indexing file storage system based on file characteristics. By analyzing file attributes (size, type, content) and adjusting the storage destination accordingly, the system optimizes both security and performance for different file types without compromising data integrity where needed.
2Reliability
If file upload processing is performed using a transactional database, then security and access control are maintained, but processing resources and time are consumed
Solution Approach 1:
The system segments file upload processing into secure transactional database storage for critical files and faster non-indexing file storage for less sensitive files. This segmentation allows the system to maintain high security standards for files requiring strict access control while improving processing speed for files that can be stored elsewhere.
Solution Approach 2:
The system dynamically changes the storage destination parameter based on file security requirements and characteristics. By evaluating file attributes and adjusting the storage location accordingly, the system optimizes both security and processing speed without compromising either aspect for any given file type.
3Ease of operation
If upload location is disclosed to the requestor, then transparency is improved, but security is compromised
Solution Approach 1:
The system introduces a key as an intermediary mechanism that provides indirect confirmation of successful upload without disclosing the actual storage location. The key acts as a mediator between the requestor and the storage system, maintaining security by keeping location information hidden while still providing transparency through key validation and file access capabilities.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Techniques are described herein that are capable of offloading upload processing of a file in a distributed system. A request is received from a requestor to upload a file to a transactional database of a DBMS. Information regarding the requestor and/or the file is extracted from the request. A determination is made that the file is to be uploaded to a non-indexing file storage system in lieu of the transactional database based at least in part on the extracted information satisfying one or more criteria. A key that includes a hash is generated. The hash is created using attribute(s) of the requestor and/or the file from the extracted information. The key is provided to the requestor. The key and at least a portion of the file are received from the requestor. Uploading of the file to the non-indexing file storage system in lieu of the transactional database is initiated.