Cloud Folder Access During Upload via Segmented Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The process of uploading large folders to cloud servers is time-consuming, often taking hours or days, and prevents access to these folders during the upload process, disrupting operations that rely on them.
Innovation Solution
A system that allows access to a folder being uploaded to a cloud storage server by establishing a communication link between the user device, cloud server, and remote device, enabling access during the upload process through a cloud service application that maps folder information and provides access to either the local or cloud-stored folder based on upload status.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a secure connection is maintained for the entire upload process of large folders, then data security and accuracy are improved, but access to the folders by other computing devices is prevented and upload time increases to hours or days
Solution Approach 1:
The upload process is segmented into multiple concurrent upload sessions rather than a single long-duration connection. The folder upload is divided into smaller chunks that can be uploaded in parallel, reducing the time each secure connection needs to remain open while maintaining data security through encrypted transfers.
Solution Approach 2:
Folder metadata and directory structure are uploaded and made accessible before the actual file contents are fully transferred. This preliminary action allows users to access folder structure and already-uploaded files immediately, while the remaining files continue uploading in the background without blocking access.
2Reliability
If the entire folder is uploaded before providing access, then data integrity is ensured, but operations that need access to the folder are disrupted for long periods
Solution Approach 1:
The system performs preliminary actions by uploading and making accessible the folder's directory structure, metadata, and any files that have already been transferred before the complete upload is finalized. This allows operations to begin using available data while the upload process continues in the background, ensuring data integrity for accessed files while maintaining operational continuity.
Solution Approach 2:
The system dynamically adjusts the state of folder accessibility during the upload process. Different portions of the folder can be accessed at different times based on their upload status, with the system automatically managing which files are available for access and which are still being transferred, allowing flexible operation throughout the upload duration.
3Reliability
If a long secure connection is maintained for uploading large folders, then secure and accurate upload is achieved, but the complexity of managing long-duration connections increases
Solution Approach 1:
The upload connection is segmented into multiple shorter, manageable connection sessions rather than one long-duration connection. Each segment handles a specific portion of the folder upload, making connection management simpler and more reliable while maintaining security through encrypted individual sessions.
Solution Approach 2:
The system implements feedback mechanisms that monitor upload progress and connection status in real-time, automatically adjusting connection parameters, restarting failed segments, and managing connection lifecycles based on actual upload status. This feedback-driven approach simplifies connection management by automating the complexity of maintaining secure long-duration connections.
Data Source
AI summary
A cloud server includes a cloud storage for storing a folder uploaded to the cloud server, a database for storing administrative data; and a cloud service application. The cloud service application establishes a communication connection with an end point device to retrieve a user identification about the user, the end point device name, and folder name and location and stores this information in the database. A remote device communicates with the cloud server to access a folder stored on at least one of the endpoint device and the cloud storage. The cloud service application determines an authorized user and provides access to the folder by providing direct access to the endpoint device from the remote device utilizing the communication connection during uploading of the folder to the cloud, or directly to the cloud storage if the folder has been uploaded.