Network Storage System for Download-Intensive Environments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network storage systems face challenges in efficiently sharing and managing secure data due to asymmetrical bandwidth ratios and the difficulty in using content addressable storage (CAS) with different encryption keys among users.
Innovation Solution
A data storage server (DSS) system that monitors network transactions, indexes data packets with client identification, and uses content addressable storage (CAS) to enable secure data sharing by storing data temporarily and permanently based on client-specific virtual file systems, while implementing a proprietary secure sharing mechanism to handle encrypted data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a central location after download, then data availability is improved, but upload bandwidth consumption increases due to asymmetrical bandwidth ratios
Solution Approach 1:
The system performs preliminary indexing of downloaded data packets with client identification before permanent storage. The DSS monitors and captures data packets from the download-intensive network, indexes them with unique client IDs, and stores them in temporary storage associated with the client identification. This preliminary organization enables efficient retrieval without requiring full re-uploads.
Solution Approach 2:
The Data Storage Server acts as an intermediary between the download-intensive network and the permanent storage system. It captures data packets, indexes them with client IDs, and manages the transfer to permanent storage only when complete sets are received, eliminating the need for clients to re-upload data.
2Productivity
If content addressable storage is used with encrypted data, then storage efficiency is improved, but security is compromised when different users use different encryption keys
Solution Approach 1:
The system segments the storage process into temporary storage with client-specific indexing and permanent storage with completeness verification. Each client's data packets are indexed with their unique client ID and stored in their designated temporary storage space, maintaining security while enabling efficient content-addressable retrieval.
Solution Approach 2:
The system applies different storage and indexing strategies to different clients based on their specific encryption keys and data characteristics. Each client has their own temporary storage space indexed with their unique client ID, allowing customized security and efficiency optimization for each user while maintaining overall system security.
3Loss of time
If data packets are stored immediately upon receipt, then access time is reduced, but storage space is wasted before all packets are received
Solution Approach 1:
The system performs preliminary indexing and temporary storage of data packets as they are received, organized by client ID. This preliminary action enables rapid access to available data while the system continues to receive remaining packets, and triggers permanent storage only when completeness is verified, optimizing both access time and space utilization.
Solution Approach 2:
The storage system dynamically adjusts between temporary and permanent storage based on the completion status of data packet sets. Incomplete data remains in temporary storage with client-specific indexing for rapid access, while complete data sets are transitioned to permanent storage, optimizing space utilization based on real-time conditions.
Data Source
AI summary
A network storage system for a download intensive environment is provided. The network storage comprises at least a data storage server (DSS) that includes an interface enabling connection of the DSS to a network at a location that enables at least a view of network transactions performed by a plurality of clients; a storage unit; and a system adapted to monitor the network transactions occurring on the network and identification of the network transactions as belonging to a registered client of the DSS, and storing in the storage the transactions with an identification corresponding to the registered client.