File Identifier Lookup for Archived Storage Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Archived files in secondary storage systems, such as cloud storage, often result in unnecessary access delays and costs due to the lack of local copies on primary storage, leading to inefficient file retrieval processes.
Innovation Solution
A method that generates and manages file identifiers using a defined hash function to determine if a local copy of an archived file exists on primary storage, allowing for the retrieval of a local copy instead of accessing the secondary storage, thereby reducing access delays and costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of stationary object
If files are archived in secondary storage systems, then storage capacity is improved, but file retrieval speed deteriorates
Solution Approach 1:
The system pre-computes and stores file identifiers (hash values) in reference files within the primary storage system before archiving. When a file is requested, the system first checks the primary storage for the file identifier, determining whether the file exists locally before accessing secondary storage. This preliminary check prevents unnecessary remote access and accelerates file retrieval when files are available locally.
2Loss of energy
If files are archived in secondary storage systems, then operational costs are reduced, but access delays increase
Solution Approach 1:
The reference file acts as an intermediary between the primary and secondary storage systems. It contains file identifiers that serve as a lookup mechanism, allowing the system to determine file availability in the primary storage without directly accessing the secondary storage. This intermediary structure eliminates the need for costly and time-consuming remote access when files are available locally.
3Speed
If local copies of archived files are maintained on primary storage, then file retrieval speed is improved, but storage capacity utilization deteriorates
Solution Approach 1:
The system creates and stores copies of file identifiers (hash values) in reference files within the primary storage. These identifiers enable the system to quickly determine whether full file copies exist locally or need to be retrieved from secondary storage. This copying approach provides fast lookup capability without requiring the entire file to be permanently resident in primary storage.
Data Source
AI summary
Files can be managed to mitigate undesirable reading of files from secondary storage component (SSC) associated with a storage system comprising primary storage component (PSC). File management component (FMC) can determine file identifiers for files stored in SSC and store them in reference files associated with such files. FMC can determine file identifiers for files stored in PSC and store them in a file entry data store. In response to a client request, FMC can determine whether a local file stored in PSC is a copy of an archived file stored in SSC based on whether the respective file identifiers of the archived file and local file or snapshot of the local file match. If there is a suitable match, FMC can read the snapshot of the local file and provide it to client device; if not, FMC can read the archived file and provide it to client device.