Hash-Based File Storage in Cloud Computing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed storage systems, such as cloud-based environments, lack an efficient and scalable mechanism for storing and retrieving large quantities of unique files, leading to inefficiencies in file management and duplication detection.
Innovation Solution
Implementing a method that uses unique hash codes to organize files, ensuring only a single copy of each file is stored, and employing a URI naming scheme based on hash codes for fast insertion and retrieval, while utilizing a hierarchical file structure to distribute files evenly across storage accounts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If distributed storage systems store large quantities of files without structure, then storage capacity is increased, but file retrieval efficiency deteriorates
Solution Approach 1:
The patent segments the file storage system by dividing files into different categories based on their hash values and storing them in separate containers. This segmentation allows for efficient retrieval by narrowing down the search space when querying for specific files, thus improving retrieval efficiency while maintaining large storage capacity.
Solution Approach 2:
The patent introduces a hash function as an intermediary mechanism that maps file content to unique identifiers and determines storage locations. This intermediary enables fast file retrieval by computing hashes and using them to directly locate files in the hierarchical structure, avoiding linear search through large file collections.
2Device complexity
If distributed storage systems use simple storage mechanisms, then system complexity is reduced, but duplication detection capability deteriorates
Solution Approach 1:
The patent implements self-service duplication detection by having the system automatically compute hash values for uploaded files and compare them against existing files. The hash computation and comparison process is performed autonomously by the storage system without requiring manual intervention, enabling reliable duplication detection while keeping the interface simple.
Solution Approach 2:
The patent changes the parameter used for file identification from simple filenames to hash values derived from file content. This parameter change enables the system to detect duplications based on actual content rather than names, improving reliability while the hash computation remains a straightforward cryptographic operation that doesn't significantly increase system complexity.
3Ease of operation
If files are stored with original names, then ease of operation is improved, but scalability deteriorates
Solution Approach 1:
The patent creates a copy of the original filename and stores it alongside the hash value and file data. This copied filename is then used for user-friendly access while the hash-based structure provides scalability. Users can access files using their original names through the copied filename mapping, while the system internally uses hashes for efficient storage and retrieval, thus maintaining both ease of operation and scalability.
Data Source
AI summary
Storing and retrieving files based on hashes for the files. One method for storing files includes: identifying a file; identifying a hash calculated based on the file; renaming the file based on the hash based on the file; and storing the file in a particular location based on the hash calculated based on the file. Another method for retrieving files includes: identifying a hash for a given file; using the hash, traversing a hierarchical file structure to find a location where the given file should be stored; determining that the file is at the location; and as a result, retrieving the file.