Shuffling File Digests in Distributed Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-tenant environments, managing content provisioning for distributed file systems is challenging due to difficulties in maintaining the security and authenticity of file digests, particularly in cloud computing environments where attackers can infer physical storage locations and tamper with files.
Innovation Solution
Implementing a shuffle index that periodically shuffles the distribution of file digests across multiple data stores, using a tree structure like a B+-tree, to obfuscate physical storage locations while maintaining logical structure, thus decoupling storage location from file digest, enhancing security and authenticity verification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If file digests are stored in a distributed file system with fixed physical locations, then retrieval efficiency is improved, but security is worsened because attackers can infer physical storage locations and tamper with files
Solution Approach 1:
The patent applies dynamics by making the physical storage locations of file digests changeable over time through periodic shuffling operations. The shuffle index dynamically repositions file digests across different data stores, preventing attackers from inferring permanent locations while maintaining efficient retrieval through logical address mapping.
Solution Approach 2:
The patent introduces a shuffle index as an intermediary layer between the logical file system and physical storage locations. This mediator decouples the logical address space from physical storage locations, allowing efficient retrieval through logical addresses while hiding actual physical locations from attackers.
2Object-affected harmful factors
If file digests are shuffled across multiple data stores, then security is improved by obfuscating physical locations, but system complexity is worsened
Solution Approach 1:
The patent segments the file system into two distinct layers: a logical address space for efficient file access and a physical storage layer with shuffled locations. The shuffle index acts as a segmentation boundary, managing the complexity of location mapping while presenting a simple logical interface to users.
Solution Approach 2:
The patent implements periodic shuffling operations that reposition file digests across data stores at scheduled intervals. This periodic action maintains security by continuously obfuscating physical locations while allowing the system to return to a known state between shuffles, managing complexity through predictable cycles.
3Reliability
If physical storage locations are obfuscated through shuffling, then authenticity verification is improved, but access time is worsened due to location determination overhead
Solution Approach 1:
The patent performs preliminary actions by maintaining the shuffle index that maps logical addresses to physical locations before access requests arrive. The system pre-computes and stores location mappings, so when authentication is needed, the physical location is already known without requiring real-time determination overhead.
Data Source
AI summary
A method includes receiving, at a content provisioning system from one or more client devices, one or more requests for file digests stored in respective data stores of a plurality of data stores in a distributed file system. The file digests are distributed across different ones of the plurality of data stores in the distributed file system. The method also includes determining a location of a given one of the requested file digests in one or more of the plurality of data stores and retrieving the given file digest from the determined location. The method further includes shuffling the distribution of the file digests across the plurality of data stores in the distributed file system.