Storage Virtualization Hydration Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud storage access and management processes are not seamless, as users must install software and deal with syncing issues between local devices and cloud storage, making file access less efficient compared to local storage.
Innovation Solution
Storage virtualization techniques create placeholders on local devices for files and directories, allowing them to appear as if stored locally, with a file system filter intercepting I/O requests and communicating with a storage virtualization provider to fetch data from the cloud when needed, using a user-mode library to simplify implementation and manage resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If cloud storage providers are used to store files remotely, then storage capacity and accessibility are improved, but file access efficiency and user experience deteriorate due to non-seamless access processes and syncing issues
Solution Approach 1:
A file system filter driver acts as an intermediary between applications and the storage virtualization provider. The filter driver intercepts I/O requests, manages placeholder files, and coordinates data retrieval from remote storage, making cloud storage transparent to applications while maintaining local storage performance characteristics
Solution Approach 2:
Placeholder files are created on local storage that replicate the metadata and structure of remote files. These placeholders appear as regular files to applications but actually point to remote storage locations, enabling seamless access without duplicating full file data locally
2Adaptability or versatility
If cloud storage software is installed on local devices to manage storage and retrieval, then storage management capability is improved, but device complexity and ease of operation worsen due to additional software layers and syncing issues
Solution Approach 1:
The storage virtualization provider automatically manages placeholder creation, data retrieval, and synchronization without requiring user intervention. The system self-manages the complexity of cloud storage operations while presenting a simple, transparent interface to applications and users
3Speed
If data is fetched from remote storage to local device, then file access speed is improved, but resource consumption increases due to hydration of placeholder files
Solution Approach 1:
Different parts of the storage system have different properties: placeholder files on local storage provide fast access for metadata and frequently used data, while remote storage handles less frequently accessed data. This hybrid approach optimizes both speed and resource usage by placing data in the most appropriate location
Data Source
AI summary
Storage virtualization techniques allow files and directories to be stored remotely, for example, by a cloud storage provider, but in a manner that appears to a user or application running on a local computing device as if the files are stored locally—even though the data of those files and directories may not be resident on the local computing device. That is, the contents of files and directories that may exist in the cloud look and behave as if they were stored locally on a computing device. The level of hydration of placeholders may be monitored and operations may be performed to reduce the impact of excessive hydration on the resources of the computing device.