POSIX File System Layering for Consistent Cloud Object Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud object storage systems face limitations such as limited search ability, high latency, and non-compliance with local file system interfaces, making it costly and impractical to convert legacy applications to use object interfaces, while also compromising security due to encryption key management.
Innovation Solution
Layering file system functionality on cloud object interfaces, specifically implementing POSIX interfaces and semantics, to provide consistent file-based access and data organization in name hierarchies, while ensuring memory map consistency and using encryption with locally managed keys for enhanced security.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If cloud object storage is used, then storage elasticity and scale are improved, but interface compatibility and ease of operation deteriorate
Solution Approach 1:
The patent introduces a cloud interface appliance as an intermediary layer between the cloud object store and the local file system. This appliance translates file system operations into object storage operations, allowing legacy applications to use traditional file interfaces while accessing cloud storage. The appliance implements a translation layer that converts POSIX-compliant file operations into S3-compatible object operations, thus maintaining interface compatibility while leveraging cloud storage elasticity.
2Adaptability or versatility
If cloud object storage is used, then storage scale is improved, but access speed and productivity deteriorate
Solution Approach 1:
The patent segments storage into two parts: frequently accessed data remains on local storage for fast access, while less frequently accessed data is moved to cloud object storage for scalable capacity. The cloud interface appliance manages this segmentation automatically based on access patterns, ensuring that hot data maintains fast access speeds while cold data utilizes the scalable cloud storage infrastructure.
3Adaptability or versatility
If cloud object storage is used, then storage flexibility is improved, but security and reliability deteriorate
Solution Approach 1:
The cloud interface appliance acts as a security intermediary that implements encryption for data transmitted between the local system and cloud storage. It manages encryption keys locally and ensures that data is encrypted before being uploaded to the cloud and decrypted only when accessed locally, thus maintaining data security while enabling flexible cloud storage access.
4Adaptability or versatility
If legacy applications are converted to use object interfaces, then adaptability to cloud storage is improved, but device complexity and ease of manufacture worsen
Solution Approach 1:
Rather than requiring conversion of legacy applications, the patent introduces the cloud interface appliance as an intermediary that handles the translation from traditional file interfaces to object storage interfaces. This approach maintains application simplicity while achieving cloud compatibility, as the complexity of interface translation is encapsulated in the appliance rather than requiring application-level changes.
Data Source
AI summary
Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes. For example, by transforming a ZFS file system disk-based storage into ZFS cloud-based storage, the ZFS file system gains the elastic nature of cloud storage.


