POSIX File Hierarchy Layer for Cloud Object Store Consistency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud object storage systems face limitations such as limited search ability, high latency, and non-compliance with local file system interfaces, making it difficult to integrate legacy applications and ensure data security and integrity.
Innovation Solution
Layering file system functionality on cloud object interfaces, specifically using POSIX interfaces and semantics, to provide cloud-based storage that mimics traditional file system access, while ensuring data integrity and security through features like memory mapping, compression, encryption, deduplication, snapshots, and clones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If cloud object storage is used, then scalability and elasticity are improved, but latency and search ability deteriorate
Solution Approach 1:
The patent segments cloud storage operations into two layers: a file system layer that handles local caching and a cloud object storage layer that provides scalable storage. This segmentation allows frequently accessed data to be cached locally (reducing latency) while maintaining the scalability of cloud storage for the overall system.
Solution Approach 2:
The patent introduces a file system as an intermediary layer between applications and cloud object storage. This intermediary provides local caching, caching metadata, and file system semantics, thereby reducing the latency of cloud storage operations while preserving the scalability benefits of object storage.
2Quantity of substance
If cloud object storage interfaces are used, then storage capacity is improved, but compatibility with legacy applications deteriorates
Solution Approach 1:
The patent uses a file system as an intermediary that translates between traditional file system interfaces (POSIX semantics) and cloud object storage interfaces. This allows legacy applications to continue using familiar file system calls while the underlying storage operates as scalable cloud object storage.
Solution Approach 2:
The patent makes the file system layer serve multiple functions: it provides compatibility interfaces for legacy applications, implements local caching to reduce latency, manages data organization, and interfaces with cloud object storage. This multi-functionality resolves the contradiction between maintaining compatibility and enabling modern cloud storage capabilities.
3Adaptability or versatility
If data is stored in cloud object storage, then storage elasticity is improved, but data integrity and security control deteriorate
Solution Approach 1:
The patent segments data management functions between local and cloud components. The local file system layer maintains integrity checks, caching policies, and security controls, while the cloud object storage layer provides elastic storage capacity. This segmentation allows the system to benefit from cloud elasticity while maintaining local control over data integrity.
Data Source
AI summary
Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes.