POSIX File System Layering for Consistent Cloud Object Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud object storage systems face limitations such as limited search ability, high latency, and non-compliance with local file system interfaces, making it costly and impractical to convert legacy applications to use object interfaces, while also compromising security due to encryption key management.

Innovation Solution

Layering file system functionality on cloud object interfaces, specifically implementing POSIX interfaces and semantics, to provide consistent file-based access and data organization in name hierarchies, while ensuring memory map consistency and using encryption with locally managed keys for enhanced security.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If cloud object storage is used, then storage elasticity and scale are improved, but interface compatibility and ease of operation deteriorate

Engineering Contradiction:
Improvestorage elasticityVSAvoidinterface compatibility
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a cloud interface appliance as an intermediary layer between the cloud object store and the local file system. This appliance translates file system operations into object storage operations, allowing legacy applications to use traditional file interfaces while accessing cloud storage. The appliance implements a translation layer that converts POSIX-compliant file operations into S3-compatible object operations, thus maintaining interface compatibility while leveraging cloud storage elasticity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If cloud object storage is used, then storage scale is improved, but access speed and productivity deteriorate

Engineering Contradiction:
Improvestorage scaleVSAvoidaccess speed
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments storage into two parts: frequently accessed data remains on local storage for fast access, while less frequently accessed data is moved to cloud object storage for scalable capacity. The cloud interface appliance manages this segmentation automatically based on access patterns, ensuring that hot data maintains fast access speeds while cold data utilizes the scalable cloud storage infrastructure.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If cloud object storage is used, then storage flexibility is improved, but security and reliability deteriorate

Engineering Contradiction:
Improvestorage flexibilityVSAvoiddata security
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The cloud interface appliance acts as a security intermediary that implements encryption for data transmitted between the local system and cloud storage. It manages encryption keys locally and ensures that data is encrypted before being uploaded to the cloud and decrypted only when accessed locally, thus maintaining data security while enabling flexible cloud storage access.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Adaptability or versatility

If legacy applications are converted to use object interfaces, then adaptability to cloud storage is improved, but device complexity and ease of manufacture worsen

Engineering Contradiction:
Improvecloud interface compatibilityVSAvoidapplication conversion complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Rather than requiring conversion of legacy applications, the patent introduces the cloud interface appliance as an intermediary that handles the translation from traditional file interfaces to object storage interfaces. This approach maintains application simplicity while achieving cloud compatibility, as the complexity of interface translation is encapsulated in the appliance rather than requiring application-level changes.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12174796B2Consistent file system semantics with cloud object storage
Publication Date: 2024.12.24 ORACLE INT CORP
  • US12174796B2 patent drawing
  • US12174796B2 patent drawing
  • US12174796B2 patent drawing

AI summary

Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes. For example, by transforming a ZFS file system disk-based storage into ZFS cloud-based storage, the ZFS file system gains the elastic nature of cloud storage.