Cloud File Resource Provisioning Across Shared Storage Nodes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies due to unnecessary write operations and lack of centralized control over storage processes, leading to reduced reliability and increased wear on storage devices.
Innovation Solution
Implementing a direct-mapped flash storage system where higher-level processes manage data operations without lower-level storage controllers, utilizing non-volatile RAM for fast write operations and proactive data management across multiple storage nodes, and employing erasure coding and mirroring for redundancy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional storage systems with lower-level storage controllers are used, then data operations can be managed at the controller level, but redundant write operations occur and device wear increases
Solution Approach 1:
The patent extracts the storage controller from the data path by implementing a direct-mapped flash storage system where higher-level processes manage data operations directly without lower-level storage controllers, eliminating redundant write operations and reducing device wear
Solution Approach 2:
The system implements self-service through proactive data management where the storage system monitors and reconstructs data before failures occur, using erasure coding and mirroring to automatically recover from errors without requiring controller intervention
2Duration of action of stationary object
If higher-level processes directly manage data operations in a direct-mapped flash storage system, then redundant writes are minimized and device lifespan is extended, but system complexity increases
Solution Approach 1:
The patent segments storage into multiple independent storage nodes, each with its own data operations, allowing higher-level processes to manage data directly without complex centralized controller logic, thereby extending device lifespan while managing complexity through distribution
Solution Approach 2:
The system performs preliminary actions by proactively managing data operations including pre-computing erasure coding redundancy and creating mirrors before failures occur, simplifying the overall system architecture by handling complexity in advance rather than requiring complex real-time controller decisions
3Reliability
If erasure coding and mirroring are employed for redundancy, then data integrity is ensured and reliability is improved, but storage capacity is reduced
Solution Approach 1:
The patent applies parameter changes by dynamically adjusting the level of redundancy (erasure coding ratios and mirror counts) based on data priority and access patterns, allowing the system to maintain data integrity while maximizing usable storage capacity through optimized redundancy parameters
Data Source
AI summary
A system for cloud-based file services, comprising: a plurality of single-tenant file system nodes configured to provide file system access to an object store via a plurality of multitenant storage nodes; the plurality of multitenant storage nodes sharing access to the object store; and one or more management nodes configured to provision resources for the plurality of single-tenant file system nodes and the plurality of multitenant storage nodes, including modifying resources within the system.