Multitenant Object Caching With OS-Managed Flash Block Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies in data management and reliability due to unnecessary write operations and lack of centralized control over storage processes, leading to reduced reliability and increased latency.
Innovation Solution
Implementing a direct-mapped flash storage system where the operating system directly manages data blocks without address translation by storage controllers, offloading device management responsibilities, and utilizing non-volatile RAM for quick data buffering and proactive data rebuilding across multiple storage nodes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If traditional storage controllers perform address translation and device management, then data access flexibility is improved, but system latency increases and reliability decreases due to redundant write operations
Solution Approach 1:
The patent extracts the address translation function from the storage controller and places it directly in the operating system. This removes the redundant translation layer that caused latency and reliability issues, allowing the OS to directly manage flash memory blocks without controller intervention for address mapping.
Solution Approach 2:
The patent introduces a buffer memory as an intermediary between the host system and flash memory storage. This buffer absorbs write operations and manages data flow, preventing direct redundant writes to flash memory while maintaining data integrity and reducing access latency.
2Ease of operation
If storage controllers manage all device operations, then device control capability is improved, but system complexity increases and productivity decreases
Solution Approach 1:
The patent extracts device management responsibilities from the storage controller and transfers them to the operating system. The OS directly manages flash memory blocks, eliminating the need for controller-mediated operations and significantly improving data management efficiency.
Solution Approach 2:
The operating system performs self-service by directly managing flash memory allocation and address translation without requiring storage controller intervention. This self-management approach reduces system complexity and improves productivity by eliminating redundant control layers.
3Reliability
If redundant write operations are performed for data safety, then reliability is improved, but energy consumption increases and loss of time occurs
Solution Approach 1:
The patent implements preliminary action by maintaining a buffer memory that pre-stores data before flash memory writes. This buffer absorbs write operations and allows batching, reducing the frequency of redundant writes to flash memory while maintaining data safety, thereby reducing energy consumption and write latency.
Data Source
AI summary
A system for cloud-based file services, comprising: a plurality of single-tenant file system nodes configured to provide file system access to an object store via a plurality of multitenant storage nodes; the plurality of multitenant storage nodes sharing access to the object store; and one or more management nodes configured to provision resources for the plurality of single-tenant file system nodes and the plurality of multitenant storage nodes, including modifying resources within the system.