Serverless Storage Optimization via OS-Managed NVRAM Buffering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies in data management and storage operations, particularly in handling flash drives without integrated storage controllers, leading to unnecessary write operations and reduced reliability.
Innovation Solution
Implementing a direct-mapped flash storage system where the operating system initiates and controls processes, offloading device management from storage drives by using non-volatile random access memory (NVRAM) as a buffer for write operations and employing erasure coding for redundancy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional storage systems with integrated storage controllers are used, then device management is automated, but unnecessary write operations occur and reliability decreases
Solution Approach 1:
The patent extracts the storage controller functionality from the flash drive hardware and relocates it to the operating system software layer. This allows the OS to directly manage flash drives without intermediary controllers, eliminating redundant write operations and improving both reliability and write efficiency through direct OS control of storage operations
Solution Approach 2:
The patent introduces NVRAM as a buffer intermediary between the flash drive and the OS. Write operations are first buffered in NVRAM before being committed to flash memory, reducing direct write operations to the flash drive and improving write efficiency while maintaining data integrity
2Ease of operation
If storage controllers are integrated into flash drives, then device management is simplified, but data management efficiency decreases
Solution Approach 1:
The patent makes the operating system universally responsible for managing all flash drives without requiring dedicated controllers in each drive. The OS implements a unified file system and storage management layer that can handle multiple flash drives with different characteristics, improving data management efficiency through centralized intelligent control while maintaining ease of operation through standard OS interfaces
Solution Approach 2:
The patent enables flash drives to be managed directly by the OS without external controllers. The OS provides self-service management capabilities including file system management, wear leveling, and error handling, eliminating the need for dedicated storage controllers and improving data management efficiency through software-based optimization
3Reliability
If redundant write operations are performed, then data integrity is maintained, but storage operations become slower
Solution Approach 1:
The patent performs preliminary actions by buffering write operations in NVRAM before committing them to flash memory. This preliminary buffering allows the system to acknowledge writes quickly while maintaining data integrity, reducing the apparent write speed penalty without sacrificing reliability
Solution Approach 2:
The patent changes the operational parameters of flash drives by eliminating controller-mediated write operations and implementing direct OS control with NVRAM buffering. This parameter change reduces the number of redundant write cycles to flash memory, improving storage operation speed while maintaining data integrity through OS-managed error checking and correction
Data Source
AI summary
An illustrative method includes a storage-aware serverless function management system determining a status of a serverless system that implements one or more serverless functions configured to access one or more components of a storage system, determining a utilization of the storage system, and requesting that the storage system adjust storage of data in the storage system based on the status of the serverless system and the utilization of the storage system.