Storage Stack Filter Delete Notification Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems do not effectively utilize delete notifications to free up storage resources, as they treat both valid and deleted data similarly, leading to unnecessary operations and resource usage.
Innovation Solution
Implementing a storage stack filter that receives delete notifications, determines if they apply to the entire storage device, and takes specific actions to free up resources by modifying or creating new notifications to exclude unnecessary data and operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If delete notifications are sent to storage devices, then storage devices can reduce internal operations on invalid data, but storage devices still perform unnecessary operations on deleted data when no delete notification is received
Solution Approach 1:
The filesystem performs delete operations in advance and sends delete notifications to the storage device before the storage device would otherwise perform operations on the deleted data. This preliminary notification allows the storage device to avoid unnecessary background operations on invalid data, resolving the contradiction between maintaining data integrity and avoiding waste of resources on deleted data.
2Productivity
If delete notifications are implemented between filesystem and storage device, then resource management is improved, but system complexity increases due to additional communication protocols
Solution Approach 1:
The delete notification mechanism is designed to work across multiple layers of the storage stack (filesystem, storage driver, storage device) using a universal notification format. This multi-functional approach allows the same notification infrastructure to serve delete notification, wear leveling optimization, and garbage collection coordination purposes, reducing overall system complexity despite the added functionality.
3Reliability
If storage devices treat all data the same way regardless of validity status, then data integrity is maintained, but storage resources are wasted on invalid data
Solution Approach 1:
The storage device receives feedback in the form of delete notifications from the filesystem about which data blocks are no longer valid. This feedback mechanism allows the storage device to differentiate between valid and invalid data, enabling it to perform recovery operations only on valid data while freeing storage resources from invalid data, thus resolving the contradiction between maintaining data integrity and optimizing storage resource usage.
Data Source
AI summary
A delete notification can be received at a storage stack filter in a storage stack. It can be determined whether the delete notification applies to an entire storage device. If the delete notification does not apply to the entire storage device, a first set of actions can be taken with the storage stack filter in response to the delete notification. If the delete notification does apply to the entire storage device, a second set of actions can be taken with the storage stack filter in response to the delete notification.