Audit Log Data Expansion for On-Demand External Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies in managing storage drives, particularly in flash-based systems, due to the need for lower-level processes by storage controllers, leading to unnecessary write operations and reduced reliability.
Innovation Solution
Implementing a direct-mapped flash storage system where higher-level processes, such as data block management and garbage collection, are handled by the operating system rather than storage controllers, reducing redundant operations and enhancing reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If storage controllers handle lower-level processes in traditional storage systems, then data management functions are centralized, but unnecessary write operations increase and reliability decreases
Solution Approach 1:
The patent extracts lower-level data management processes from storage controllers and relocates them to the operating system. Specifically, functions such as data block management, garbage collection, and wear leveling are moved from the storage controller to the OS, eliminating redundant write operations initiated by the controller and improving both reliability and write efficiency
Solution Approach 2:
The operating system takes on the responsibility of managing flash storage drives directly, performing self-service for data management tasks that were previously handled by storage controllers. The OS monitors and manages write operations, garbage collection, and wear leveling independently, reducing unnecessary intermediate write operations and improving overall system reliability
2Ease of operation
If storage controllers manage all lower-level processes, then centralized control is maintained, but system complexity increases
Solution Approach 1:
The patent extracts complex lower-level management functions from the storage controller and transfers them to the operating system. This reduces the complexity burden on the storage controller while maintaining centralized control through the OS, which has broader system context and can manage these functions more efficiently
Solution Approach 2:
The operating system serves multiple functions including both high-level file management and low-level flash storage management. By making the OS multi-functional in handling both user-space applications and storage-controller-space operations, the system eliminates the need for specialized complex storage controllers while maintaining ease of operation through unified OS management
Data Source
AI summary
An illustrative method includes a storage system storing audit data generated in an efficient binary format, the audit data associated with data operations within the storage system, detecting a request for a portion of the audit data, converting, based on the request, the portion of the audit data to an expanded data format configured for external use, and providing the converted portion of the audit data. In some embodiments, the storage system may process a request to access a pseudo-file as the request for the portion of the audit data.