Metadata Management for Storage Disk Pools
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage server systems face challenges in efficiently managing metadata for virtual volumes, particularly in maintaining persistent storage and allocating metadata blocks on-demand, which affects the flexibility and scalability of virtual volume provisioning.
Innovation Solution
A system configured with a processor and memory that stores metadata blocks in persistent storage, using a data structure of multiple bits to indicate whether blocks are free or occupied, allowing for efficient allocation, relocation, and deletion of metadata blocks, and managing metadata blocks through a metadata structure with sets and virtual volume record blocks to optimize storage pool management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If metadata blocks are managed using traditional allocation methods, then storage capacity is provided, but metadata management efficiency and flexibility are reduced
Solution Approach 1:
The patent segments the storage pool into multiple sets of metadata blocks, where each set is independently managed. This segmentation allows the system to allocate and manage metadata blocks in smaller, more efficient units rather than treating the entire storage pool as a single entity, thereby improving metadata management efficiency while maintaining organized complexity
Solution Approach 2:
The patent pre-allocates metadata blocks from the storage pool before they are actually needed for virtual volume operations. By preparing metadata blocks in advance and maintaining a pool of available metadata blocks, the system eliminates allocation delays during runtime operations, improving overall metadata management efficiency
2Quantity of substance
If storage pools are expanded by adding more disks, then storage capacity increases, but metadata management complexity increases
Solution Approach 1:
The patent creates a universal metadata management mechanism that works independently of the number of disks in the storage pool. The same metadata block allocation and management processes apply whether the pool contains a few or many disks, allowing storage capacity to scale without proportionally increasing management complexity
Solution Approach 2:
By dividing the storage pool into multiple independent sets of metadata blocks, the system can scale storage capacity by adding disks while keeping each metadata set's complexity manageable. Each set can be independently allocated and managed, preventing overall system complexity from becoming unmanageable as capacity grows
3Adaptability or versatility
If metadata blocks are allocated on-demand, then provisioning flexibility improves, but allocation overhead increases
Solution Approach 1:
The patent performs preliminary allocation of metadata blocks from the storage pool before they are needed for specific virtual volume operations. By pre-establishing the pool of available metadata blocks and organizing them into sets, the system maintains provisioning flexibility while eliminating the time overhead of allocation decisions during runtime
Solution Approach 2:
The system dynamically allocates metadata blocks from pre-established sets based on actual provisioning needs. The metadata block sets are organized and ready for allocation, allowing the system to adapt to different provisioning scenarios while using efficient lookup and allocation processes that minimize overhead
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing metadata for pools of storage disks, are described. In some implementations, a system includes a processor, a memory and a storage system. The storage system contains a storage pool including multiple storage devices. Further, the storage system is configured to store in persistent storage associated with the storage pool a bitmap that is configured to indicate whether metadata blocks corresponding to one or more virtual volumes associated with the storage pool are free or occupied. In addition, the processor is configured to perform operations including accessing at least portions of the bitmap, and managing, based on information from the accessed portions, at least some of the metadata blocks stored in the persistent storage.