Thin Provisioned Storage Server Snapshot Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large-scale storage systems face challenges in efficiently managing storage capacity and snapshots due to the complexity and memory overhead of tables used for thin provisioning and snapshot management, leading to reduced performance and wasted space as storage capacity increases.
Innovation Solution
Implementing flexible virtual address translation and data structures like volume tables and system volume tables to support direct and indirect address mapping, enabling efficient tracking of provisions and snapshots, and reducing granularity to minimize waste and enhance performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional tables and data structures are used for thin provisioning and snapshot management, then storage capacity and snapshot management are achieved, but memory footprint increases and performance decreases
Solution Approach 1:
The patent divides the storage management system into multiple hierarchical levels: volume tables for virtual to physical address translation, system volume tables for snapshot management, and a unified allocation bitmap for space tracking. This segmentation allows each structure to manage specific aspects efficiently, reducing overall memory requirements while supporting large storage capacities and numerous snapshots
Solution Approach 2:
The patent introduces indirect address translation through system volume tables as an additional dimensional layer between virtual addresses and physical storage addresses. This intermediate structure enables efficient snapshot management and space reuse without requiring direct tracking of all snapshot data in memory, thereby reducing memory footprint while maintaining functionality
2Quantity of substance
If storage capacity increases, then more data can be stored, but the size and access complexity of management tables increases
Solution Approach 1:
The patent segments address translation into multiple levels: direct mapping in volume tables for simple cases and indirect mapping through system volume tables for snapshot-related operations. This segmentation allows the system to handle large storage capacities by distributing the mapping overhead across multiple structures rather than relying on a single large table
Solution Approach 2:
The system volume tables act as intermediaries between virtual address space and physical storage, providing a manageable layer for snapshot management. This intermediate structure simplifies access complexity by centralizing snapshot-related mappings and enabling efficient space reuse algorithms to operate on a smaller, more manageable data structure
3Reliability
If the number of snapshots increases, then data protection and backup capabilities improve, but system performance and memory usage increase
Solution Approach 1:
The patent segments snapshot management into dedicated system volume tables that track only the metadata and space allocation information for snapshots, rather than maintaining all snapshot data in memory. This segmentation allows the system to support numerous snapshots for data protection while maintaining good performance by keeping only essential snapshot management information in memory
Solution Approach 2:
The patent implements space reuse mechanisms where blocks allocated to snapshots can be discarded from active use and recovered for new allocations when snapshots are deleted or when space becomes available. This recovering mechanism allows the system to maintain performance by dynamically reallocating space rather than reserving it permanently, enabling support for many snapshots without linear performance degradation
Data Source
AI summary
Technologies for high capacity storage servers with thin provisioning can support an increased storage capacity and an increased number of snapshots within a data storage system while maintaining a reduced memory footprint. Flexible virtual address translation can support both direct, and indirect, translation from a virtual address to an address in physical storage. A data structure, referred to as a volume table, may be provided for supporting the virtual to physical address translation. Multiple volume tables for the various volumes within a data storage system can be stored together in a global volume table. Granularities of storage allocation units, such as territories, provisions, and chunks can be reduced to improve efficiencies in the operation of the storage system. Processes for handling volume and snapshot I/O operations with various data structures can contribute to improved efficiencies while supporting increased storage capacities and an increased number of snapshots.