Container File System Thin Provisioning via Sparse Metavolume
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing complexity and volume of stored information in network file systems pose challenges for ensuring fast and reliable access, with the cost of administration, including software tools for hierarchical storage, data backup, and information lifecycle management, becoming a significant fraction of the total cost, and interfering with quick recovery from hardware or software errors.
Innovation Solution
A file server architecture that includes a container file system built on a sparse metavolume, allowing for thin provisioning and enhanced decoupling of logical storage from physical storage, with a slice map to manage storage allocation and provide common supplementary storage services for iSCSI block access and NFS or CIFS file system access, enabling efficient storage management and fault containment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional file replication and backup facilities are used to replicate and backup storage objects, then storage objects can be replicated and backed up without disruption of client access, but the complexity and volume of stored information increases, making administration costlier and recovery from errors slower
Solution Approach 1:
The storage system is segmented into multiple independent components: a container file system layer, a sparse metavolume layer, and a physical storage layer. This segmentation allows the container file system to manage multiple storage objects independently, enabling replication and backup operations without disrupting client access to any single object. The slice map structure further segments the management of storage allocation, making administration more manageable despite increased volume.
Solution Approach 2:
The patent implements a nested structure where the container file system contains multiple storage objects, which in turn contain slices that map to physical storage blocks. This nesting allows hierarchical management of storage objects, where replication and backup can be performed at different levels without affecting the entire system. The container file system acts as a parent container that manages child storage objects independently.
2Quantity of substance
If the volume of stored information increases to meet growing data demands, then more storage capacity is available, but the cost of administration including software tools for hierarchical storage, data backup, and information lifecycle management becomes a significant fraction of the total cost
Solution Approach 1:
The container file system provides universal management capabilities that work across all storage objects regardless of their type, size, or access patterns. A single unified structure handles storage allocation, replication, backup, and lifecycle management for all objects, eliminating the need for separate administration tools for each function. This multi-functional approach reduces administration costs despite increased storage capacity.
Solution Approach 2:
The slice map structure enables the system to automatically track and manage storage allocation, provisioning, and deprovisioning without requiring manual administration. The system self-manages the mapping between container file system objects, slices, and physical storage blocks, reducing the need for expensive software tools and manual intervention in hierarchical storage management.
3Quantity of substance
If the volume of stored information increases, then more data is available, but quick recovery from hardware or software errors becomes interfered with
Solution Approach 1:
The segmentation of storage into independent slices within the container file system means that errors in one slice or storage object do not propagate to other slices. The slice map allows rapid identification and isolation of corrupted sections, enabling quick recovery operations that do not require scanning the entire storage volume. This segmented architecture maintains recovery speed even as total storage capacity increases.
Solution Approach 2:
The slice map acts as an intermediary layer between the container file system and physical storage, providing a quick reference guide for locating and recovering specific storage blocks. During error recovery, the slice map enables rapid translation of logical addresses to physical locations, significantly accelerating recovery speed compared to scanning physical storage directly, regardless of the total volume of stored information.
4Adaptability or versatility
If thin provisioning is implemented to allocate storage blocks on-demand, then storage capacity is optimized, but a common mechanism for allocating storage blocks to both production file systems and snapshot copies is needed
Solution Approach 1:
The slice map structure provides universal storage allocation functionality that serves multiple purposes: allocating blocks to production file systems, creating snapshot copies, managing replication, and handling backup operations. A single data structure and allocation mechanism handles all these different storage needs uniformly, eliminating the need for separate allocation systems for each function while maintaining high flexibility.
Solution Approach 2:
The thin provisioning mechanism uses copying of the slice map structure and block allocation patterns to create snapshot copies efficiently. Instead of physically copying entire storage volumes, the system creates virtual copies by referencing the same physical blocks through the slice map, enabling fast snapshot creation while optimizing storage capacity usage. This copying approach maintains allocation flexibility without increasing complexity.
Data Source
AI summary
A container file system is built on a sparse metavolume for enhanced decoupling of logical storage from physical storage and for providing common supplementary storage services for iSCSI block access and for NFS or CIFS file system access. The container file system contains a production file system or iSCSI LUN and may also contain snapshot copies of the production file system or iSCSI LUN. The container file system manages storage space among the production file system or iSCSI LUN and its snapshot copies, and also improves fault containment. The sparse metavolume provides thin provisioning of the container file system. A slice map indicates whether or not each slice of logical storage in the sparse metavolume is provisioned with an associated configured slice of data storage.


