Tenant-Specific Storage Modules for Distributed Disk Sharding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed storage systems, such as Ceph, lack the ability to provide tenant-specific configurations for data storage, leading to shared storage device daemons and disk partitions, which can result in performance and failure isolation issues among tenants.
Innovation Solution
Implementing tenant-level sharding of disks with unique data storage modules per tenant, allowing for individual configurations based on subscription models and policies, enabling differentiated service levels and independent data storage management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple tenants share the same storage device daemons and disk partitions, then resource utilization is improved, but performance isolation and failure isolation between tenants deteriorate
Solution Approach 1:
The patent divides the storage system into tenant-specific segments by creating separate storage device daemons and disk partitions for each tenant. This segmentation allows each tenant to have isolated storage resources while still utilizing the same physical storage infrastructure, thereby maintaining resource utilization while achieving performance and failure isolation between tenants.
2Reliability
If tenant-specific storage modules are implemented, then performance isolation and failure isolation between tenants are improved, but system complexity increases
Solution Approach 1:
The patent implements a universal storage device daemon architecture that can serve multiple tenants through configuration rather than requiring completely separate daemon instances for each tenant. The storage device daemons are designed to handle multiple tenants' data with appropriate isolation mechanisms, reducing system complexity while maintaining performance and failure isolation.
3Ease of operation
If the same set of rules and weights apply to all tenants, then system management is simplified, but the ability to provide customized service levels to individual tenants deteriorates
Solution Approach 1:
The patent introduces dynamic configuration capabilities that allow storage device daemons to apply different rules, weights, and policies to different tenants based on their specific requirements. This dynamic approach enables customized service levels for each tenant while maintaining a unified management framework, balancing ease of operation with adaptability.
Data Source
AI summary
Embodiments include receiving an indication of a data storage module to be associated with a tenant of a distributed storage system, allocating a partition of a disk for data of the tenant, creating a first association between the data storage module and the disk partition, creating a second association between the data storage module and the tenant, and creating rules for the data storage module based on one or more policies configured for the tenant. Embodiments further include receiving an indication of a type of subscription model selected for the tenant, and selecting the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant. More specific embodiments include generating a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.