Multi-tenant Storage Tiering for Query Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-tenant storage devices face challenges in consistently managing data storage across various tenants with different usage patterns, leading to inefficient query searches and storage strategies that do not benefit all customers equally.
Innovation Solution
A multi-tenant storage device determines object attributes' access frequency and size to dynamically adjust storage rules, spreading data objects across multiple tiers, with frequently accessed attributes on upper layers and less-used or larger data on lower tiers, optimizing query efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data objects are stored in a single storage area for each tenant, then data isolation and simplicity are maintained, but query efficiency and storage optimization are reduced
Solution Approach 1:
The patent segments data objects into multiple storage tiers (hot, warm, cold storage) based on access frequency and recency. Each tier serves different query patterns, with hot storage for frequently accessed data and cold storage for archival data, thereby improving query efficiency without compromising data isolation
Solution Approach 2:
The patent applies different storage characteristics to different portions of tenant data based on local access patterns. Frequently accessed attributes are stored in high-performance storage areas, while less accessed data is stored in lower-cost storage, optimizing both query efficiency and storage cost
2Loss of energy
If data is stored on multiple tiers based on recency, then storage cost optimization is improved, but query performance for diverse access patterns deteriorates
Solution Approach 1:
The patent implements dynamic tiering that adapts to each tenant's specific access patterns rather than using static recency-based rules. The system continuously monitors query patterns and dynamically adjusts data placement across tiers, ensuring that frequently accessed data remains in high-performance storage while optimizing storage costs for less accessed data
Solution Approach 2:
The system uses query pattern feedback to continuously optimize data placement. By monitoring which attributes and data objects are accessed most frequently, the system adjusts tiering decisions in real-time, balancing storage cost optimization with query performance maintenance
3Device complexity
If uniform storage rules are applied to all tenants, then system simplicity is maintained, but individual tenant optimization is reduced
Solution Approach 1:
The patent implements a universal multi-tenant storage system that simultaneously supports different storage strategies for different tenants. The system provides a unified interface while internally applying tenant-specific tiering rules based on individual access patterns, achieving both simplicity and adaptability
Solution Approach 2:
The system enables each tenant's data to self-optimize based on its own access patterns. By automatically monitoring and adapting to individual tenant query behaviors, the system provides tenant-specific optimization without requiring manual configuration or increasing operational complexity
Data Source
AI summary
Systems and methods for composite storage of data across tiers of a multi-tenant storage device are provided. In embodiments, a method includes determining attributes associated with each query in a set of queries; determining whether each of the attributes meet respective predetermined threshold values for a first storage tier, a second storage tier and a third storage tier based on statistical data generated for the attributes; updating storage rules for at least one of the first storage tier, the second storage tier and the third storage tier based on the determining; receiving data from the tenant for storage; dividing the data into at least a first portion and a second portion based on the storage rules; and storing the at least the first portion and the second portion on separate ones of the first storage tier, the second storage tier and the third storage tier based on the storage rules.