Scalable Object Store With Heterogeneous File Arrays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional object systems are not scalable and typically do not offer file access, with existing systems often becoming bottlenecks in data storage and retrieval due to limitations in handling multiple heterogeneous file arrays and providing continuous availability during node failures.
Innovation Solution
A scalable objects store is provided through a storage provisioning engine that enables storage across multiple heterogeneous file arrays, allowing for dynamic addition and balancing of data without interruption, using a Virtual Storage Pool and partitioning scheme with B+ tree structures for efficient data management and load balancing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional object systems are used to store data, then data storage is provided, but the systems are not scalable and become bottlenecks in data storage and retrieval
Solution Approach 1:
The patent segments the storage system into multiple independent file arrays (first file array, second file array, etc.) that can be independently managed and accessed. Each array can be actively added or removed without affecting the entire system, enabling horizontal scalability while maintaining high data storage and retrieval efficiency through parallel access to multiple segmented storage units.
2Adaptability or versatility
If multiple heterogeneous file arrays are used to increase storage capacity, then scalability is improved, but system complexity and management difficulty increase
Solution Approach 1:
The patent implements a universal object interface that enables a single object to be stored across multiple heterogeneous file arrays with different formats and structures. The system provides unified object storage semantics that work consistently across diverse underlying storage arrays, allowing scalable storage capacity expansion without proportionally increasing management complexity through standardized object-level operations.
Solution Approach 2:
The patent introduces an intermediary layer that manages object storage across multiple heterogeneous file arrays. This intermediary handles the complexity of managing diverse arrays by providing a unified object interface, allowing the system to scale storage capacity across multiple heterogeneous arrays while the intermediary abstracts away the management complexity from users and applications.
3Adaptability or versatility
If nodes are added or removed from the system to scale capacity, then storage flexibility is improved, but system availability may be compromised during transitions
Solution Approach 1:
The patent enables preliminary actions to be taken when adding or removing file arrays from the system. The system can prepare for capacity changes in advance, maintaining object storage availability throughout the transition process. Objects can be proactively redistributed or access paths updated before physical array additions or removals occur, ensuring continuous system availability while providing storage scaling flexibility.
Data Source
AI summary
A computer implemented method, computer program product, and system for providing, via a storage provisioning engine, a scalable objects store enabled to store objects across multiple heterogeneous file arrays; wherein file arrays are enabled to be actively added to the object store without pausing the file arrays; and wherein data representing the objects enabled to be balanced across the heterogeneous file arrays based.