Scalable Data Management System Using Dynamic Storage Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection solutions, such as tape-based systems and disk archive management systems, face limitations in scalability, flexibility, and performance as storage capacity increases, leading to inefficiencies and degradation in data management operations.
Innovation Solution
A scalable data management system comprising a cell manager, storage control circuitry, and multiple storage devices, which allows for dynamic allocation of resources, load balancing, and data migration to maintain optimal performance and capacity, using client agents and archive agents to manage data storage and retrieval efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If disk archive management systems are used to provide increased flexibility and operational speeds, then configurability and speed are improved, but scalability deteriorates as storage capacity is consumed and additional disks are added
Solution Approach 1:
The system is divided into multiple independent storage devices (disk arrays) that can be individually managed and scaled. Each storage device operates semi-independently under the coordination of the backup controller, allowing the system to grow by adding more storage devices without requiring complete system redesign or management overhead to increase proportionally.
Solution Approach 2:
The patent introduces a hierarchical management structure with a backup controller that operates at a higher abstraction level, managing multiple storage devices through a unified namespace. This dimensional shift from individual device management to pool-based management allows scalability without linearly increasing management complexity.
2Quantity of substance
If additional disks are added to accommodate increased storage requirements, then storage capacity is improved, but device complexity and resource limitations worsen
Solution Approach 1:
The backup controller implements a universal management interface that handles multiple storage devices through a common protocol and namespace. This multi-functional approach allows the same control logic to manage any number of storage devices, preventing management complexity from increasing linearly with storage capacity.
Solution Approach 2:
The patent introduces a storage manager as an intermediary layer between the backup controller and individual storage devices. This mediator abstracts the complexity of managing multiple disks, presenting a simplified interface to higher-level systems while handling the intricacies of device coordination, load distribution, and capacity management.
3Device complexity
If tape based systems are used to provide data protection solutions, then design simplicity and reduced cost are improved, but flexibility and speed deteriorate
Solution Approach 1:
The patent replaces the mechanical tape-based sequential access system with an electronic disk-based random access system. This substitution maintains data protection capabilities while dramatically improving speed and flexibility, as disk systems can rapidly seek and retrieve data without the physical constraints of tape reels and linear access patterns.
Data Source
AI summary
Data management systems, articles of manufacture, and data storage methods are described. According to one aspect, a data management system provides a data storage system configured to store data of a plurality of client protected computer systems, wherein the data storage system comprises a plurality of storage devices individually having a respective capacity, and a quantity of the data of the protected computer systems to be stored exceeds capacities of individual ones of the storage devices and storage control circuitry coupled with the data storage system and configured to assign individual ones of the individual storage devices to store data for respective ones of the protected computer systems.