Active Archive Bridge Data Tiering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges in efficiently managing and consolidating increasing volumes of data, as existing methods like compression and new storage techniques are insufficient to fully address the capacity strain, necessitating improved data storage techniques.
Innovation Solution
A solution that connects a primary data storage system with an external active archive system, utilizing a hierarchical storage system with multiple tiers and logic for data movement based on events and policies, allowing data to be automatically moved between storage tiers based on usage and retention policies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored in primary storage system to maintain quick access, then access speed is improved, but storage capacity and cost increase
Solution Approach 1:
The storage system is segmented into multiple tiers: primary storage system for frequently accessed data and active archive storage system for less frequently accessed data. This segmentation allows the system to maintain quick access speed for active data while reducing the quantity of high-capacity primary storage required by moving inactive data to archive storage.
Solution Approach 2:
The system adds a temporal dimension to storage management by implementing hierarchical storage with different access speeds and costs. Data is dynamically moved between primary and archive storage based on access patterns and retention policies, creating a multi-dimensional storage architecture that optimizes both speed and capacity utilization.
2Quantity of substance
If data is moved to lower-cost storage tiers, then storage cost is reduced, but data access time increases
Solution Approach 1:
The system performs preliminary actions by proactively moving data to appropriate storage tiers based on predicted access patterns, retention policies, and data classification. Event detection mechanisms trigger data movement before access is needed, ensuring that frequently accessed data remains in primary storage while reducing costs by moving inactive data to archive storage.
Solution Approach 2:
The system implements feedback mechanisms through event detection that monitors data access patterns, file age, and retention policy compliance. This feedback triggers automatic data movement between storage tiers, optimizing the balance between access time and storage cost by continuously adapting to changing data usage patterns.
3Productivity
If manual data management is used, then system complexity is reduced, but productivity and efficiency decrease
Solution Approach 1:
The system implements self-service through automated event detection and policy-based data movement. The active archive storage system autonomously monitors primary storage for events such as file creation, modification, and access patterns, then automatically moves data between tiers based on retention policies without requiring manual intervention, thereby improving productivity while managing complexity through automation.
Solution Approach 2:
The system changes parameters by implementing event detection mechanisms that monitor multiple data attributes (file age, access frequency, retention policy compliance) and dynamically adjust data placement based on these parameters. This automated parameter-based management improves efficiency by replacing manual processes while managing complexity through systematic decision rules.
Data Source
AI summary
A primary data storage system is connected with a separate and external active archive storage system to consolidate data and allow active archive data to be managed based on primary storage system events. The primary data storage system may be managed and maintained by an external entity, and may include a manager module such as a resource manager. The active archive system may include several tiers of storage in a hierarchical storage system and logic for moving data between and among the tiers. As data processing milestones are completed or the state of data changes, in projects stored in the primary data storage system, task milestone or state change events are detected. Event detection can trigger data movement in the active archive solution. One or more software modules implementing the present invention may detect the events and trigger active archive operations based on the events.