Data Archiving System with Aggregate Size Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data archiving systems lack an efficient method to identify and prioritize datasets for archiving, leading to suboptimal storage savings and performance improvements.
Innovation Solution
A system that searches a datastore to find records based on given fields and values, aggregates data sizes, and renders these to a display for user selection, allowing for the archiving of specific datasets while providing visibility into storage savings and organizational impact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is retained in primary storage for long-term retention and compliance, then data availability and reliability are improved, but storage costs increase and system performance deteriorates
Solution Approach 1:
The patent segments data into different storage tiers based on access patterns and importance. Frequently accessed data remains in primary storage while less frequently accessed data is moved to archive storage, resolving the contradiction by separating data based on usage requirements.
Solution Approach 2:
The patent introduces an intermediary archiving system that sits between primary storage and long-term retention requirements. This intermediary layer provides compliant data retention with reduced performance impact by handling archival operations separately from primary data access paths.
2Productivity
If data is moved to archive storage, then storage costs are reduced and primary storage performance is improved, but data access time increases
Solution Approach 1:
The patent performs preliminary actions by proactively archiving data based on predicted future access patterns and compliance requirements before actual access is needed. This reduces the frequency of archival operations and minimizes access delays.
Solution Approach 2:
The patent implements feedback mechanisms that monitor data access patterns and automatically adjust archiving decisions. When archived data is accessed, the system learns from this behavior and adjusts future archiving decisions to prevent re-archiving of frequently accessed data.
3Reliability
If comprehensive data archiving is performed to meet compliance requirements, then regulatory compliance is improved, but system complexity and operational overhead increase
Solution Approach 1:
The patent enables the archiving system to automatically identify, categorize, and archive data based on built-in compliance rules and access pattern analysis. This self-service capability reduces operational overhead by eliminating manual intervention in archiving decisions while maintaining compliance assurance.
Data Source
AI summary
In one embodiment, a system includes a processor configured to search a datastore to find records including a given field with a given value, the found records defining a dataset for consideration for archive having an aggregate data size, render to a display an indication of the aggregate data size of the dataset for consideration for archive, receive a user selection to archive at least part of the dataset, and purge the at least part of the dataset from the datastore and archive the at least part of the dataset into archive storage responsively to receiving the user selection, and a memory configured to store data used by the processor.