Database Storage Lifecycle Control for Automated Stale Data Deletion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional database systems require manual and table-specific deletion tasks, which are time-consuming, prone to errors, and result in unnecessary retention of stale data, wasting storage resources.
Innovation Solution
A deletion criterion is defined by an administrator and applied to multiple tables, with periodic execution, transferring eligible data to temporary storage and providing historical execution information, thus optimizing data deletion and resource utilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual and table-specific deletion tasks are used, then data deletion can be performed, but the process is time-consuming and prone to errors
Solution Approach 1:
The system implements self-service through automated deletion tasks that execute based on predefined criteria without requiring manual intervention. The deletion task system automatically identifies, selects, and removes data according to stored criteria, eliminating the need for manual table-by-table deletion operations and reducing both time consumption and human error.
Solution Approach 2:
The system applies preliminary action by pre-defining deletion criteria and storing them in advance. These predefined criteria enable automated deletion tasks to be executed without manual setup each time, allowing the system to prepare and execute deletion operations based on pre-established rules, thereby reducing execution time and improving consistency.
2Loss of substance
If manual deletion tasks are performed for each table, then specific data can be deleted, but storage resources are wasted due to unnecessary retention of stale data
Solution Approach 1:
The system implements universality by creating a single deletion task framework that can be applied across multiple tables and data types. The deletion task system stores and executes deletion criteria universally, allowing one unified approach to handle data deletion across the entire database system rather than requiring separate manual tasks for each table, thereby optimizing storage resource utilization.
Solution Approach 2:
The system applies parameter changes by storing deletion criteria as configurable parameters that can be adjusted based on different data characteristics. These parameters (such as retention periods, data types, or specific conditions) allow the system to adapt deletion behavior to different tables and storage scenarios, enabling optimized storage resource utilization without increasing operational complexity.
3Ease of operation
If table-specific deletion tasks are created, then data can be deleted from specific tables, but the process is prone to errors and requires significant effort
Solution Approach 1:
The system applies segmentation by dividing the data deletion process into distinct components: predefined deletion criteria, automated task execution, and result verification. This segmentation allows the system to handle complex deletion operations across multiple tables through modular, manageable units, reducing operational effort while maintaining accuracy through systematic execution of predefined rules.
Data Source
AI summary
Systems and methods are provided for controlling the deletion of data in a database system. The system receives input comprising a deletion criterion for a database system. The system applies the deletion criterion to a set of tables of the database system. The system determines that an individual portion of the set of tables satisfies the deletion criterion. In response to determining that the individual portion of the set of tables satisfies the deletion criterion, the system transfers the individual portion of the set of tables to a temporary storage system.