Database Archiving via Accelerator Mediator
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Managing large data volumes in enterprise data warehouses leads to increased disk space requirements, slower index access, and inefficient buffer pool management, as well as slower maintenance operations due to the need for high-quality storage and extensive indexing, which can impede access to archived data and require modifications to existing systems.
Innovation Solution
Archiving older data from a database management system to a separate accelerator system, allowing for transparent online access through the database management system without altering applications or queries, using a data warehouse accelerator to store old data and reduce the data volume in the database management system, thereby reducing index sizes and improving query performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data volume in the data warehouse is reduced by archiving, then storage costs and index size are reduced, but access to archived data may be impeded and existing access mechanisms may require modification
Solution Approach 1:
The patent introduces an accelerator system as an intermediary between the database management system and archived data. The accelerator system receives queries from the DBMS, determines whether archived data satisfies the queries, and retrieves the data if needed. This mediator enables transparent access to archived data without requiring modifications to existing DBMS or application access mechanisms.
2Productivity
If data is archived to a separate system, then storage costs are reduced and query performance for remaining data is improved, but access to archived data requires additional processing steps
Solution Approach 1:
The accelerator system performs preliminary actions by pre-determining whether archived data satisfies incoming queries before actual data retrieval. The system evaluates query conditions against archived data metadata in advance, so that when archived data needs to be accessed, the retrieval process can begin immediately without additional processing delays.
Solution Approach 2:
The accelerator system acts as an intermediary that handles the complexity of archived data access transparently. It receives queries from the DBMS, determines satisfaction of archived data, and retrieves data only when necessary, thereby minimizing access time while maintaining improved query performance for non-archived data.
3Reliability
If indexes are increased to handle more table rows, then data access completeness is improved, but index access speed decreases due to larger index size
Solution Approach 1:
The patent segments data into two categories: active data remaining in the database management system and archived data stored in the accelerator system. This segmentation allows indexes to be maintained only on the active data portion, keeping index sizes manageable and access speeds high, while still providing complete data access through the accelerator system's ability to query archived data when needed.
Data Source
AI summary
According to one embodiment of the present invention, at least a portion of data from a first processing system is archived onto a second processing system based on partitions of the data. A query received at the first processing system is processed at the second processing system to retrieve archived data satisfying the received query in response to determining at the first processing system that the received query encompasses archived data. Embodiments of the present invention further include methods, systems, and computer program products for archiving and accessing data in substantially the same manner described above.