Row-to-Column Data Archiving for Historical Traceability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data processing methods in databases often result in the loss of historical data, making it difficult to trace and maintain data integrity, as historical data is typically cleared without effective preservation mechanisms.
Innovation Solution
A data processing method that involves transferring target rows from a row-oriented database to a column-oriented database, where attribute values are stored in target pages, and then clearing the rows after a specified time, ensuring historical data is preserved and easily traceable.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If historical data is cleared from the database using related operations, then storage space is freed and database performance is improved, but historical data is lost and cannot be traced
Solution Approach 1:
The patent segments historical data into two storage locations: the original row-oriented database for current operations and a column-oriented archive database for historical preservation. This segmentation allows the main database to maintain performance while historical data is preserved separately for tracing purposes.
Solution Approach 2:
The patent introduces an intermediary archiving mechanism that transfers historical data from the row-oriented database to a column-oriented database. This intermediary process enables data to be moved systematically, preserving historical records while freeing up space in the primary database.
2Loss of information
If all historical data is preserved in the original database, then data tracing is enabled, but database complexity increases and performance degrades
Solution Approach 1:
The patent divides the database system into two specialized components: a row-oriented database optimized for current transactions and a column-oriented database optimized for historical storage and analysis. This segmentation reduces complexity in each individual database while enabling comprehensive historical tracing across both systems.
Solution Approach 2:
The patent adds a temporal dimension to data storage by implementing a data archiving mechanism that separates current and historical data across different storage dimensions. This allows the system to maintain operational simplicity while preserving historical data through a structured multi-dimensional approach.
3Loss of information
If data is transferred from row-oriented to column-oriented database, then historical data is preserved for tracing, but data processing time increases
Solution Approach 1:
The patent implements preliminary archiving by proactively transferring historical data to the column-oriented database before it is needed for analysis. This preliminary action prevents data from accumulating in the row-oriented database, reducing query times and avoiding the need for time-consuming data transfers when historical data is required.
Solution Approach 2:
The patent implements an automated archiving system that self-manages the transfer of historical data based on predefined criteria. This self-service mechanism operates independently, continuously archiving data without requiring manual intervention or causing performance degradation during peak operational periods.
Data Source
AI summary
This application discloses a data processing method and apparatus, a storage medium and an electronic device. The method includes: obtaining, by the electronic device, at least one target row to be cleared at a target time from a data table of a row-oriented database; storing target attribute values recorded in the at least one target row to target pages in a column-oriented database; and clearing the at least one target row after the target time arrives. The application resolves the technical problem that it is difficult to trace historical data in the related data processing technology.