Archiving Process Layer for Safe Data Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in archiving information from transactional databases, particularly when replication systems do not have access to archived data, leading to incomplete or inaccurate analysis, and modifying source code of archiving applications is costly and impractical due to the numerous applications involved.
Innovation Solution
A process layer determines the archiving mode of applications and converts delete requests into copy and delete requests to ensure data is archived and replicated correctly, allowing analysis applications to access archived information without modifying the source code of archiving applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If delete requests are processed directly without conversion, then processing speed is improved, but data completeness for analysis deteriorates
Solution Approach 1:
The system performs preliminary action by converting delete requests into copy-delete pairs before actual deletion occurs. This ensures data is replicated to analysis systems before being removed from transactional systems, maintaining data completeness for analysis while enabling efficient processing.
Solution Approach 2:
The process layer acts as an intermediary between archiving applications and the database system. It intercepts delete requests, converts them to copy-delete pairs, and manages the replication process, thereby resolving the conflict between processing speed and data completeness without modifying application source code.
2Manufacturing precision
If source code of archiving applications is modified to handle replication, then data replication accuracy is improved, but implementation cost and complexity worsen
Solution Approach 1:
The process layer serves as an intermediary that handles replication logic centrally, eliminating the need to modify multiple archiving application source codes. This approach maintains high data replication accuracy while significantly reducing implementation complexity and cost.
Solution Approach 2:
The process layer provides universal functionality by handling replication for all archiving applications through a common mechanism. This multi-functional approach ensures consistent data replication accuracy across different applications without requiring application-specific modifications.
3Loss of information
If archiving process is performed before replication, then data availability for analysis is improved, but data consistency between systems worsens
Solution Approach 1:
The system performs preliminary replication action before deleting data from transactional systems. By converting delete requests to copy-delete pairs and executing the copy operation first, it ensures data is available in analysis systems before source data is removed, maintaining both availability and consistency.
Data Source
AI summary
A computer-implemented method for archiving information includes: executing a first application in a first process; determining that the first application is an archiving application configured to archive information stored in a transactional system; assigning, based on the determination, an archiving mode to the first process; receiving, from the first process and after assigning the archiving mode, a request to delete information; and processing the request to delete information according to the archiving mode.