Secondary Transaction Log for External Database Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transfer systems, particularly change data capture (CDC) systems, face challenges in accurately synchronizing data between source and target database systems when non-logged changes occur, leading to inconsistencies in external database systems.
Innovation Solution
The method involves creating a secondary transaction log that receives data changes from the target database system, creating log entries for each change, and providing this log to external database systems for applying data changes, thereby ensuring consistent data storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a primary transaction log is used for data synchronization between source and target database systems, then data consistency is maintained, but external database systems cannot access data changes
Solution Approach 1:
The patent divides the transaction log functionality into separate components: a primary transaction log for source-target synchronization and a secondary transaction log for external system access. This segmentation allows each log to serve its specific purpose independently, resolving the contradiction between maintaining data consistency and enabling external access.
Solution Approach 2:
The secondary transaction log acts as an intermediary between the target database system and external database systems. It captures data changes from the target system and makes them available to external systems without interfering with the primary synchronization process, thus enabling external access while preserving data consistency.
2Productivity
If change data capture (CDC) systems apply only changed data, then transfer efficiency is improved, but non-logged changes are missed leading to inconsistencies
Solution Approach 1:
The secondary transaction log serves as an intermediary that captures all data changes including non-logged changes from the target database system. By reading from the target system's internal logs and forwarding these changes to external systems, it ensures complete data capture without missing any modifications, thus maintaining synchronization accuracy while preserving CDC efficiency.
Solution Approach 2:
The system creates a copy of the transaction log data in the secondary log, which then serves external systems. This copying mechanism ensures that external systems receive accurate replicas of all data changes without affecting the primary CDC process, maintaining both efficiency and accuracy.
3Adaptability or versatility
If a secondary transaction log is created to enable external system access, then external database access is enabled, but system complexity increases
Solution Approach 1:
The secondary transaction log is designed to serve multiple external database systems simultaneously, providing a universal interface for external access. This multi-functional approach consolidates what could be multiple separate access mechanisms into a single standardized log structure, reducing overall system complexity while maintaining versatility.
Data Source
AI summary
The present disclosure relates to a method for enabling access to data of a data analysis system by a set of one or more external database systems. The data analysis system comprises a source database system and target database system. The data analysis system is configured for synchronizing the data in the source database system with the target database system using a primary source transaction log in the source database system. The method comprises: creating a secondary transaction log. Data changes applied at the target database system may be received from the target database system. At least one log entry that represents each received data change may be creating in the secondary transaction log. The secondary transaction log may be used by the set of external database systems for applying data changes according to the secondary transaction log, thereby storing the data in the set of external database systems.