Real-Time Database Replication via Log File Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing database replication systems, such as Oracle DBMS, increase the load on the source server by using data extractors to transmit changed-data, and require additional hardware costs for maintaining archive logs, complicating failure recovery.
Innovation Solution
The system minimizes source server load by transmitting redo and archive log files in real-time from the source to the target server, where they are temporarily stored and replicated, eliminating the need for data extraction and reducing hardware requirements by using log synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data extractor is used to transmit changed-data from source to target server, then data replication is achieved, but load on source server increases
Solution Approach 1:
The patent extracts the log file transmission function from the source server's data extraction process. Instead of extracting changed-data through complex queries and transmissions that burden the source server, the system extracts and transmits only the necessary log files (redo logs and archive logs) that contain the change information, significantly reducing the source server's processing load while maintaining replication capability.
Solution Approach 2:
The patent introduces log files as an intermediary mechanism between the source and target servers. Rather than direct data extraction and transmission, the log files serve as a buffer and transmission medium, allowing the source server to write changes to logs without direct interaction with the target server, thus reducing the source server's operational load.
2Reliability
If archive log storage is implemented for data replication, then data synchronization is maintained, but hardware costs increase
Solution Approach 1:
The patent makes the log files serve multiple functions: they act as transaction logs for data integrity, as transmission media for replication, and as backup storage for recovery. This multi-functionality eliminates the need for separate dedicated storage systems for each purpose, reducing overall hardware requirements while maintaining data synchronization and reliability.
Solution Approach 2:
The patent merges the functions of data logging, data transmission, and data backup into a single log file system. By combining these functions, the system reduces the total hardware resources needed compared to having separate systems for each function, while still achieving reliable data synchronization between source and target servers.
3Productivity
If complex data extraction and transmission process is used, then data replication is achieved, but system complexity increases
Solution Approach 1:
The patent segments the data replication process into distinct, manageable components: log file generation by the source server, log file transmission through the network, and log file processing by the target server. This segmentation simplifies each individual component's complexity while maintaining the overall replication functionality, making the system easier to implement and maintain.
Data Source
AI summary
Provided are an apparatus and a method for replicating changed-data in a source database management system to a target database management system in real time, for minimizing the load on the source DBMS system, reducing costs for DBMS hardware configuration, and facilitating operation and failure recovery. The source server transmits the changed-data from a redo log file or an archive log file in a source DBMS area to a target server in real time, and the target server receives the changed-data transmitted from the source server to temporarily store the changed-data in a local area, and extracts the change data stored in the local area to replicate the extracted changed-data to the target DBMS, thereby implementing the apparatus for replicating the changed-data in the source database management system to the target database management system in real time.