Database Transaction Log Replay Synchronization Mechanism

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Database systems face challenges in maintaining synchronized data between primary and secondary systems during load balancing operations, which can lead to inconsistent responses and require additional processing resources, increasing costs and complexity.

Innovation Solution

A synchronization mechanism that involves receiving transaction log information from a primary database system, parsing it with start and end markers to ensure proper serialization of operations, and replicating these operations in a secondary database system to maintain data consistency and support load balancing without disrupting the hot-standby functionality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the secondary database system actively responds to queries during load balancing operations, then hardware resource utilization is improved, but data consistency between primary and secondary systems deteriorates

Engineering Contradiction:
Improvehardware resource utilizationVSAvoiddata consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system applies preliminary action by pre-replicating transaction log information from the primary database system to the secondary database system before query operations occur. This ensures that the secondary system has up-to-date data in advance, allowing it to safely respond to queries while maintaining data consistency. The transaction log replay mechanism prepares the secondary system's data state beforehand, eliminating the risk of serving stale or inconsistent data during load balancing operations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If transaction log information is replayed continuously to maintain data consistency, then data synchronization is improved, but system complexity increases

Engineering Contradiction:
Improvedata synchronizationVSAvoidsynchronization mechanism complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses copying by creating simplified replicas of transaction log records with start and end markers that capture essential operation boundaries. Instead of complex transaction protocols, the invention copies transaction essence into marker-based log entries that can be efficiently replayed. This copying approach maintains data synchronization through simple marker replication rather than complex coordination mechanisms, reducing system complexity while ensuring reliability.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If start and end markers are used to serialize operations, then operation correctness is improved, but processing overhead increases

Engineering Contradiction:
Improveoperation serialization correctnessVSAvoidprocessing overhead
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system applies parameter changes by transforming transaction log records into a standardized format with start and end marker parameters. This parameterization allows operations to be serialized through simple marker detection and state transitions rather than complex locking protocols. The start marker triggers operationbeginning state changes, and the end marker triggers operation completion state changes, providing precise serialization control through minimal parameter-based state transitions that reduce processing overhead compared to traditional locking mechanisms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10762107B2Synchronization mechanism for serialized data log replay in database systems
Publication Date: 2020.09.01 SAP SE
  • US10762107B2 patent drawing
  • US10762107B2 patent drawing
  • US10762107B2 patent drawing

AI summary

A computer implemented method for updating a secondary database includes receiving transaction log information from a primary database system at a secondary database system. The transaction log information comprises a first marker identifying a beginning of an operation comprising a plurality of sub-operations and a second marker identifying an end of the operation. The transaction log information is sequentially parsed, a first marker is identified, and a lock state is created after replaying the first marker to ensure proper serialization of the plurality of sub-operations. The lock state is terminated after replaying the second marker. Related apparatus, systems, techniques and articles are also described.