Dynamic Update Strategy Selection for Database Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data synchronization systems in data analysis systems are inefficient as they often require manual interventions and knowledge of version-specific shortcomings, leading to potential downtime during replication setups, and lack optimal resource usage due to the use of a single update strategy for various types of database operations.

Innovation Solution

A method that receives log records from a source database system, determines the type of operation, and selects a pre-defined update strategy from a set of strategies to apply changes to a target database system, allowing for hybrid replication and automatic switching between strategies to handle errors and optimize resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a single update strategy is used for all database operations, then the system is simpler to implement, but resource usage is not optimized and efficiency decreases

Engineering Contradiction:
Improvedata synchronization efficiencyVSAvoidupdate strategy selection mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system dynamically selects update strategies based on the type of database operation being performed. Different operation types (DML, DDL, utility actions) are mapped to different update strategies, allowing the system to adapt its behavior to the specific requirements of each operation rather than using a static, one-size-fits-all approach

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of the update strategy based on the operation type. By analyzing log records and determining operation types, the system selects appropriate strategies (e.g., incremental updates for DML, bulk load for DDL), effectively changing the operational parameters to optimize resource usage and synchronization efficiency

Inventive Principle:
Principle #35Parameter changes

2Reliability

If manual interventions are required for replication setups, then errors can be corrected, but downtime increases and operational complexity increases

Engineering Contradiction:
Improvereplication setup reliabilityVSAvoiddowntime during replication
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs self-diagnosis and self-correction by automatically detecting errors in log record processing and selecting alternative update strategies without manual intervention. The error handling mechanism allows the replication process to continue autonomously, reducing downtime and operational complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops where error conditions are detected, alternative strategies are selected, and the system continues operation. This closed-loop control ensures reliability while minimizing downtime by automatically responding to errors rather than requiring manual intervention

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If version-specific shortcomings are manually managed, then replication accuracy can be maintained, but operational complexity and time loss increase

Engineering Contradiction:
Improvedata replication accuracyVSAvoidreplication setup ease
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system automatically handles version-specific issues by detecting operation types from log records and selecting appropriate update strategies without requiring manual knowledge of version-specific shortcomings. This maintains replication accuracy while significantly improving ease of operation

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11704335B2Data synchronization in a data analysis system
Publication Date: 2023.07.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11704335B2 patent drawing
  • US11704335B2 patent drawing
  • US11704335B2 patent drawing

AI summary

A computer implemented method comprises receiving at least one log record. A type of operation performed in a source database system may be determined based on the log record. Based on the type of operation, an update strategy may be selected from a set of pre-defined update strategies, wherein the update strategy specifies a sequence of replication operations to be performed in order to apply changes described in the at least one log record to a target database system.