Secondary System Log Mirroring for Data Integrity Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In data replication environments, secondary storage systems often have underutilized computing resources, and analyzing production data for error diagnosis and correction creates additional overhead, leading to a tradeoff between data integrity and processing speeds.

Innovation Solution

A method that detects abnormal activity on a primary system by mirroring system logs to a secondary system, analyzing them, and taking snapshots of associated data sets for later analysis, allowing the secondary system to assist in tasks typically performed by the primary system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data analysis is performed on the production system, then data integrity is improved, but processing speed deteriorates due to additional overhead on CPU and DASD

Engineering Contradiction:

Improvedata integrityVSAvoidprocessing speed

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system divides data analysis functions into separate segments: the primary system continues production operations while the secondary system performs data analysis on mirrored data, eliminating the conflict between production and analysis overhead

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

A secondary system acts as an intermediary that receives mirrored production data, performs analysis operations, and returns results without directly interfering with the primary production system's CPU and DASD resources

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If computing resources are dedicated to production operations, then processing speed is improved, but data integrity monitoring deteriorates due to lack of resources for analysis

Engineering Contradiction:

Improveprocessing speedVSAvoiddata integrity monitoring

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system creates a copy of production data on a secondary system that can be analyzed without affecting the primary production system's processing speed, enabling continuous integrity monitoring alongside production operations

Inventive Principle:

Principle #26Copying

3Reliability

If the secondary system is used for failover readiness, then reliability is improved, but resource utilization deteriorates as computing resources remain underutilized

Engineering Contradiction:

Improvefailover capabilityVSAvoidresource utilization

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The secondary system is designed to perform multiple functions: it maintains failover readiness by mirroring production data while simultaneously performing data analysis operations, maximizing resource utilization without compromising reliability

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS11281694B2Remote data capture in data replication environments

Publication Date: 2022.03.22 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A method for more effectively utilizing computing resources in a data replication environment is disclosed. In one embodiment, such a method detects, at a primary system, activity occurring on the primary system. This activity is recorded in systems logs located at the primary system. The method automatically mirrors the system logs from the primary system to a secondary system that is in a mirroring relationship with the primary system. The system logs are analyzed at the secondary system. In the event abnormal activity is detected in the system logs at the secondary system, the method identifies, on the secondary system, a data set that is associated with the abnormal activity. A snapshot is taken of this data set and saved on the secondary system for later analysis. A corresponding system and computer program product are also disclosed.