Data Element Validation in Storage Consistency Groups

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data replication environments like PPRC or XRC, data corruption can occur due to user errors, program bugs, or malicious activities, leading to undetected corruption that may be mirrored and overwrite valid data during replication, especially when copying data elements from a primary to a secondary storage system.

Innovation Solution

A method and system that validate data elements by reading them from a volume, determining their location, mapping it to a data set using a VTOC, and comparing identifiers like creation dates to ensure data integrity before copying, thereby preventing corrupt data from being overwritten.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data replication is performed without validation, then productivity is improved by faster data copying, but reliability deteriorates due to undetected data corruption being mirrored

Engineering Contradiction:
Improvedata copying speedVSAvoiddata integrity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary validation of data elements before replication by comparing identifiers (such as creation dates) between the data element and its associated data set. This advance validation prevents corrupt data from being replicated while maintaining efficient data copying operations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If data validation is performed by comparing identifiers, then reliability is improved by detecting data corruption, but device complexity increases due to additional validation steps

Engineering Contradiction:
Improvedata corruption detectionVSAvoidvalidation process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses identifier copying and comparison rather than full data validation. By storing and comparing compact identifiers (such as creation dates) instead of validating entire data sets, the system achieves reliable corruption detection while minimizing the complexity and overhead of the validation process.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If all data elements are validated before replication, then manufacturing precision is improved by ensuring data accuracy, but loss of time increases due to validation overhead

Engineering Contradiction:
Improvedata accuracyVSAvoidvalidation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system extracts only the essential identifier information (such as creation dates) from data elements for validation purposes, rather than validating the entire data set. This extraction approach ensures data accuracy through validation while significantly reducing the time overhead by working with minimal validation data.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10503417B2Data element validation in consistency groups
Publication Date: 2019.12.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10503417B2 patent drawing
  • US10503417B2 patent drawing
  • US10503417B2 patent drawing

AI summary

A method for validating data is disclosed. In one embodiment, such a method includes reading a data element from a volume. The method determines a location of the data element within the volume. This location is mapped to a particular data set stored on the volume, such as by mapping the location to the particular data set using a volume table of contents (VTOC) associated with the volume. The method further determines a first identifier (e.g., a creation date) associated with the particular data set and compares this first identifier to a second identifier (e.g., a creation date) appended to the data. If the first identifier matches the second identifier, the method validates the data. A corresponding system and computer program product are also disclosed.