Master Data Management Quarantine for Suspect Record Integrity

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Master data management (MDM) systems face challenges in determining whether overlay information received from trusted data sources is proper or potentially erroneous, leading to data corruption and integrity issues due to incorrect source ID assignments.

Innovation Solution

A computer-implemented method and system that determines when a transaction member record with a shared source identifier is linked to a different user, flags it as suspect, and creates an overlay task to unlink it from the composite data entity, storing it in a quarantine queue to prevent data corruption, thereby maintaining data integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the MDM system automatically merges customer records from multiple sources using source ID matching, then data consolidation efficiency is improved, but data integrity deteriorates when source IDs are incorrectly assigned

Engineering Contradiction:

Improvedata consolidation efficiencyVSAvoiddata integrity

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system performs preliminary validation checks on source ID assignments before merging records. When a source ID is encountered that could potentially cause incorrect merging, the system proactively flags the record for review before the merge operation completes, preventing data integrity issues before they occur.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms that monitor merge operations and automatically flag suspicious cases where source ID matching might lead to incorrect record consolidation. These flagged cases are then routed to the Quarantine Queue for manual review, creating a feedback loop that maintains data integrity while preserving automation efficiency.

Inventive Principle:

Principle #23Feedback

2Manufacturing precision

If the system performs manual review of all suspect records, then data quality control is improved, but processing time increases

Engineering Contradiction:

Improvedata quality controlVSAvoidprocessing time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system extracts only the suspect records that require manual review and places them in a separate Quarantine Queue, rather than requiring manual review of all records. This allows the majority of records to be processed automatically while isolating only the problematic cases for human intervention, minimizing time loss.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The Quarantine Queue serves as an intermediary mechanism between automated processing and manual review. It acts as a buffer that holds suspect records temporarily, allowing the system to maintain high-speed automated processing for confident cases while scheduling manual review only for ambiguous cases that truly need human judgment.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Speed

If the system allows automatic merging of records with matching source IDs, then consolidation speed is improved, but risk of data corruption increases

Engineering Contradiction:

Improveconsolidation speedVSAvoidrisk of data corruption

Core Design Contradiction:

SpeedVSObject-affected harmful factors

Solution Approach 1:

The system applies preliminary anti-action by implementing validation rules that prevent automatic merging when source ID assignments appear incorrect. Before the harmful effect of data corruption can occur, the system proactively identifies and blocks suspicious merge operations, counteracting the potential damage in advance.

Inventive Principle:

Principle #9Preliminary anti-action

Solution Approach 2:

The system converts the potentially harmful situation of incorrect source ID matching into a beneficial opportunity for quality control. By automatically detecting and flagging suspect records, the system transforms what could be data corruption events into learning opportunities that improve the overall merging process and identify patterns of incorrect source ID assignment for future prevention.

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS11556944B2System and methods for quarantining suspect data from integrated data

Publication Date: 2023.01.17 WALGREEN CO

AI summary

A master data management (MDM) computing device may determine that a first composite data entity that includes a first transaction member record assigned with a first source identifier for a first user by a data source is linked with a second transaction member record assigned with the first source identifier for a second user by the data source. The MDM computing device may flag the second transaction member record as a suspect record for corrupting the first composite data entity when a comparison between first information contained in the first transaction member record and second information contained in the second transaction member record exceeds a predetermined threshold. The MDM computing device may create an overlay task for the second transaction member record, thereby preventing the second transaction member record from corrupting the first composite data entity.