Graphical Record Matching Replay for Data Quality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The process of matching and consolidating records in data quality programs is time-consuming and expensive, especially when dealing with large datasets, and it is difficult for data stewards to understand why certain records are matched while others are not, leading to inefficiencies and the need for manual intervention.
Innovation Solution
A graphical record matching process replay is provided through a data quality user interface, allowing users to visually understand the matching process by displaying the application of match rules and criteria in a step-by-step manner, enabling adjustments and improvements to the matching configuration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated record matching processes are used to handle large datasets, then productivity is improved, but understanding of the matching process deteriorates
Solution Approach 1:
The patent introduces an intermediary visualization layer between the automated matching engine and the data steward. This layer includes graphical displays showing match scores, rule applications, and record comparisons, allowing stewards to understand the automated process without manual review of each record pair.
Solution Approach 2:
The system provides feedback mechanisms where data stewards can review match results, understand why records were matched or not matched through visualized rules and scores, and provide feedback to refine matching parameters. This creates a closed-loop system that maintains transparency while preserving automation.
2Measurement precision
If manual review of matching processes is performed to understand match decisions, then measurement precision is improved, but loss of time increases
Solution Approach 1:
Instead of requiring complete manual review of all matching processes, the system applies partial action by allowing data stewards to selectively review only those match decisions that fall within configurable confidence thresholds or exhibit unusual patterns. The majority of clear-cut matches are processed automatically without manual intervention.
Solution Approach 2:
The patent replaces the mechanical process of manual record-by-record review with an automated system that provides visualized decision support. Graphical interfaces display match scores, applied rules, and key differences, enabling rapid assessment without manual analysis of each field comparison.
3Manufacturing precision
If complex matching rules are applied to improve match accuracy, then manufacturing precision is improved, but device complexity increases
Solution Approach 1:
The patent segments complex matching rules into modular, independently configurable components. Each matching rule can be defined, enabled, or disabled separately through a graphical interface, allowing data stewards to manage complexity by selecting only the rules relevant to their specific data quality requirements without being overwhelmed by the full rule set.
Data Source
AI summary
According to some embodiments, a plurality of records may be received, and a data quality platform may execute a matching process to match at least some records with each other. A replay request associated with at least two of the received records may be received from a user, and information about the at least two records and a first decision in the matching process may be graphically displayed via a user interface. A result of the first decision in the matching process may then be graphically displayed to the user. Similarly, information about the at least two records and a second decision in the matching process, subsequent to the first decision, may be graphically displayed in the user interface. A result of the second decision in the matching process may then be graphically displayed to the user.