Best Record Calculator Platform for Master Data Merging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current master data management processes for consolidating multiple records into a single electronic record are time-consuming and impractical, especially when dealing with a large number of records and input data sources, as they require sequential application of consolidation rules and multiple database queries.
Innovation Solution
A two-phase process involving duplicate identification and merging of records using a 'best record calculator platform' that applies survivorship rules to resolve conflicts, prioritizing data sources based on reliability and recency, and using a single query to construct best records, thereby reducing the need for temporary tables and improving performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sequential consolidation rules are applied with multiple database queries, then data accuracy is improved, but processing time increases
Solution Approach 1:
The patent applies preliminary action by pre-ranking source records according to survivorship rules before the actual consolidation process. Records are pre-sorted and prioritized based on reliability, recency, and other criteria, so that when consolidation occurs, the system already knows which records to prefer without needing multiple sequential queries to determine this during the merging process.
Solution Approach 2:
The patent segments the consolidation process into distinct phases: first ranking source records according to survivorship rules, then consolidating based on the predetermined ranking. This segmentation allows the system to separate the decision-making about record priority from the actual merging operation, improving both accuracy and efficiency.
2Manufacturing precision
If multiple consolidation rules are applied in sequence, then merging accuracy is improved, but system complexity increases
Solution Approach 1:
The patent changes the parameter of record prioritization from a dynamic, query-time determination to a static, pre-calculated ranking based on survivorship rules. By transforming the consolidation logic into a predetermined ranking system with configurable parameters (reliability weights, recency factors, etc.), the system achieves accurate merging without the complexity of multiple sequential rule applications.
Solution Approach 2:
The patent introduces an intermediary ranking mechanism that sits between the raw source records and the final consolidated record. This intermediary layer pre-processes and ranks records according to survivorship rules, serving as a mediator that simplifies the consolidation process by eliminating the need for complex sequential rule evaluation during merging.
3Reliability
If temporary tables are created for each consolidation step, then data integrity is maintained, but resource consumption increases
Solution Approach 1:
The patent applies preliminary action by pre-ranking all source records before consolidation begins, eliminating the need to create temporary tables during the merging process. The predetermined rankings allow the system to directly consolidate records in the correct order without intermediate storage requirements, reducing resource consumption while maintaining data integrity through the structured ranking approach.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
According to some embodiments, a plurality of source records may be received from a plurality of data sources, with each source record including a plurality of fields. It may be determined that a match group of source records from different data sources relate to the same entity, and a single best record may be automatically created for the match group based on field values from different source records in the match group. The creating may includes, for example, assigning a first set of fields to a first survivorship group associated with a first survivorship rule and a second set of fields to a second survivorship group associated with a second survivorship rule. All records in the match group may then be simultaneously ranked in accordance with the first and second survivorship rules using a single query. The best record could then be stored for subsequent use by other applications.