Entity Record Merging for Traceable Resolution and Faster Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in managing and analyzing entity records due to the presence of duplicative and multiple records associated with the same entity, leading to performance and accuracy issues during record analysis.
Innovation Solution
A data analysis and management platform utilizing machine learning embeddings and clustering to identify and merge related entity records, creating new merged records while retaining original individual records for traceability and compatibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple entity records are maintained for the same entity, then data completeness and traceability are improved, but system performance and analysis accuracy deteriorate due to excessive record comparisons
Solution Approach 1:
The patent segments entity records into individual source records and merged records. Individual records preserve original data for traceability, while merged records consolidate information for efficient analysis. This segmentation allows the system to maintain both data completeness and analysis performance by using the appropriate record type for each operation.
Solution Approach 2:
The patent introduces merged entity records as an intermediary layer between individual source records and analysis operations. These merged records aggregate information from multiple sources and serve as a mediator that enables efficient analysis without requiring direct comparison of all individual records, thus improving productivity while preserving traceability through links to source records.
2Reliability
If duplicative records are retained, then data source traceability is maintained, but system complexity and processing overhead increase
Solution Approach 1:
The patent merges information from duplicative individual entity records into consolidated merged entity records. This combining process reduces system complexity by eliminating redundant data while maintaining traceability through reference links to the original source records. The merged records provide a unified view without requiring the system to manage multiple duplicate copies.
Solution Approach 2:
The patent creates merged entity records that copy and consolidate information from individual source records while maintaining references to the originals. This copying approach allows the system to work with simplified consolidated data for analysis while preserving the ability to trace back to source records when needed, thus reducing complexity without sacrificing reliability.
3Measurement precision
If record comparison is performed across all entity records, then comprehensive analysis is achieved, but processing time and computational resources increase significantly
Solution Approach 1:
The patent performs preliminary merging of entity records into consolidated merged records before analysis operations. This preliminary action consolidates data in advance, creating a optimized structure that reduces the number of comparisons needed during subsequent analysis while maintaining comprehensive coverage through the merged information, thus reducing processing time without sacrificing analysis accuracy.
Solution Approach 2:
The patent transforms the data structure from a flat collection of individual records to a hierarchical structure with merged records that aggregate information from multiple sources. This dimensional change allows the system to perform analysis on consolidated data while preserving the ability to access underlying source records, effectively reducing the computational space required for comparisons while maintaining comprehensive analysis capability.
Data Source
AI summary
A plurality of entity records is received. The plurality of entity records are processed to determine one or more groups of related entity records included in the plurality of entity records. Each of the one or more groups of related entity records identify a corresponding common underlying entity. For a specific entity record group included in the determined one or more groups of related entity records, a new merged entity record is created. The new merged entity record merges elements of individual related entity records included in the specific entity record group is created while retaining the individual related entity records of the specific entity record group as separate stored records.