Globally Unique Identifier Mapping for Distributed Data Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge lies in efficiently correlating and retrieving information from diverse data sources, including public and private data, due to differences in data structures, attribute labels, and formats, which hinders effective information retrieval and analysis.
Innovation Solution
A system and method utilizing globally unique identifiers (GUIDs) are introduced to map text strings to unique identifiers, storing these mappings along with relationship data and meta-data, enabling correlation and retrieval of information across multiple data sources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple data sources are accessed using custom interfaces and protocols, then each data source can be accessed with its specific format, but the system complexity increases significantly
Solution Approach 1:
The patent implements a universal interface that can access multiple different data sources (public web data, private data, subscription databases) through a single standardized protocol. This universal interface translates various data formats and protocols into a common internal representation, eliminating the need for multiple custom interfaces while maintaining compatibility with diverse data sources.
Solution Approach 2:
The patent introduces an intermediary layer (the universal interface and correlation engine) that mediates between the user's search request and the multiple underlying data sources. This intermediary handles format translation, protocol adaptation, and data normalization, shielding users from the complexity of individual data source interfaces while enabling access to diverse sources.
2Productivity
If data from multiple sources is pre-processed to index to a searchable index, then search efficiency improves, but the time and resources required for data preparation increase
Solution Approach 1:
The patent performs preliminary actions by assigning globally unique identifiers (GUIDs) to data sources and entities during the data ingestion phase. This preliminary tagging and identification allows for efficient correlation and retrieval operations later without requiring extensive pre-processing of the actual data content. The GUIDs are assigned in advance to enable quick matching and joining operations.
Solution Approach 2:
The patent changes the parameter of data representation by transforming diverse data formats into a standardized internal format with uniform GUID-based identification. This parameter change allows the system to maintain search efficiency without requiring extensive pre-processing, as the standardized format enables efficient indexing and correlation operations.
3Ease of operation
If data structures and attribute labels are standardized across sources, then data correlation becomes easier, but the flexibility to accommodate source-specific formats is reduced
Solution Approach 1:
The patent applies local quality by maintaining source-specific data formats and attribute labels at the source level while introducing a universal GUID-based identification system. Each data source retains its local characteristics and formatting, but the GUIDs provide a common reference framework that enables correlation across sources without requiring standardization of the actual data content or source-specific formats.
Data Source
AI summary
In a particular embodiment, a method includes sending a text string from a source device to a destination device. The destination device includes a unique identifier repository having a plurality of globally unique identifiers mapped text strings, relationship data defining associations between the plurality of globally unique identifiers, and meta-data related to the text string. Each of the plurality of globally unique identifiers includes a data value that is shared by a plurality of data sources as an identifier associated with information related to the text string. The method further includes receiving data including one or more globally unique identifiers, associated relationship data, and associated meta-data from the destination device at the source device in response to sending the text string. Additionally, the method includes storing the received data at a memory of the source device for use in searching and relating search results received from multiple data sources.