Data Discovery Service with Global Term Annotations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems fail to effectively facilitate the discovery and utilization of data due to lack of methods to capture, share, and interpret user interactions with data, leading to inefficient data search and usage, as well as inconsistent data structures and descriptions across different sources.
Innovation Solution
A computer-implemented system that captures and stores associations of data with vocabularies, allowing for the annotation of data sources with global terms, enabling enriched data discovery and consumption by linking relevant data sources and providing a centralized data store for consolidated views and enriched metadata.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is structured and described in unique ways for specific applications, then data can be optimized for that application's needs, but new users must spend time and resources parsing the data to understand what it is and how to use it
Solution Approach 1:
The patent applies preliminary action by pre-annotating data sources with vocabularies and metadata before users access them. The annotation component receives and processes vocabulary associations with data sources in advance, storing this information in the data store. When users request data, the interface component retrieves pre-prepared annotations, eliminating the need for users to manually parse and understand data structures.
2Adaptability or versatility
If data is made freely accessible and integrated into new uses, then data availability increases, but users may not know the data exists or how to find it using proper search terms
Solution Approach 1:
The patent introduces an intermediary layer consisting of vocabularies and annotations that mediate between raw data sources and users. The annotation component creates associations between data sources and standardized vocabularies, storing these in the data store. The interface component then uses these annotations to present data in contextually relevant ways, helping users discover and understand data without needing to know the underlying data structures or search terminology.
3Productivity
If multiple users employ the same data sources for different applications, then data utility increases, but there is no method to capture, learn from, and share user applications and interpretations of data
Solution Approach 1:
The patent implements feedback by capturing user interactions with data and using this information to improve data annotations. The system monitors how users access and use annotated data sources, then feeds this information back to refine vocabulary associations and metadata. This continuous feedback loop enables the system to learn from user applications and interpretations, making data more useful for future users while preserving valuable usage insights.
Data Source
AI summary
The subject disclosure relates to one or more computer-implemented processes for collecting, analyzing, and employing annotations of data sources. In particular, an annotation component is configured to receive annotations of data for a data source, wherein the respective annotations comprise different associations of a global terms with the data of the data source, a data store configured to store the annotations, and an interface component configured to render the data based on the annotations in response to a request for the data. In an aspect, storing information, the data also stores descriptions of the data sources and definitions of the global terms, and the interface component determines a subset of the information in the data store based on the annotations. A method is further provided comprising receiving a global term and determining data sources that have the global term associated with the data thereof based on the information in the data store.