Trust Metadata Association for Data Repository Reliability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data repositories face challenges in ensuring the trustworthiness of data due to varying trust levels of source infrastructure, leading to unreliable query results and increased liability, with no existing mechanisms to assess or manage trust characteristics across data sources.
Innovation Solution
The implementation of trust characteristics management techniques that associate and store trust metrics, scores, and attributes of storage infrastructure as metadata within data repositories, enabling the assessment of data trustworthiness and query reliability by tracing lineage and providing confidence measures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is collected from diverse data sources, then data repository functionality and query capabilities are improved, but data trustworthiness deteriorates due to varying reliability of source infrastructure
Solution Approach 1:
The patent segments the trust assessment by separating data from its source infrastructure characteristics. Each data element is associated with metadata that independently captures trust characteristics of its source infrastructure, allowing the data repository to maintain versatility while enabling differentiated trust assessment for each data element based on its source reliability.
Solution Approach 2:
The patent introduces trust metadata as an intermediary between data sources and the data repository. This metadata layer captures and transmits trust characteristics from source infrastructure to the data repository, enabling the repository to accept data from diverse sources while maintaining awareness of their varying reliability levels through the intermediary metadata structure.
2Reliability
If trust characteristics of source infrastructure are tracked and stored as metadata, then data trustworthiness assessment is improved, but device complexity and storage requirements increase
Solution Approach 1:
The patent makes the trust metadata structure universal by designing it to work across different data types and source infrastructure systems. The same metadata framework can capture trust characteristics from various sources (databases, files, cloud services) without requiring source-specific implementations, reducing overall system complexity while maintaining comprehensive trust assessment capability.
Solution Approach 2:
The patent nests trust metadata within the existing data repository structure, embedding trust information at the data element level. This nesting approach integrates trust characteristics into the existing data storage framework without creating separate complex systems, allowing trust metadata to be stored alongside data while leveraging the existing repository infrastructure.
3Reliability
If trust characteristics are associated with data sets, then query reliability is improved, but processing time and computational overhead increase
Solution Approach 1:
The patent performs preliminary action by capturing and storing trust characteristics at the time of data ingestion into the repository. Trust metadata is extracted and associated with data elements before they are stored, so that when queries are executed later, the trust information is already available and does not need to be computed or fetched in real-time, reducing query processing time while maintaining reliability.
Solution Approach 2:
The patent creates a copy of trust characteristics as metadata that travels with the data through the repository. Instead of continuously querying source infrastructure for trust information during query processing, the system uses pre-captured trust metadata copies that are stored with the data, enabling fast query execution while maintaining accurate reliability assessment.
Data Source
AI summary
One or more trust characteristics are obtained. The one or more trust characteristics are attributable to a storage infrastructure from which one or more data sets stored in one or more data repositories are obtained. The one or more trust characteristics attributable to the storage infrastructure are associated with the one or more data sets such that the one or more data sets are characterized as having a trustworthiness reflective of the one or more trust characteristics. The one or more trust characteristics and the association with the one or more data sets are stored as metadata in the one or more data repositories.