Unified Metadata Graph for Siloed Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems require significant computational resources and cause data integrity issues when accessing siloed data across disparate locations due to the need for creating new data silos and reconfiguring computing systems, leading to inefficiencies and potential data corruption.
Innovation Solution
A unified metadata graph system that uses natural language processing to interpret user queries, determines relevant data silos through a metadata graph, and generates a visual representation of data objects, reducing the need for new silos and reconfiguration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If new data silos are created to store data for different computing systems, then data can be stored and accessed by each computing system, but computational resources are wasted and data integrity issues arise due to maintaining multiple copies
Solution Approach 1:
The patent creates a virtual copy of data through the metadata graph rather than physical copies in multiple silos. The metadata graph stores references and relationships to actual data locations, allowing multiple computing systems to access the same data without duplicating it physically, thus eliminating the need for redundant storage while maintaining data accessibility across systems
Solution Approach 2:
The metadata graph acts as an intermediary layer between computing systems and data silos. Instead of each computing system directly accessing and storing data in its own silo, the metadata graph mediates by providing a unified interface that resolves data locations and relationships, reducing the need for direct data duplication across multiple systems
2Adaptability or versatility
If data is stored in multiple data silos with different variable names and formats, then each computing system can access data according to its requirements, but data integrity is compromised and compute capacity is consumed to maintain consistency
Solution Approach 1:
The patent segments data access into two independent parts: the data itself remains in its original silos with its native variable names and formats, while the metadata graph segments the access layer to provide standardized references. This allows each computing system to access data according to its requirements without affecting the original data integrity in the silos
Solution Approach 2:
The metadata graph serves as an intermediary that translates between different data formats and variable names in various silos and the standardized access interface. It maintains the original data integrity in each silo while providing flexible access points that can adapt to different computing system requirements through metadata resolution
3Reliability
If computing systems are reconfigured to use unified data structures, then data consistency can be improved, but system complexity increases and downtime occurs during migration
Solution Approach 1:
Instead of reconfiguring computing systems to adopt unified data structures, the patent inverts the approach by keeping the original silo structures intact and creating a unified access layer through the metadata graph. This eliminates the need for system reconfiguration while achieving data consistency through the metadata layer
4Loss of energy
If existing data silos are replaced with a unified silo, then data redundancy is eliminated, but the effort to build and verify the new system is massive
Solution Approach 1:
The patent segments the data architecture into existing silos that remain unchanged and a new metadata graph layer that provides unification. This segmentation allows the system to leverage existing data infrastructure while adding unification capabilities, avoiding the massive effort of replacing entire silos
Solution Approach 2:
The metadata graph provides universal access to data across all existing silos with different variable names and formats. Instead of building a completely new unified silo, the metadata graph serves multiple functions: data location resolution, format translation, and consistency management, reducing the building effort while achieving resource efficiency
Data Source
AI summary
Systems and methods for reducing usage of computational resources when accessing siloed data across disparate locations via a unified metadata graph are disclosed. The system receives a user-specified query indicating a request to access a set of data objects. The system then performs natural language processing on the user-specified query to determine a set of phrases corresponding to the user-specified query. The system then accesses a metadata graph to determine a node corresponding to the set of phrases. Using a location identifier corresponding to the determined node, the system determines a data silo storing at least one data object of the set of data objects. The system then generates for display, on a graphical user interface, a visual representation of the at least one data object.