Data Governance Graph for Interconnected Dataset Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data governance systems lack efficient methods for creating visual representations of interconnected data sets, leading to difficulties in data management, security, and compliance.
Innovation Solution
A computer-implemented method and system for creating a data governance graph by receiving data sets from various sources, storing them in a catalog, determining common traits, generating representations of interconnections, and displaying these connections via a graphical user interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data sets are stored in a centralized catalog without visual representation, then data storage is simple, but data management efficiency deteriorates due to difficulty in understanding data relationships
Solution Approach 1:
The patent creates a visual copy (graphical representation) of the data catalog structure, showing data sets, traits, and interconnections in a visual format that preserves and communicates relationship information without altering the underlying data storage
Solution Approach 2:
The patent transforms the flat, one-dimensional data catalog into a two-dimensional visual graph with nodes and edges, adding a visual dimension that makes data relationships perceivable and manageable
2Reliability
If detailed data interconnections are tracked for security and compliance, then security and compliance monitoring improve, but system complexity increases
Solution Approach 1:
The patent implements a multi-functional system where the same data catalog and graph structure serve multiple purposes: data storage, relationship tracking, security monitoring, and compliance verification, reducing overall system complexity through consolidation
Solution Approach 2:
The patent introduces a graphical representation layer as an intermediary between the raw data catalog and the security/compliance monitoring functions, simplifying the interface and reducing complexity in the monitoring layer
3Measurement precision
If comprehensive data trait analysis is performed to identify common traits, then data classification accuracy improves, but processing time increases
Solution Approach 1:
The patent performs preliminary analysis to identify and extract common traits from data sets before creating the graphical representation, preparing classification information in advance to reduce processing time during graph generation
Data Source
AI summary
Systems and methods are disclosed for creating a governance graph representing data set interconnection. The data set interconnections may be based on common fields, sources, databases, applications, or patterns of usage. For example, the interconnections may be direct connections, where one data set is directly downstream from another data set. Alternatively, the interconnections may be indirect connections based patterns showing the data sets are commonly used together. For example, given data sets “A”, “B”, and “C”, if “B” is directly connected to “A” because it is downstream from “A”, and a particular group of users commonly use “B” and “C” together, “A” may be indirectly related to “C” based on the pattern of usage. In this example, the governance graph is configured to indicate the connection between “A” and “B” is stronger than the connection between “A” and “C”, whilst still showing said connection.