Data Governance Graph for Visualizing Dataset Interconnections
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data governance systems lack effective methods for managing and governing digital assets, leading to inefficiencies and resource wastage due to the lack of a visual or structural representation of data interconnectedness, which hinders proper data management, security, and compliance.
Innovation Solution
Implementing a data governance graph that visually represents interconnections between data sets based on common traits, policies, and usage patterns, using a computer-implemented method to generate and display a governance graph that highlights connections and recommends additional data sets with common traits.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data governance systems manage digital assets without visual representation, then data management processes become complex and inefficient, but implementing visual representation increases system complexity
Solution Approach 1:
The patent creates a visual copy (graphical user interface representation) of the data asset interconnections that mirrors the actual data relationships. This visual copy allows users to interact with and understand data governance structures without adding complexity to the underlying data management systems, resolving the contradiction by providing simplicity at the user interface level while maintaining the integrity of complex backend operations.
2Reliability
If data governance systems lack structural representation of data interconnectedness, then security and compliance management become difficult, but creating such representation requires additional processing resources
Solution Approach 1:
The system pre-processes and establishes the visual representation of data interconnections during data ingestion and governance setup phases. By creating this structural representation in advance, the system enables efficient security and compliance monitoring without requiring intensive processing resources during actual governance operations, thus resolving the contradiction between reliability improvement and resource consumption.
3Ease of operation
If data governance systems use traditional classification algorithms, then data classification is achieved, but the systems cannot effectively visualize and represent data interconnections for governance purposes
Solution Approach 1:
The patent merges traditional data classification functionality with visual graph representation, combining the strengths of both approaches. The system maintains classification capabilities while simultaneously creating visual representations that preserve and display data interconnection information, thus resolving the contradiction by integrating multiple functions into a unified system that delivers both classification accuracy and interconnection visibility.
Data Source
AI summary
Systems and methods are disclosed for creating a governance graph representing data set interconnection. The data set interconnections may be based on common fields, sources, databases, applications, or patterns of usage. For example, the interconnections may be direct connections, where one data set is directly downstream from another data set. Alternatively, the interconnections may be indirect connections based patterns showing the data sets are commonly used together. For example, given data sets “A”, “B”, and “C”, if “B” is directly connected to “A” because it is downstream from “A”, and a particular group of users commonly use “B” and “C” together, “A” may be indirectly related to “C” based on the pattern of usage. In this example, the governance graph is configured to indicate the connection between “A” and “B” is stronger than the connection between “A” and “C”, whilst still showing the connection.