Data Lineage Discovery Tool for Manager Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Managers lack the ability to effectively control data flow in information systems due to a knowledge gap between information technology specialists, who understand data lineage, and managers, who are familiar with organizational goals but not data lineage, leading to limited control over data flow in organizations.
Innovation Solution
A tool that discovers and analyzes data lineage in complex machine information environments, allowing for monitoring and control of business information elements by cross-referencing technical data elements with key business elements, providing data lineage information and enabling role-based security and notification tools to manage access and changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If data lineage is tracked using technical data elements and machines, then measurement precision of data flow is improved, but ease of operation for managers deteriorates due to technical complexity
Solution Approach 1:
The patent introduces an intermediary layer that translates technical data element identifiers into business information element identifiers. This mediator enables managers to query and control data flow using business terminology rather than technical details, resolving the contradiction between precise tracking and ease of operation.
Solution Approach 2:
The system segments the data lineage tracking into two distinct layers: a technical layer for precise tracking using TDEs, and a business layer for easy management using BIEs. This segmentation allows each layer to operate independently with its own optimization criteria.
2Reliability
If comprehensive data lineage information is provided to managers, then organizational governance is improved, but device complexity of the system increases
Solution Approach 1:
The translation mechanism acts as an intermediary that provides managers with comprehensive governance information without requiring the underlying complex technical infrastructure to be visible or understandable to them.
Solution Approach 2:
The system creates a simplified copy or view of the data lineage information tailored for business users, while the complete technical lineage is maintained separately for system integrity and detailed analysis.
Data Source
AI summary
Resources for data lineage discovery, data lineage analysis, role-based security, notification. The resources may include or involve machine readable memory that is configured to store a technical data element (“TDE”); a receiver that is configured to receive a query for data lineage information corresponding to a business element identifier; and a processor configured to: register a logical association between the business element identifier and the TDE; and formulate the data lineage information of the TDE associated with the business element identifier. The receiver may be configured to receive a criterion that is required to access one or more technical data elements (“TDEs”) associated with the business element identifier. The receiver may be configured to receive an election to receive a notification of a change of data lineage. The processor may be configured to toggle between a first data lineage graph and a second data lineage graph.