Active Metadata Catalog for Consistent Downstream Access Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data management systems lack the capability for consistent access enforcement across various data platforms due to the absence of an active metadata catalog, leading to inefficiencies in data access control.
Innovation Solution
Implementing a platform, language, and cloud agnostic metadata change management module triggered by an authoritative and active data catalog, which includes an AI/ML model for auto-approval checks, ensuring consistent access control enforcement across downstream data platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional data management systems are used without an active metadata catalog, then system simplicity is maintained, but consistent access control enforcement across data platforms cannot be achieved
Solution Approach 1:
The patent introduces an active metadata catalog as an intermediary component between data sources and data platforms. This catalog collects, stores, and distributes metadata in a centralized manner, enabling consistent access control enforcement across diverse data platforms without requiring each platform to independently manage access controls. The metadata catalog acts as a mediator that propagates access control policies throughout the data ecosystem.
Solution Approach 2:
The metadata catalog is designed to be platform-agnostic and can serve multiple data platforms simultaneously. It provides universal access control enforcement capabilities that work across different data platforms, languages, and cloud environments. The system can manage metadata from various data sources and distribute it to multiple downstream platforms, making it a multi-functional solution for access control.
2Productivity
If manual metadata update processes are used, then control over data properties is maintained, but data management efficiency and processing speed decrease
Solution Approach 1:
The patent implements a certification process that performs preliminary actions on metadata updates before they are applied to data platforms. The metadata must be certified by data owners or authorized systems before propagation. This preliminary certification step ensures that only validated and approved metadata changes are distributed, maintaining control while enabling efficient automated processing of legitimate updates.
Solution Approach 2:
The system incorporates self-service capabilities where data owners can autonomously certify and approve metadata updates without requiring manual intervention from system administrators. The metadata catalog system automatically processes certified updates and propagates them to downstream platforms, enabling self-service metadata management that improves efficiency while maintaining proper authorization controls.
3Reliability
If an active metadata catalog with certification process is implemented, then access control consistency is improved, but the complexity of metadata management increases
Solution Approach 1:
The metadata management process is segmented into distinct phases: metadata collection, certification, storage, distribution, and consumption. Each phase is handled by specific components within the metadata catalog system. The certification process is separated from the propagation process, allowing for independent optimization. This segmentation reduces overall complexity by breaking down the metadata management workflow into manageable, discrete steps.
Data Source
AI summary
Various methods and processes, apparatuses or systems, and media for enabling consistent access enforcement across downstream data platforms triggered via an active data catalog are disclosed. A processor implements an active data catalog; causes the active data catalog to receive metadata updates corresponding to a line of business including properties that may be used to control access enforcement across the downstream data platforms; executes a certification process to certify the metadata updates including the properties that may be used to control access enforcement; stores the certified metadata updates onto the active data catalog; updates the active data catalog with the certified metadata updates along with certification details data; and distributes the certified metadata to the downstream data platforms thereby enabling consistent access control enforcement.


