Automated Data Governance Using Metadata-Driven Policy Enforcement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Organizations face challenges in automating data governance across various environments, requiring manual updates to comply with changing regulations and ensuring consistent enforcement of data policies.
Innovation Solution
A system with a metadata repository, policy repository, and classification management device that automatically applies classification codes to datasets based on environment-specific policies, using APIs and real-time communication to enforce data governance policies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual updates are used to enforce data governance policies, then flexibility in policy application is maintained, but productivity and consistency across multiple environments deteriorate
Solution Approach 1:
The system enables self-service automation where the classification management device automatically queries classification requirements from the metadata repository, retrieves appropriate classification codes from the policy repository, and applies them to datasets without requiring manual intervention. This eliminates the need for actors to manually update code in each data environment while maintaining policy flexibility through automated policy retrieval and application.
Solution Approach 2:
The patent replaces the mechanical manual process of updating governance code in each environment with an automated information technology system. The classification management device uses electronic queries to the metadata repository and policy repository to automatically determine and apply classification codes, substituting manual mechanical operations with automated digital processes that improve productivity and consistency.
2Adaptability or versatility
If manual policy application is used, then adaptability to regulation changes is maintained through human judgment, but loss of time and consistency across environments increase
Solution Approach 1:
The system performs preliminary action by pre-storing classification requirements and corresponding classification codes in the metadata repository and policy repository before regulation changes occur. When a regulation changes, the system can quickly query updated requirements from the repository and automatically apply the new classification codes without time-consuming manual analysis, thus reducing the time loss while maintaining adaptability through updated policy data.
Solution Approach 2:
The system incorporates feedback mechanisms where the classification management device continuously queries the metadata repository for updated classification requirements and automatically adjusts policy applications accordingly. This feedback loop ensures the system adapts to regulation changes in real-time without manual intervention, reducing time loss while maintaining compliance adaptability through automated policy updates.
3Productivity
If automated code generation is implemented, then productivity and consistency improve, but device complexity and initial setup requirements increase
Solution Approach 1:
The classification management device serves multiple functions within a single integrated system: it queries classification requirements from the metadata repository, retrieves classification codes from the policy repository, and automatically applies them to datasets across multiple data environments. This multi-functionality consolidates what would otherwise require separate manual processes in each environment into one automated system, improving productivity while managing complexity through functional integration.
Solution Approach 2:
The patent introduces intermediary components including the metadata repository and policy repository that mediate between the classification management device and the data environments. These intermediary repositories store classification requirements and codes, allowing the automated system to query and retrieve necessary information without direct complex interactions with each data environment, thus reducing overall system complexity while maintaining high automation productivity.
Data Source
AI summary
Systems and methods for providing automated data governance are disclosed. The system may include a plurality of data environments, a metadata repository storing data attributes and classification requirements, a policy repository, one or more processors, and a memory in communication with the one or more processors storing instructions to execute steps of a method. The system may receive a first dataset from a first data environment having a first dataset ID. The system may transmit the dataset ID to the metadata repository and the metadata repository may return an indication that the first dataset includes at least one data attribute and at least one associated classification requirement. The system may transmit the classification requirement to the policy repository and receive classification code associated with the classification requirement. The system may modify the first dataset by transmitting instructions to the first data environment to execute the classification code.