Cloud Data Asset Marketplace Using Virtualized Access Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Organizations face challenges in managing the rapid growth of third-party data assets, with inconsistent data access, laborious ingestion, and compliance difficulties, leading to inefficiencies and complications in maintaining control over sensitive data.
Innovation Solution
A cloud-based data and analytics platform that enables users to discover, select, and manage data assets through a data virtualization layer, applying protected views to sensitive data and ensuring compliance with policies, while allowing for secure sharing and delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is accessed manually from distributed sources, then data access control is maintained, but data access speed and efficiency deteriorate
Solution Approach 1:
The patent introduces a data virtualization layer as an intermediary between users and distributed data sources. This layer provides a unified interface that abstracts the complexity of accessing data from multiple external and third-party sources, enabling fast and convenient data access without manual intervention while maintaining centralized control policies.
Solution Approach 2:
The marketplace platform serves multiple functions: it acts as a data catalog, access control mechanism, and distribution hub simultaneously. By consolidating these functions into a single universal system, the patent enables efficient data access across distributed sources while maintaining centralized governance.
2Productivity
If data ingestion and preparation is performed manually, then data quality control is maintained, but processing time and complexity increase
Solution Approach 1:
The patent implements automated data ingestion and preparation processes that perform data validation, transformation, and quality checks automatically upon data entry into the marketplace. This preliminary automated processing reduces manual intervention requirements while maintaining quality control standards.
Solution Approach 2:
The system provides self-service data ingestion capabilities where data sources can automatically connect and register their data assets with the marketplace platform. The platform automatically handles data cataloging, metadata extraction, and initial validation, reducing the complexity of data onboarding while maintaining quality standards.
3Reliability
If data is replicated across multiple sources, then data availability is improved, but data control and compliance management become more difficult
Solution Approach 1:
The data virtualization layer acts as an intermediary that provides unified access to distributed data sources without requiring physical replication. This approach maintains data availability through virtual access points while keeping the actual data stored at source locations, thereby simplifying compliance management and control.
Solution Approach 2:
Instead of replicating actual data, the system creates virtual copies or references to data assets in the marketplace catalog. These virtual copies enable multiple users to access the same data source simultaneously without duplicating the underlying data, maintaining availability while simplifying control and compliance management.
4Object-affected harmful factors
If protected views are applied to sensitive data, then data security is improved, but data utility for analysis may be reduced
Solution Approach 1:
The patent applies protected views selectively to specific sensitive columns or fields within data assets rather than masking entire datasets. This localized protection approach secures sensitive information while preserving the utility of non-sensitive data for analysis and insights generation.
Solution Approach 2:
The system dynamically applies protection levels based on user roles, data sensitivity classifications, and contextual factors. Protected views can be adjusted dynamically to provide appropriate levels of access - fully protected for highly sensitive data, partially protected for moderately sensitive data, and minimally protected for public data - thereby maintaining both security and analytical utility.
Data Source
AI summary
The invention relates to computer-implemented systems and methods that implements a data asset marketplace and management platform. An embodiment of the present invention is directed to a cloud-based data and analytics (D&A) platform enabling professionals and various users with accelerated access to critical data, D&A tools and workspaces to create and deliver reusable data-driven solutions.


