Portable Datamart Curation for Secure Client-Specific Data Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional data curation methods in centralized enterprise warehouses are costly, complex, and lack the ability to efficiently integrate client-specific data and reporting, while also failing to ensure data security and portability.
Innovation Solution
A curated portable datamart system that includes a semantic layer to generate client-specific rules, a security and client context layer for authorization, and an API to manage client queries, enabling the generation of curated data deliverables on demand, ensuring data security and portability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional centralized enterprise warehouses are used for data curation, then data quality and security can be ensured, but the solution becomes costly and complex
Solution Approach 1:
The patent segments the centralized enterprise warehouse into multiple virtual datamarts, each serving specific clients or purposes. This segmentation allows data to be organized into smaller, manageable units that can be independently curated and accessed, reducing overall system complexity while maintaining data quality through specialized handling in each segment.
Solution Approach 2:
The patent introduces a data curation layer as an intermediary between the raw data warehouse and end users. This layer handles data transformation, enrichment, and delivery, isolating the complexity of data management from both the source system and consumers, thereby simplifying the overall architecture while ensuring data quality through controlled processing.
2Reliability
If traditional centralized enterprise warehouses are used for data curation, then data security can be ensured, but operational costs increase
Solution Approach 1:
The patent implements self-service capabilities where clients can independently access and query their designated virtual datamarts without requiring extensive centralized management intervention. This reduces operational overhead and costs while maintaining security through pre-configured access controls and data isolation mechanisms.
Solution Approach 2:
The patent creates virtual copies of data subsets for different clients rather than providing direct access to the entire centralized warehouse. These virtual datamarts are lightweight replicas that maintain data security through isolation, reducing the cost of security management while preserving the security benefits of centralized control.
3Reliability
If traditional centralized enterprise warehouses are used, then data can be curated, but the ability to integrate client-specific data and reporting is limited
Solution Approach 1:
The patent applies local quality by customizing each virtual datamart according to specific client requirements and data needs. Each client receives a tailored data environment with relevant schemas, access controls, and reporting capabilities, while the overall system maintains standardized data curation processes, thus achieving both reliable curation and high adaptability.
Solution Approach 2:
The patent creates a universal data curation platform that can serve multiple clients with different requirements through virtual datamarts. The underlying infrastructure and curation processes are universal and reusable, while the virtual layers adapt to specific client needs, providing both reliable standardized curation and versatile client-specific integration.
4Reliability
If centralized enterprise warehouses are used, then data can be stored, but portability of data solutions is reduced
Solution Approach 1:
The patent extracts specific data subsets from the centralized warehouse and packages them into portable virtual datamarts for individual clients. This extraction allows data to be stored reliably in the centralized system while simultaneously providing portable, client-specific data environments that can be independently managed and potentially migrated, thus improving portability without sacrificing storage capability.
Data Source
AI summary
A curated portable datamart system, method, and apparatus are provided. The method, implemented by one or more processors, comprises: invoking a security and client context layer to authorize a client to access an individual-specific raw data that is specific to a client query, the security and client context layer stored on the one or more computer memories and comprising computing instructions configured to access a semantic layer; responsive to authorizing the client query, invoking the semantic layer to curate the individual-specific raw data to generate a curated data deliverable, the curated data deliverable comprising temporal data generated from one or more raw data items accessed by the semantic layer; and outputting, via the API, the curated data deliverable, wherein the semantic layer is stored on the one or more computer memories and comprises computing instructions configured to generate temporal data from the one or more raw data items.