Unified Audit Logging for Cloud Data Warehouse Input Tables
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern businesses face challenges in efficiently managing and tracking modifications to input tables in cloud-based data warehouses due to the complexity of database queries and user limitations in composing and issuing efficient queries.
Innovation Solution
Implementing a workbook manager that logs modifications to input tables in an audit table within the cloud-based data warehouse, allowing for a unified record of changes across multiple input tables, using database statements to store and manage these modifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users directly manipulate data in cloud-based data warehouses using database queries, then data access and modification capabilities are improved, but the complexity of composing and issuing efficient database queries exceeds most users' abilities
Solution Approach 1:
The patent introduces a workbook manager as an intermediary layer between users and the cloud-based data warehouse. This workbook manager handles the complexity of database query composition and execution, allowing users to manipulate data through a simplified interface while the workbook manager translates user actions into efficient SQL queries behind the scenes.
Solution Approach 2:
The patent creates a local copy or representation of the data warehouse schema in the workbook environment. Users interact with this copied structure rather than directly with the complex database system, making data manipulation more intuitive while the workbook manager handles the actual database operations.
2Reliability
If comprehensive audit logging is implemented to track all modifications to input tables, then audit trail completeness and reliability are improved, but the system complexity and storage requirements increase
Solution Approach 1:
The patent extracts the audit logging function into a separate, dedicated component within the workbook manager. Rather than embedding audit capabilities throughout the entire data warehouse system, the workbook manager independently captures and stores modification information, simplifying the overall system architecture while maintaining comprehensive audit coverage.
Solution Approach 2:
The workbook manager autonomously captures modification events and generates audit entries without requiring complex external audit infrastructure. The system self-services its own audit logging needs by tracking changes made through the workbook interface and automatically recording them in the audit table.
3Measurement precision
If multiple separate audit tables are created for each input table to track modifications, then audit tracking precision is improved, but the complexity of managing and querying audit data across multiple tables increases
Solution Approach 1:
The patent consolidates audit logging for multiple input tables into a single unified audit table. Each audit entry includes identifiers that link the modification to its specific source input table, allowing precise tracking of changes while maintaining a centralized, simplified audit structure that is easier to manage and query than multiple separate tables.
Data Source
AI summary
Audit logging for input tables on a data warehouse including: receiving, by a workbook manager from a client computing system, a modification to an input table of a plurality of input tables stored in a cloud-based data warehouse; and storing, by the workbook manager, in an audit table stored in the cloud-based data warehouse, an entry describing the modification to the input table, wherein the audit table is configured to store entries describing modifications to any of the plurality of input tables.