Data Warehouse Views That Exclude Metadata for Simpler Queries
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern businesses face challenges in efficiently accessing and manipulating large data sets stored in cloud-based data warehouses due to the complexity of database queries, which often exceed the capabilities of most users.
Innovation Solution
A workbook manager selects a subset of columns from an input table in a cloud-based data warehouse, excluding metadata columns, generates a view of the table based on this subset, and stores it in the warehouse, allowing users to issue simpler queries without needing to account for non-presented columns.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users directly access input tables in cloud-based data warehouses, then complete data access is achieved, but query complexity increases and usability decreases
Solution Approach 1:
The patent introduces a view as an intermediary layer between users and the underlying input tables. This view abstracts the complex table structure by excluding metadata columns and presenting only relevant data columns, thereby simplifying user queries while maintaining access to the complete data warehouse infrastructure.
Solution Approach 2:
The patent segments the input table structure by separating metadata columns from data columns. The view presents only the necessary data columns to users, while the metadata columns remain available in the underlying table for system operations. This segmentation reduces query complexity for users who don't need metadata.
2Productivity
If all columns including metadata are presented to users, then complete information is provided, but data access volume increases unnecessarily
Solution Approach 1:
The patent extracts and excludes metadata columns from the view presented to users, while maintaining them in the underlying input table. This extraction reduces the data access volume for typical user queries that only need data columns, while the metadata remains available when required by the system.
3Manufacturing precision
If complex queries are required to exclude metadata columns, then precise data selection is achieved, but user capability requirements increase
Solution Approach 1:
The patent performs the data selection action in advance by creating a view that pre-excludes metadata columns. This preliminary action eliminates the need for users to write complex queries to filter out metadata, as the view already presents only the necessary data columns in a simplified structure.
Data Source
AI summary
Creating data warehouse views for input tables including: selecting, by a workbook manager, a subset of columns of an input table stored in a cloud-based data warehouse, wherein the subset of columns excludes one or more metadata columns of the input table; generating, by the workbook manager, a view of the input table based on the subset of columns; and storing, by the workbook manager, the view of the input table in the cloud-based data warehouse.