Metadata Versioning for Slowly Changing Dimensions in OLAP
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multidimensional database systems struggle to efficiently manage and query slowly changing dimensions and metadata, as they often require archiving snapshots of data structures for past states, which is computationally expensive and inefficient.
Innovation Solution
A system and method for supporting slowly changing dimensions and metadata versioning in a multidimensional database environment, where metadata is used to track changes over time, allowing a single data structure to represent both current and past states, reducing the need for frequent data archiving.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshots of data structures are archived to preserve past states of dimensions, then historical data access is enabled, but computational cost and storage requirements increase significantly
Solution Approach 1:
The patent combines current and historical dimension data into a single multidimensional database structure rather than maintaining separate snapshots. The system stores dimension data with version identifiers and temporal metadata, allowing the database to consolidate multiple time states in one unified structure, thereby reducing storage overhead and computational resources needed to manage and query historical data.
Solution Approach 2:
The patent introduces a time dimension to the multidimensional database structure, transforming the storage approach from archiving complete snapshots to storing dimension members with temporal attributes. This adds a time-based dimension to the data model, enabling historical queries without requiring full structural snapshots of past states.
2Reliability
If snapshots of data structures are archived to preserve past states of dimensions, then historical data access is enabled, but storage requirements increase significantly
Solution Approach 1:
The patent combines current and historical dimension data into a single multidimensional database structure rather than maintaining separate snapshots. The system stores dimension data with version identifiers and temporal metadata, allowing the database to consolidate multiple time states in one unified structure, thereby reducing storage overhead and computational resources needed to manage and query historical data.
Solution Approach 2:
Instead of archiving complete structural snapshots, the patent creates lightweight copies of dimension members with temporal metadata. Each dimension member is stored once with version information, rather than duplicating entire data structures for each time state. This selective copying approach dramatically reduces storage requirements while preserving historical data access capability.
3Volume of stationary object
If a single data structure is used to represent both current and past states, then storage efficiency is improved, but query complexity increases
Solution Approach 1:
The patent introduces metadata as an intermediary layer between the unified data structure and query operations. The metadata contains temporal information, version identifiers, and validity periods that mediate between the stored dimension data and query requirements. This intermediary metadata layer simplifies query processing by providing pre-computed temporal context without requiring complex queries against the underlying unified structure.
Solution Approach 2:
The patent segments the unified data structure into dimension members with distinct temporal attributes and validity periods. By dividing the data into manageable units with explicit temporal boundaries, the system enables efficient query processing through selective access to relevant time periods, reducing the complexity of querying the overall unified structure.
Data Source
AI summary
In accordance with an embodiment, described herein are systems and methods for supporting slowly changing dimensions and metadata versioning in a multidimensional database, comprising. A system can comprise a computer that includes one or more microprocessors, and a multidimensional database server executing on the computer, wherein the multidimensional database server supports at least one hierarchical structure of data dimensions. A data dimension can slowly change over time. When such changes occur, metadata associated with the data dimension can be updated. Advantageously, a current snapshot of the data structure can allow searching of previous changes to the slowly changing dimension based upon the metadata.


