ETL Process Upgrade Independence from User Customizations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional ETL tools do not support upgrades when customizations are made to core product processes, requiring users to develop separate external processes, which affects performance and prevents core product upgrades.
Innovation Solution
A system and method that allow users to customize and upgrade ETL processes independently, enabling automatic upgrades of ETL processes without losing customizations, by identifying and customizing core processes and objects, and applying rules for adding new objects and attributes, while allowing automatic updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users customize core ETL processes, then customization capability is improved, but upgradeability deteriorates
Solution Approach 1:
The system segments ETL processes into core processes and user customizations by identifying customized objects and processes. This allows the core functionality to be upgraded independently while preserving user customizations through the identification of which objects were modified versus which are part of the core product.
Solution Approach 2:
The system introduces an intermediary mechanism that detects customizations and manages upgrade compatibility. By tracking which objects have been customized and maintaining this information, the system can mediate between core product updates and user-specific modifications, enabling upgrades without losing customizations.
2Reliability
If separate external ETL processes are developed for customization, then upgradeability is maintained, but system complexity and performance deteriorate
Solution Approach 1:
The system merges user customizations with core ETL processes by allowing customizations to be applied directly to existing core objects rather than creating separate external processes. This consolidation reduces system complexity while maintaining upgradeability through the customization tracking mechanism.
Solution Approach 2:
The system enables core ETL processes to serve multiple functions: they can be customized by users and still upgraded through the same framework. The identification mechanism allows a single process structure to handle both standard operations and customizations, eliminating the need for duplicate external processes.
3Adaptability or versatility
If core code is changed to support customization, then customization capability is improved, but product upgradeability deteriorates
Solution Approach 1:
The system performs preliminary identification of customizations before upgrades occur. By tracking which objects have been customized in advance, the system can prepare upgrade paths that preserve these customizations, allowing core code to be updated without requiring manual intervention to maintain customizations.
Data Source
AI summary
A system, method, and computer program product are provided for permitting an upgrade of extract, transform, and load (ETL) processes, independent of a customization performed by a user. In operation, one or more ETL processes are identified. Additionally, a user is permitted to customize the one or more ETL processes. Further, an upgrade of the one or more ETL processes is permitted and enabled.