Decoupled Data Integration for BI and Transaction Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional systems integration approaches for business intelligence (BI) and transactional systems are inefficient, lacking flexibility and scalability in data transformation and transfer, particularly in handling different data models and requiring coupled implementation details.
Innovation Solution
A service-oriented transaction system is integrated with an information storage, access, and analysis system using a data integration component with a decoupled data transformation interface and data transfer interface, allowing for model-based data processing and flexible transformations, including delta replication and generic/model-based implementations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a traditional API-based integration approach is used to transfer data from a transactional system to a BI system, then data can be extracted and pushed between systems, but the implementation details of data transfer are coupled with data transformation logic, reducing flexibility and scalability
Solution Approach 1:
The patent divides the data integration process into separate components: a data transformation interface that handles model conversion and a data transfer interface that handles data movement. This segmentation decouples the implementation details of transformation from transfer, allowing each component to be independently optimized and modified without affecting the other.
Solution Approach 2:
The patent introduces an intermediary layer (the data transformation interface) between the transactional system and the BI system. This intermediary handles the complexity of data model transformations, allowing the data transfer interface to operate with simplified logic while maintaining flexibility in how data is transformed and transferred.
2Ease of manufacture
If data transformation and data transfer are coupled in a single interface, then implementation is simpler, but updates and improvements to either transformation or transfer require changes to the entire interface, reducing maintainability
Solution Approach 1:
The patent segments the integrated interface into distinct transformation and transfer components. This allows the system to maintain the simplicity of a unified interface while enabling independent updates to transformation logic or transfer mechanisms without requiring changes to the entire interface implementation.
3Adaptability or versatility
If a generic model-based transformation approach is used, then the system can handle different data models flexibly, but the complexity of managing multiple transformation agents increases
Solution Approach 1:
The patent implements a generic model-based transformation agent that can handle multiple data model transformations through a unified framework. This universal agent reduces the need for multiple specialized transformation agents, managing complexity while maintaining the capability to handle diverse data models through parameterized transformation rules.
Data Source
AI summary
The present disclosure includes systems and techniques relating to integration of a service-oriented transaction system with an information storage, access and analysis system, such as a Business Intelligence (BI) infrastructure. In general, in some implementations, a data transformation interface and a data transfer interface can be configured to effect data exchange between a computer-based information storage, access and analysis system including a second data model, and a computer-based service-oriented transactional system including a first data model. The data transformation interface and the data transfer interface can be configured to communicate through a decoupled information exchange that separates program implementation details of the data transfer interface from the data transformation interface. Furthermore, in some implementations, an agent framework can be used to decouple data transformation from data transfer, where the agent framework includes a generic agent and application specific agents.