Workflow System Data Management Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional workflow systems are cumbersome for accessing data management systems, requiring complex coding in traditional programming languages or wrapping SQL statements into Web services, and they struggle with efficient handling of large data sets and dynamic data source selection during runtime.
Innovation Solution
Integrating data management operations directly into workflow systems through new data management activities, set references with life cycle attributes, and allowing business process variables as input/output parameters, enabling inline SQL and dynamic data source selection at runtime.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data management operations are accessed through conventional workflow systems using traditional programming languages or Web services, then data management functionality is available, but the system complexity and development time increase significantly
Solution Approach 1:
The patent merges data management operations directly into the workflow system by integrating SQL capabilities and data source management within the workflow engine itself, eliminating the need for separate programming layers or Web service wrappers. This allows workflow activities to directly access and manipulate data management resources through native operations.
Solution Approach 2:
The workflow system is enhanced with universal data management capabilities that can handle multiple operations (queries, updates, deletions, inserts) across different data sources (relational databases, XML files, CSV files, flat files) through a unified interface, making the system multi-functional without requiring separate specialized components.
2Adaptability or versatility
If data management operations are accessed through conventional workflow systems, then data access is possible, but development time and coding effort increase
Solution Approach 1:
The workflow system provides self-service data management capabilities where the system automatically handles data source connections, query execution, and result processing without requiring external programming. The integrated SQL engine and data source manager enable workflows to autonomously perform data operations through declarative definitions rather than procedural coding.
3Quantity of substance
If large data sets are handled in conventional workflow systems, then data processing is possible, but performance degrades due to data materialization requirements
Solution Approach 1:
The patent extracts the data materialization step from the data processing workflow, allowing workflows to operate directly on data sources without loading complete data sets into memory. The system extracts and processes only the necessary data portions through cursor-based access and incremental processing, eliminating the performance bottleneck of full data materialization.
4Ease of manufacture
If data source selection is fixed in conventional workflow systems, then system design is simplified, but adaptability to dynamic runtime conditions is reduced
Solution Approach 1:
The patent introduces dynamic data source selection capabilities where the workflow system can determine and switch between different data sources at runtime based on conditions, parameters, or external events. This dynamic behavior allows the system to adapt to changing requirements without requiring complex redesign, maintaining ease of use while enhancing flexibility.
Data Source
AI summary
Techniques are provided for processing a workflow. A workflow including one or more data management activities is received. A workflow description is generated from the workflow that includes a description of the one or more data management activities. One or more data management operations are generated from the workflow description. The one or more data management operations are executed against one or more data management systems.