Workflow Integration of Heterogeneous Data Sources
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data integration systems face challenges in seamlessly combining and storing data from multiple heterogeneous sources, leading to inefficient data processing and reduced accuracy in transaction-related workflows.
Innovation Solution
The system contextualizes queries to retrieve contact records from multiple data sources, including social networks and CRM databases, and uses layered caching techniques to synchronize updates, ensuring relevant data is integrated while excluding less pertinent information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data from multiple heterogeneous sources is combined and stored, then data integration completeness is improved, but data processing complexity increases
Solution Approach 1:
The patent segments data integration by creating separate data sources (CRM database, social network service, external data sources) that can be independently managed and queried. Each data source maintains its own structure and characteristics while being accessible through a unified workflow interface, reducing the complexity of handling heterogeneous data as a single monolithic system.
Solution Approach 2:
The patent introduces a workflow system as an intermediary layer between multiple data sources and the user. This workflow engine coordinates data retrieval from heterogeneous sources, manages data integration logic, and presents unified results, thereby reducing the complexity of directly processing data from multiple sources.
2Measurement precision
If queries are executed to retrieve contact data from heterogeneous data sources, then data accuracy is improved, but processing time increases
Solution Approach 1:
The patent implements preliminary action by pre-defining workflows that specify which data sources to query and what data to retrieve. These workflows are configured in advance with contextual parameters, allowing the system to execute pre-planned data retrieval operations rather than ad-hoc queries, thereby reducing processing time while maintaining accuracy.
Solution Approach 2:
The patent utilizes parameter changes by contextualizing queries with workflow-specific parameters and entity identifiers. The system dynamically adjusts query parameters based on the workflow context, enabling efficient retrieval of only the most relevant and accurate data from heterogeneous sources, balancing accuracy with processing efficiency.
3Loss of information
If contextualized queries are used to retrieve relevant contact data, then data relevance is improved, but query complexity increases
Solution Approach 1:
The patent implements universality by creating a unified workflow system that handles multiple data sources through a single interface. The workflow engine provides multi-functional capabilities to query, retrieve, and integrate data from heterogeneous sources using a consistent methodology, reducing query complexity despite the diversity of data sources.
Solution Approach 2:
The patent uses copying by creating contextualized representations of data retrieval logic that can be reused across different workflows. Template workflows and predefined query patterns allow the system to replicate successful data retrieval approaches, reducing the complexity of creating new contextualized queries while maintaining high data relevance.
Data Source
AI summary
Techniques for integrating data from multiple data sources with a transaction-related workflow are provided. The disclosed techniques include, in response to determining that a contact record was retrieved from a second data source, concurrently with the assigning of a role to the contact record, instantiating a version of the contact record in a first data source using data obtained from the second data source.