Unified Query Processing Server for Multi-Source Data Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developers face complexity in combining information from multiple data sources, such as databases and APIs, due to differing formats and the need to write multiple queries in various languages, which can lead to increased complexity when integrating internal and public API calls.
Innovation Solution
A query processing server that receives a unified query, extracts endpoint queries for multiple data sources, updates parameters, and generates a result by forwarding and processing these queries across servers, enabling the combination and enrichment of data from various sources in a single unified query.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If developers write multiple queries in various languages to access different data sources, then data access capability is improved, but query complexity and integration difficulty increase
Solution Approach 1:
The patent implements a universal query language that can access multiple data sources (databases, APIs, data lakes) through a single interface. The query processor translates unified queries into source-specific queries, eliminating the need for developers to write separate queries in different languages for each data source, thus reducing query complexity while maintaining versatile data access capability
Solution Approach 2:
The query processor acts as an intermediary between the unified query language and various data sources. It receives queries in a standardized format, translates them into appropriate query languages for specific data sources, and manages the integration process, thereby simplifying the complexity of directly integrating multiple data sources with different query requirements
2Adaptability or versatility
If developers integrate multiple data sources with differing formats, then data enrichment capability is improved, but integration complexity increases
Solution Approach 1:
The system provides a unified interface that handles multiple data sources with different formats through a single query language. The query processor automatically manages format conversions and integrations, allowing developers to enrich data from multiple sources without dealing with the complexity of format differences manually
Solution Approach 2:
The system changes the parameter format of queries from source-specific formats to a unified format. By standardizing query parameters and data formats at the interface level, the system enables seamless integration of data sources with differing formats while maintaining data enrichment capabilities
3Adaptability or versatility
If multiple separate queries are used to access different data sources, then data source compatibility is improved, but processing time increases
Solution Approach 1:
The patent merges multiple separate queries into a single unified query that can access multiple data sources simultaneously. The query processor translates and executes the unified query across different data sources in an optimized manner, reducing the total processing time compared to executing multiple separate queries sequentially
4Adaptability or versatility
If developers manually integrate API calls and data queries, then flexibility in data access is improved, but operational complexity increases
Solution Approach 1:
The unified query language provides a universal interface that handles both API calls and data queries through the same syntax and processing mechanism. This eliminates the need for developers to manually integrate different types of data access operations, reducing operational complexity while maintaining flexibility in accessing various data sources
Data Source
AI summary
A method, including receiving, from a client, a unified query, and extracting, from the unified query, an endpoint query for a first data source on a first server and an endpoint query for a second data source on a second server. The extracted endpoint query for the first data source is forwarded to the first server. Upon receiving a response to the endpoint query forwarded to the first server, one or more parameters are extracted from the response. The endpoint query for the second data source is updated so as to include the extracted one or more parameters, and the updated endpoint query for the second data source is forwarded to the second server. Upon receiving, from the second server, a response to the forwarded endpoint query, a result for the received unified query is generated based on the receive responses, and the generated result is conveyed to the client.


