Federated Query Processing for Enterprise Event Data Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Enterprises face challenges in accessing and processing event data across multiple systems and geographic locations, leading to operational data visibility loss and increased time and cost due to the complexity of handling large amounts of data and numerous systems, making it difficult to create operational reports in a cost-effective manner.
Innovation Solution
A computer-implemented method and system that selectively parses and federates queries related to event data by identifying common query components, sending a single query component to the relevant data source, and combining responses while filtering based on security access levels, allowing for efficient access and processing of real-time and historical event data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If queries are sent to multiple separate data sources across geographic locations, then data accessibility and completeness are improved, but system complexity and processing time increase
Solution Approach 1:
The patent segments the enterprise system into multiple geographically distributed data sources, each handling local event data independently. Query components are divided and routed to appropriate segments, allowing parallel processing while maintaining data accessibility across the distributed system.
Solution Approach 2:
The patent introduces intermediary components including query routers that direct query components to appropriate data sources, and result aggregators that combine responses. These intermediaries manage the complexity of distributed queries without sacrificing data accessibility.
2Loss of information
If multiple query components are sent to multiple data sources, then complete event information is obtained, but processing time and resource consumption increase
Solution Approach 1:
The patent merges identical or redundant query components before sending them to data sources. When multiple queries require the same event information, the system combines them into a single query, reducing the total number of requests while ensuring complete event information is collected from all necessary sources.
Solution Approach 2:
The patent performs preliminary actions by pre-processing queries to identify and combine redundant components before execution. This preliminary analysis reduces the computational burden during actual query execution and minimizes processing time while maintaining information completeness.
3Reliability
If data is stored in distributed operational databases across multiple systems, then system autonomy and local processing capability are improved, but enterprise-wide data visibility and report generation efficiency deteriorate
Solution Approach 1:
The patent implements a universal query processing framework that operates across diverse distributed systems. The system provides multi-functional capabilities including query routing, component combination, result aggregation, and security filtering, enabling efficient report generation while preserving the autonomy of individual distributed systems.
4Reliability
If security access control is implemented for event data queries, then data security and privacy are improved, but query processing complexity and access time increase
Solution Approach 1:
The patent applies security filtering at local points in the query processing architecture. Security filters are positioned at strategic locations where they can enforce access control policies without requiring centralized verification of every query component, reducing overall processing complexity while maintaining data security.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Merging of query elements in an enterprise system is described. The enterprise system receives queries, which may each be broken down into query components. The enterprise system identifies query components that are related to identical event information from a data source of the enterprise. The enterprise system sends a single query to the data source for the event information, receives the response, and sends the response to the query sources.