Dynamic Data Filter for Federated Source Querying
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data processing systems struggle to generate targeted search reports from federated data sources without requiring users to have knowledge of the data keys, data structures, or overall data schema, limiting their ability to access and utilize information efficiently.
Innovation Solution
A data processing system that receives data source agnostic information requests, generates dynamic data filters using a data dictionary derived from these requests, and filters information from multiple data sources, enabling users to obtain structured reports without knowing the specific data schema or keys.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users directly query federated data sources using traditional methods, then they can access information from multiple data sources, but they must have knowledge of data keys, data structures, and schemas which increases operational complexity
Solution Approach 1:
The patent introduces a natural language query processing system that acts as an intermediary between users and federated data sources. This system translates user-friendly natural language queries into the complex data source specific queries required by underlying data sources, eliminating the need for users to know data keys, schemas, or structures while maintaining access to multiple data sources
Solution Approach 2:
The patent creates a universal query interface that can handle multiple different data sources with different schemas through a single unified natural language processing system. This multi-functional system adapts to various data source structures automatically, allowing users to query diverse federated data sources without learning multiple data models or schemas
2Extent of automation
If the system generates dynamic data filters based on natural language requests, then data retrieval becomes more automated and user-friendly, but the processing time and computational resources increase
Solution Approach 1:
The patent implements preliminary processing of natural language queries by analyzing and structuring them before execution against federated data sources. The system performs advance parsing, entity recognition, and query plan generation, which automates the complex translation process while optimizing execution efficiency to minimize processing time
Solution Approach 2:
The patent employs dynamic query generation that adapts to the specific characteristics of the requested information and available data sources. The system dynamically adjusts the level of automation and processing depth based on query complexity, data source responsiveness, and user needs, balancing automation benefits with processing time constraints
Data Source
AI summary
Methods, systems, and computer programs, for generating dynamic data filters. In one aspect, a data processing system is disclosed that is configured to perform operations that include receiving a data source agnostic information request (DSAIR), determining, based on the DSAIR, (i) one or more source selection keys and (ii) a data dictionary, identifying, by the data processing system, one or more data sources related to the received DSAIR using the one or more source selection keys, generating a dynamic data filter using one or more of the plurality of terms of the data dictionary, filtering, using the dynamic data filter, information in the one or more data sources that were identified using the source selection keys, and providing the filtered information from the one or more data sources for output by the user device.