Automatic Query System via Metadata Registration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Analysts face inefficiencies and inaccuracies when building search queries across multiple tables and databases, due to cryptic data sources and unstructured institutional knowledge, requiring extensive trial and error and months of training.
Innovation Solution
An automatic query system that allows users to select tables, columns, and value filters using meta-data from data set registrations, enabling the execution of customized join queries without requiring detailed knowledge of the underlying data tables.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If analysts manually identify data sources and build search queries using traditional methods, then they can access data in various tables, but the process is inefficient and requires extensive training due to cryptic formatting and unstructured institutional knowledge
Solution Approach 1:
The patent introduces an intermediary layer between the user and the database system. This intermediary automatically translates natural language queries into SQL queries by accessing registered data sets and their metadata, eliminating the need for users to manually navigate complex table structures and cryptic formatting.
Solution Approach 2:
The system performs preliminary actions by pre-registering data sets with their schemas, metadata, and relationships before query execution. This preliminary registration creates a structured catalog that enables automatic query translation, reducing the complexity of real-time query processing.
2Measurement precision
If analysts rely on unstructured institutional knowledge and trial and error techniques to locate data, then they can eventually find the required information, but the process is inaccurate and time-consuming
Solution Approach 1:
The system incorporates feedback mechanisms where the automatic query translation process learns from registered data sets and their metadata. The system provides feedback to users about available data sets and their structures, enabling accurate data location without trial and error approaches.
Solution Approach 2:
The patent creates structured copies of unstructured institutional knowledge by registering data sets with standardized schemas and metadata. This copying process transforms cryptic formatting into organized, queryable structures that can be efficiently searched and accessed.
3Reliability
If users need detailed knowledge of underlying data tables to build queries, then they can construct accurate search queries, but extensive training is required which reduces accessibility
Solution Approach 1:
The system enables self-service by automatically translating user intent into accurate SQL queries without requiring users to have detailed knowledge of underlying data tables. The automatic query translation handles the complexity of table relationships and column mappings, making the system accessible to non-experts while maintaining query accuracy.
4Ease of operation
If the system provides a user-friendly interface for selecting data sets, then ease of operation improves, but the device complexity increases due to the need for metadata management and automatic query translation
Solution Approach 1:
The patent segments the system into distinct functional modules: data set registration, metadata management, natural language processing, SQL query generation, and result delivery. This segmentation allows the complex automatic query translation functionality to be managed through separate, well-defined components, making the system more maintainable despite its increased capabilities.
Data Source
AI summary
Methods and systems described herein are directed to creating customized queries on data sets via selection of search elements based on meta-data from data set registrations. In some implementations, an automatic query system can register database elements with associated meta-data by receiving programming data objects, corresponding to database elements, with meta-data and adding the programming objects as selectable values for a user interface (UI). Each data object can define one or more elements for a table and/or column(s) within a table in a database. The automatic query system can provide the UI to a user to receive table and column selections. The automatic query system can select a root table to join the selected tables into, and generate a join query for the root table by inserting search string snippets, corresponding to selected tables and columns, into a query template.


