Database Search System Using Incremental Result Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of big data platforms face challenges in efficiently searching and retrieving relevant data from numerous database data structures, often requiring manual identification of relevant data structures for analysis and reporting, which can be time-consuming and inefficient.
Innovation Solution
A method and system that parse search queries into sets of terms, query multiple database data structures in parallel, and generate result data structures based on metadata and data matches, allowing for incremental and ranked results to be returned, reducing the need for users to wait for complete searches and minimizing data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual identification of database data structures is used for analysis and reporting, then data accuracy can be ensured, but time consumption increases significantly
Solution Approach 1:
The patent replaces manual mechanical identification of database data structures with an automated natural language processing system. The system parses user questions, identifies relevant data structures and fields automatically, and generates queries without manual intervention, thereby eliminating time consumption while maintaining accuracy through systematic processing
Solution Approach 2:
The system enables self-service by allowing users to directly query the database using natural language without needing to manually identify data structures. The automated system handles the complex task of mapping user questions to appropriate database schemas, fields, and queries independently
2Loss of information
If complete database searches are performed to ensure comprehensive results, then result completeness is improved, but user waiting time increases
Solution Approach 1:
The patent implements incremental result generation where the system returns partial results as soon as they are available rather than waiting for complete processing. Users receive initial relevant results quickly and can continue to receive additional results, achieving a balance between speed and completeness
Solution Approach 2:
The system performs preliminary parsing and identification of relevant data structures before executing full queries. By pre-processing the user question to identify key entities, fields, and relationships, the system prepares the query structure in advance, enabling faster result generation and incremental return of results
3Loss of information
If all matching data is returned to ensure comprehensive results, then result completeness is improved, but data transfer volume increases
Solution Approach 1:
The patent extracts and returns only the specific data fields that are relevant to the user's question rather than returning all matching data. The system identifies and extracts only the necessary columns and rows that directly answer the query, reducing data transfer volume while maintaining result completeness
Solution Approach 2:
The system applies local quality by providing different levels of data detail based on specific user needs. Rather than uniformly returning all data, the system tailors the result set to include only the specific fields and aggregation levels that are relevant to each particular query, optimizing data transfer efficiency
Data Source
AI summary
Method and systems may be used to provide search results in response to plain language queries from a database. A search query may be received and a database may be queried. A metadata search of the database data structures may be performed to determine a search set based on the search query. Using the search set, a data search may be performed to determine the database data structures for a result set. Result data structures may be generated based on the result set. The result data structures may be iteratively provided to a client to display the search results responsive to the search query quickly. The relevant data may be retrieved from the database in response to a selection. In some instances, the results retrieved from the database in response to a selection of a result data structure may be limited based on a count parameter.


