Database Search Query Expansion via Synonym Frequency Thresholds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current database search queries often return either too many or too few results due to being too broad or narrow, leading to inefficiencies in data retrieval.
Innovation Solution
A system and method for expanding database search queries by tokenization, synonym candidate determination, and contextual expansion, using a query controller module and expansion module within a client-server architecture to refine search queries by adding relevant synonyms based on frequency and category association, thereby improving search relevance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the search query is made broader to retrieve more data items, then the quantity of search results increases, but the relevance and precision of search results deteriorates
Solution Approach 1:
The system performs preliminary actions by automatically expanding the search query before execution using synonym generation and category association. The expansion module pre-processes the query by identifying tokens, generating synonyms based on frequency and category data, and constructing an expanded query that includes both original terms and relevant synonyms, thereby ensuring high relevance without requiring broader initial queries
Solution Approach 2:
The expansion module acts as an intermediary between the user's original query and the database search. It receives the initial query, processes it through synonym generation and category association mechanisms, and produces an expanded query that mediates between the user's intent and the database structure, enabling precise matching without requiring overly broad search terms
2Measurement precision
If the search query is made narrower to improve relevance, then the search result precision improves, but the quantity of search results decreases
Solution Approach 1:
The system performs preliminary expansion of the query by automatically adding synonyms and related terms before the search executes. This pre-expansion ensures that even though the user provides a narrow query, the actual search covers broader relevant concepts, maintaining both precision and quantity of results
Solution Approach 2:
The system changes the query parameters by transforming the original query terms into an expanded set that includes synonyms, variations, and category-related terms. This parameter transformation allows the search to maintain narrow focus on relevant concepts while expanding the actual search scope to retrieve sufficient results
3Measurement precision
If synonym expansion is performed to improve search relevance, then the search query precision improves, but the system complexity increases
Solution Approach 1:
The system segments the complexity by dividing the synonym expansion process into distinct modules: tokenization module, synonym generation module, and query expansion module. Each module handles a specific aspect of the expansion process independently, making the overall complex task manageable and systematic. The expansion module further segments by processing tokens individually and applying different expansion strategies based on token characteristics
Solution Approach 2:
The system implements self-service by automatically generating synonyms and expanding queries without requiring manual intervention. The expansion module autonomously processes the query, identifies tokens, generates appropriate synonyms based on frequency and category data, and constructs the expanded query, thereby reducing the burden on users while managing system complexity internally
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In some embodiments, a method includes receiving a token that is usable in search queries for data in a database. The database includes items of data that are represented by data strings. The method also includes determining a synonym candidate for the token. The method includes adding the synonym candidate as a synonym for the token into an expansion dictionary in response to a determination that the number of data strings having the synonym candidate exceeds a threshold.