Connection-Field Query Flow for Full-Text and Association Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data retrieval systems face challenges in simultaneously performing full-text retrieval and association retrieval efficiently, leading to memory overflow risks and performance issues due to large intermediate result sets and network data transmission.
Innovation Solution
A method and system that combines a full-text retrieval system with a target type database, using a connection field to associate indexes with data tables, allowing for efficient querying by determining query conditions in both systems sequentially to obtain a target query result.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If caching intermediate result sets in memory is used for association query, then query performance is improved, but memory overflow risk increases
Solution Approach 1:
The patent extracts only the necessary connection field values from the intermediate result sets and stores them in a temporary table, rather than caching entire intermediate result sets in memory. This reduces memory consumption while maintaining query performance, as only essential linking data is retained.
Solution Approach 2:
The patent uses temporary tables that are automatically discarded after query completion, rather than maintaining large in-memory caches. This approach provides sufficient performance for association queries while avoiding permanent memory allocation that could lead to overflow, as the temporary storage is ephemeral and reused.
2Adaptability or versatility
If intermediate result sets are transmitted over network, then distributed query capability is achieved, but performance degradation occurs
Solution Approach 1:
The patent performs preliminary full-text retrieval operations locally at each node before network transmission, obtaining intermediate result sets and their connection field values in advance. This preliminary local processing reduces the amount of data that needs to be transmitted over the network and minimizes network latency impact on overall query performance.
Solution Approach 2:
The patent extracts only the connection field values from intermediate result sets for network transmission to the coordinate node, rather than transmitting complete intermediate result sets. This extraction approach significantly reduces network bandwidth consumption and transmission time while preserving the ability to perform distributed association queries.
3Productivity
If full-text retrieval system is used for single table retrieval, then retrieval performance is improved, but association retrieval capability is weakened
Solution Approach 1:
The patent makes the full-text retrieval system multi-functional by enabling it to perform both single-table full-text retrieval and multi-table association retrieval through coordinated operation with temporary tables. The system maintains its high retrieval performance for full-text operations while gaining association query capability through the temporary table mechanism that stores connection field values from multiple indexes.
Solution Approach 2:
The patent introduces temporary tables as an intermediary structure between the full-text retrieval system and association query operations. These temporary tables store connection field values and serve as a bridge that enables the full-text retrieval system to perform association queries across multiple tables while maintaining its core full-text retrieval performance.
Data Source
AI summary
Embodiments of the present disclosure provides a method and a system for data query. The method may include obtaining a query request; determining a first query condition based on the query request; obtaining a field query result relating to a connection field by querying, based on the first query condition, in a full-text retrieval system, wherein the full-text retrieval system may store one or more indexes; determining a second query condition based on the field query result; and obtaining a target query result by querying, based on the second query condition, in a target type database, wherein the target type database may store one or more target type data tables, and the one or more indexes may be associated with data in the one or more target type data tables via the connection field.