Query Cached Filter Using CFI for Selective Data Scanning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing database query methods are inefficient in handling repeated queries, leading to unnecessary data scanning and processing delays.
Innovation Solution
Implementing a query cached filter system that uses condition fulfillment information (CFI) to identify irrelevant data groups, allowing for selective scanning and caching of query conditions, thereby optimizing query responses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional database query methods are used to handle repeated queries, then all data must be scanned to ensure accurate results, but this leads to unnecessary data scanning and processing delays
Solution Approach 1:
The patent applies preliminary action by pre-computing and caching condition fulfillment information (CFI) for query conditions before actual queries are executed. The system caches filtered data groups that already satisfy certain conditions, so when a query arrives, the system can directly use the pre-computed CFI to identify relevant data without scanning all data again. This resolves the contradiction by preparing results in advance, ensuring accuracy while eliminating repeated scanning delays.
Solution Approach 2:
The patent uses copying by creating and storing cached representations of data groups that fulfill specific conditions. Instead of scanning the original full dataset for every query, the system maintains cached copies of filtered data subsets with their CFI. When a query matches cached conditions, the system retrieves results from these copies rather than re-scanning source data, thus maintaining reliability while dramatically reducing processing time.
2Reliability
If all data is scanned for every query to ensure complete results, then query accuracy is maintained, but query response time increases
Solution Approach 1:
The patent applies segmentation by dividing the complete dataset into multiple data groups, each associated with specific query conditions and their CFI. Instead of treating all data as a single unit that must be scanned completely, the system segments data into manageable subsets that can be independently evaluated and cached. When a query arrives, only relevant segments need to be checked against cached CFI, ensuring query completeness while significantly improving response speed by avoiding full data scans.
Solution Approach 2:
The system performs preliminary action by pre-evaluating and caching the CFI for each data group segment before queries are executed. This advance preparation allows the system to quickly determine which segmented data groups are relevant to incoming queries without scanning their contents. The pre-computed CFI segments enable rapid query response while maintaining completeness by ensuring all relevant segments are identified.
3Productivity
If query condition caching is implemented to speed up repeated queries, then processing efficiency improves, but system complexity increases
Solution Approach 1:
The patent introduces an intermediary component - the condition fulfillment information (CFI) cache - that mediates between the query processor and the segmented data groups. This intermediary stores pre-computed condition evaluations and provides quick lookup capabilities without requiring complex real-time analysis. By inserting this CFI intermediary layer, the system achieves high query processing efficiency through simple cache lookups while managing complexity by keeping the caching mechanism as a distinct, manageable component rather than embedding it throughout the entire system.
Data Source
AI summary
A method for responding to a query, the method may include (a) receiving, by a storage system compute element, a query that comprises one or more conditions related to a content of at least one data unit (DU); (b) searching, based on the one or more conditions and on a condition fulfillment information (CFI), for one or more irrelevant groups of DUs to be skipped during the responding to the query; wherein the one or more irrelevant groups of DUs belong to multiple stored groups of DUs that are stored in the storage system; wherein an irrelevant group of DU does not comprise, according to the CFI, any DU that fulfills the one or more conditions; and (c) generating a response to the query based on an outcome of the searching.