Frequency-Based Worksheet Filtering for Cloud Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern businesses face challenges in efficiently presenting large amounts of data from cloud-based data warehouses due to excessive query responses, which overwhelm web applications.
Innovation Solution
The implementation of top frequency worksheet filtering, which involves sending a request for distinct values with the greatest frequency in a data set, allowing users to select and filter data based on these values, thereby reducing the data presentation to a manageable size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all data from cloud-based data warehouses is queried and presented, then complete data accessibility is achieved, but web application performance deteriorates due to excessive data volume
Solution Approach 1:
The patent extracts only the most frequently occurring distinct values from the complete data set and presents them to users for selection. This extraction approach allows users to access relevant data without loading the entire data set, thereby maintaining data accessibility while improving web application performance by significantly reducing the volume of data transferred and processed.
2Loss of information
If the complete data set is presented to users, then comprehensive data analysis is enabled, but data processing time increases due to large data volume
Solution Approach 1:
The system performs preliminary analysis to identify and store the most frequently occurring distinct values before user interaction. When users query the data, they receive pre-processed, filtered results immediately without requiring the system to process the entire data set in real-time. This preliminary action reduces data processing time while maintaining access to the most relevant information.
3Measurement precision
If frequent queries are executed on large data sets, then accurate results are obtained, but system resource consumption increases
Solution Approach 1:
The system pre-calculates and stores frequency information for distinct values in the data set. When queries are executed, the system uses this pre-computed frequency data to quickly filter and return results without performing expensive full-data-set scans. This approach maintains query result accuracy while significantly reducing system resource consumption for frequent queries.
Data Source
AI summary
Top frequency worksheet filtering including sending a first request comprising a first search term; receiving, in response to the first request, a first plurality of distinct values having a greatest frequency in a data set and responsive to the first search term, wherein the first plurality of distinct values comprises a number of distinct values less than or equal to a size threshold; presenting the first plurality of distinct values; receiving a selection of a first value from the first plurality of distinct values; and filtering, based on the selected first value, a worksheet comprising a presentation of the data set.