Columnar Venn Diagram Computation with Ordered Set Loading
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques for generating Venn diagrams in data mining systems are inefficient as they load the same data multiple times, leading to excessive computing resource consumption.
Innovation Solution
A data mining system using a columnar database management system efficiently determines intersection sets by loading data combinations in an ordered manner, reusing data for subsequent computations and utilizing a truth table to rank set combinations for optimized processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If conventional techniques load data multiple times for each set operation step, then each operation can be performed independently, but computing resource consumption increases significantly
Solution Approach 1:
The system performs preliminary actions by loading data sets in advance and maintaining them in memory buffers. The truth table is pre-computed to determine the optimal execution order of set operations, allowing the system to reuse loaded data across multiple operations without reloading, thereby reducing computing resource consumption while maintaining operational ease
Solution Approach 2:
The system changes the parameter of data loading strategy from loading data on-demand for each operation to loading data once and reusing it. The execution order parameter is optimized using truth tables, transforming the approach from independent sequential operations to an optimized sequence that maximizes data reuse, significantly reducing energy consumption
2Reliability
If data is loaded multiple times for different set operations, then each operation has access to complete data, but the time required for Venn diagram generation increases
Solution Approach 1:
The system performs preliminary data loading and truth table computation before executing set operations. By pre-determining the optimal execution order through truth tables and pre-loading necessary data into memory, the system ensures data completeness is maintained while eliminating redundant loading operations, significantly reducing generation time
Solution Approach 2:
The system maintains continuous useful action by keeping data loaded in memory buffers and reusing it across multiple set operations. The optimized execution sequence ensures that data loaded for one operation is immediately available for subsequent operations, eliminating idle loading time and maintaining continuous productive computation
3Device complexity
If conventional techniques perform set operations without optimizing data loading order, then implementation is simple, but computing resources are wasted
Solution Approach 1:
The system introduces a truth table parameter to track which data sets have been loaded and which operations can reuse that data. By changing the execution order parameter based on truth table analysis, the system identifies optimal sequences that maximize data reuse, preventing computing resource waste while adding only moderate implementation complexity
Solution Approach 2:
The system implements feedback mechanisms through truth tables that track data loading status and operation requirements. This feedback information is used to dynamically determine the execution order of set operations, ensuring that data is loaded only when necessary and reused wherever possible, thereby preventing computing resource waste
Data Source
AI summary
Venn diagrams are computed for a given plurality of input sets. The process of computing the Venn diagrams is executed on columnar database systems for efficient execution. The computation of various subsets of the Venn diagrams is performed by determining subsets of various combinations of the input sets and computing set differences of the intersection sets. The process orders the execution of various steps of computing the subsets for the Venn diagram in an order that reduces the number of times an input set is loaded. Information describing various subsets of a Venn diagram is used to render the Venn diagram for display, for example, on a client device.