Binary Filtering for Pivot Table Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In large source data tables, generating pivot tables is inefficient due to high computational complexity and time required for filtering and logical operations, especially when dealing with numerous filtering conditions and records.
Innovation Solution
A method and apparatus that convert filtering conditions into binary numbers, perform logical operations on these numbers based on their relationships, and use the results to determine records for pivot table generation, thereby simplifying the process and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional filtering methods are used on large source data tables, then filtering accuracy is maintained, but data processing time and computational complexity increase significantly
Solution Approach 1:
The patent transforms filtering conditions into binary numerical representations, changing the parameter format from textual/logical conditions to numerical values. This enables the use of efficient numerical operations (bitwise AND, OR, NOT) instead of traditional string matching or record-by-record evaluation, significantly reducing processing time while maintaining filtering accuracy
Solution Approach 2:
The patent replaces the mechanical process of record-by-record filtering evaluation with a numerical computation system. By converting filtering conditions to binary numbers and using bitwise operations, the system substitutes the traditional mechanical filtering approach with a more efficient numerical calculation method that scales better with large datasets
2Manufacturing precision
If multiple filtering conditions are applied to ensure accurate pivot table generation, then result precision is improved, but computational complexity increases
Solution Approach 1:
The patent converts multiple filtering conditions into binary numerical parameters, where each condition becomes a bitwise operation. This transformation reduces the complexity of combining multiple conditions from O(n*m) where n is records and m is conditions, to O(1) bitwise operations on numerical representations, maintaining precision while reducing computational complexity
Solution Approach 2:
The patent merges multiple filtering conditions into a single numerical computation process. By representing all filtering conditions as binary numbers and using bitwise operations (AND for intersection, OR for union), the system combines multiple conditions in a unified numerical framework rather than processing them separately through multiple filtering passes
3Reliability
If traditional record filtering methods are used, then data accuracy is maintained, but data processing efficiency decreases
Solution Approach 1:
The patent changes the parameter representation from textual filtering conditions to binary numerical values, enabling efficient bitwise operations. This maintains data accuracy because the binary representation preserves the logical relationships of filtering conditions while allowing parallel processing and mathematical operations that are much faster than traditional record-by-record evaluation
Solution Approach 2:
The patent creates a numerical copy (binary representation) of the filtering conditions without modifying the original data. This numerical copy can be processed efficiently through bitwise operations to determine which records satisfy the conditions, maintaining data accuracy by referencing the original records only when needed for final output
Data Source
AI summary
A method, apparatus and electronic device for data processing are provided. A specific implementation of the method comprises: obtaining a plurality of filtering conditions for filtering data in a data table and a logical relationship between the plurality of filtering conditions; determining a first numerical value corresponding to each filtering condition among the plurality of filtering conditions, wherein the first numerical value corresponding to a filtering condition is determined by at least one first record obtained according to the filtering condition; performing a logical operation based on the first numerical value and the logical relationship between the plurality of filtering conditions; and determining a record to generate a pivot table. The implementation can simplify the process of generating a pivot table and improve the speed of generating the pivot table.