Slot-Based Query Execution for Schema-Less Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional query processing systems are inefficient in executing queries against non-relational or schema-less databases, as they often pass entire data objects between stages, leading to unnecessary data transmission and additional processing steps, and cannot optimize for diverse data structures.
Innovation Solution
A query processing system that generates a slot-based execution (SBE) plan by optimizing logical representations of queries, reducing data transmission to individual values between stages and customizing search operations for different data structures, thereby eliminating unnecessary data passing and reformatting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional query processing systems pass entire data objects between stages, then data transmission is simplified, but data transmission volume increases and processing time increases
Solution Approach 1:
The patent segments data objects into individual fields and values, transmitting only the specific field values needed for query execution between processing stages rather than entire data objects. This segmentation reduces data transmission volume while maintaining query processing efficiency.
Solution Approach 2:
The patent extracts only the necessary field values from data objects that are required for query execution, eliminating unnecessary data transmission. The slot-based execution plan extracts specific values and passes them between stages, reducing the quantity of transmitted data.
2Productivity
If conventional query processing systems pass entire data objects between stages, then data integrity is maintained, but additional processing steps are required
Solution Approach 1:
The patent performs preliminary actions by generating a slot-based execution plan that identifies and prepares only the necessary field values before execution. This preliminary planning reduces the processing steps required during actual query execution, as the system knows exactly what data to extract and transmit.
Solution Approach 2:
The slot-based execution plan enables the system to self-configure the data transmission process by automatically identifying which field values are needed and setting up the appropriate slots for their transmission, eliminating the need for complex manual processing steps.
3Productivity
If conventional query processing systems use generic processing approaches, then system simplicity is maintained, but optimization for diverse data structures is lost
Solution Approach 1:
The patent applies local quality by customizing the slot-based execution plan for specific data structures and query requirements. Different slots can be configured with different properties based on the specific data structure being queried, allowing optimization for diverse data structures while maintaining a unified processing framework.
Data Source
AI summary
Described herein embodiments of a query processing system. The query processing system optimizes execution by generating an optimized slot-based execution (SBE) plan for executing the query. The query processing system optimizes query execution by generating a logical representation of the query, optimizing the logical representation of the query, and translating the optimized logical representation of the query into an SBE plan. The query processing system then executes the SBE plan to generate the query results.