Slot-Based Query Execution for Schema-Less Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional query processing systems are inefficient in executing queries against non-relational or schema-less databases, as they often require passing entire data objects between stages, adding unnecessary processing steps and degrading performance, and cannot optimize for diverse data structures.
Innovation Solution
A query processing system that generates a slot-based execution (SBE) plan by optimizing logical representations of queries, reducing data transmission to individual values between stages, and customizing search operations for different data structures, thereby eliminating unnecessary data passing and reformatting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional query processing systems pass entire data objects between stages, then data can be accessed and processed, but data transmission volume increases and performance degrades
Solution Approach 1:
The patent segments data objects into individual field values and passes only the required values between query processing stages. Instead of transmitting entire data objects, the system extracts and transmits only the specific field values needed for each stage, significantly reducing data transmission volume while maintaining query execution efficiency.
Solution Approach 2:
The system extracts only the necessary field values from data objects for transmission between query processing stages. By taking out only the required data elements rather than passing complete objects, the system reduces unnecessary data transmission while ensuring all needed information is available for query execution.
2Adaptability or versatility
If conventional systems process diverse data structures, then various data formats can be handled, but processing complexity increases
Solution Approach 1:
The patent applies local quality by customizing search operations specifically for array data structures. Instead of using a generic processing approach for all data types, the system implements specialized handling for arrays, optimizing performance for this particular data structure while maintaining compatibility with other formats through targeted rather than universal complexity.
Data Source
AI summary
Described herein embodiments of a query processing system. The query processing system optimizes execution by generating an optimized slot-based execution (SBE) plan for executing the query. The query processing system optimizes query execution by generating a logical representation of the query, optimizing the logical representation of the query, and translating the optimized logical representation of the query into an SBE plan. The query processing system then executes the SBE plan to generate the query results.