Join Transform Mechanism for Reducing Intermediate Table Size
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies do not effectively reduce the size of intermediate tables generated during the process of aggregating and joining multiple tables, leading to increased processing loads.
Innovation Solution
An information processing device, method, and recording medium that utilize a join transform mechanism to optimize the transformation of programs, specifically by rearranging the inputs and outputs of aggregation and join processes, thereby reducing the size of intermediate tables.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional table join instructions are executed sequentially without optimization, then the processing logic is simple to implement, but the size of intermediate tables generated during the process increases, leading to increased processing load
Solution Approach 1:
The system performs preliminary analysis of the program to identify consecutive table join instructions where the second argument of the second join instruction is a data table generated by a first intermediate table generation instruction. This preliminary identification enables subsequent optimization by rearranging the execution order and arguments of these join instructions before actual data processing occurs, thereby reducing intermediate table sizes without adding runtime complexity
Solution Approach 2:
The system dynamically transforms the static execution order of table join instructions by identifying optimization opportunities and rearranging the sequence of operations. The transformation changes which tables are joined and in what order, making the processing flow adaptive and optimized based on data generation patterns rather than following a fixed sequential execution path
2Productivity
If intermediate tables are reduced in size through argument reassignment, then processing load is decreased, but the program transformation requires complex analysis and rewriting logic
Solution Approach 1:
The system introduces an intermediate transformation layer that acts as a mediator between the original program and its optimized version. This transformation logic analyzes the program structure, identifies consecutive join instructions with intermediate table generation patterns, and rewrites them with optimized argument assignments. The intermediary transformation process handles the complexity of analysis and rewriting, separating it from both the original program logic and the execution engine, thereby improving processing efficiency without permanently increasing system complexity
Data Source
AI summary
An information processing device sets: a first argument of a first table join instruction to a second table join instruction as the first argument of the second table join instruction; a second argument of the first table join instruction to the first table join instruction as the first argument of the first table join instruction; a first output data table generated by the first intermediate table generation instruction to the first table join instruction as the second argument of the first table join instruction; and a second output data table generated by the first table join instruction after changing the first and second arguments of the first table join instruction to the second table join instruction as the second argument of the second table join instruction.