Database Fast Access Storage Allocation for I/O Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mass storage I/O execution time remains a significant bottleneck in database management systems, affecting query resolution speed due to the need for intermediate files to be written and read from slower mass storage devices when they exceed cache size thresholds.
Innovation Solution
A method is introduced to optimize storage allocation by using a fast access storage flag to selectively allocate intermediate files to fast access storage data blocks, improving access times by utilizing faster storage devices for intermediate data rows.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If intermediate files are stored in mass storage devices, then storage capacity is sufficient, but I/O execution time increases
Solution Approach 1:
The patent segments storage into two distinct types: fast access storage (e.g., memory) and mass storage (e.g., disk). Intermediate files are selectively placed in fast access storage when possible, while mass storage provides backup capacity. This segmentation allows the system to optimize for speed when resources permit while maintaining adequate storage capacity when needed.
Solution Approach 2:
The patent applies local quality by creating a fast access storage pool specifically dedicated to intermediate files that require rapid access. Not all storage is treated uniformly - instead, a portion of storage is optimized for speed (fast access storage pool) while the rest provides general capacity (mass storage). This localized optimization resolves the contradiction by providing fast access where needed while maintaining overall storage capacity.
2Loss of time
If intermediate files are cached in file system cache memory, then I/O execution time decreases, but storage capacity is limited
Solution Approach 1:
The patent introduces a fast access storage pool as an intermediary between file system cache memory and mass storage devices. This intermediary layer provides larger capacity than cache memory while maintaining faster access speeds than mass storage. The fast access storage pool acts as a buffer that can hold intermediate files, reducing the need to repeatedly access slow mass storage while providing more space than limited cache memory alone.
3Productivity
If fast access storage is allocated to intermediate files, then query resolution speed increases, but storage allocation complexity increases
Solution Approach 1:
The patent implements self-service through automatic management of the fast access storage pool. The system autonomously allocates space in the fast access storage pool to intermediate files based on predefined criteria (such as file size thresholds or query importance), eliminating the need for manual intervention. This automatic management reduces allocation complexity while maintaining high query resolution speed by ensuring critical intermediate files are placed in fast storage.
Solution Approach 2:
The patent applies dynamics by making the fast access storage pool a dynamic, adjustable resource. The allocation of fast access storage can be modified based on system conditions, query characteristics, and available resources. This dynamic approach allows the system to optimize query resolution speed by adapting storage allocation in real-time while managing complexity through flexible, condition-based rules rather than rigid structures.
Data Source
AI summary
There is provided a method, a system and a machine readable medium to optimize storage allocation in a database management system. The method comprises receiving a processing step at a step processing module of an access module processor from a dispatcher module. The method further comprises determining whether a fast access storage flag is set in the processing step, the fast access storage flag indicating use of an intermediate file in fast access storage to store one or more redistributed data rows of a table of a database that is distributed across one or more storage devices of the database management system; Yet further the method comprises selectively allocating a free fast access storage data block to the intermediate file from a fast access storage pool based on the determination that the fast access storage flag is set. Lastly, the method comprises writing a redistributed data row from the one or more redistributed data rows to the allocated fast access storage data block.