Database Storage Unit Allocation for Concurrent Bulk Loads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database systems face challenges in efficiently executing concurrent database operations, particularly in releasing allocated space back to the file system without inducing conflicts with other concurrent workloads, especially during mass operations like bulk loads.

Innovation Solution

A method is introduced to determine the usage speeds of free storage units for concurrent database operations, allowing the execution of database operations within a time window by limiting the first database operation to storage units and reallocating resources for the second database operation, thereby optimizing resource sharing and avoiding conflicts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a process releasing free space is executed to release allocated space back to the file system, then space utilization is improved, but conflicts are induced with other concurrent workloads using the space

Engineering Contradiction:
Improvefree spaceVSAvoidconcurrent operation stability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent dynamically adjusts the number of free storage units allocated to the second database operation based on the usage speed of the first database operation. This dynamic allocation allows the system to release space back to the file system while adapting to the changing needs of concurrent workloads, preventing conflicts while improving space utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of free storage unit allocation by determining a maximum number of free storage units for the second database operation based on the usage speed of the first operation. This parameter adjustment enables the system to optimize space release while maintaining sufficient resources for concurrent operations.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If mass operations like bulk loads are executed that need many new pages in a very short time window, then productivity is improved, but conflicts are induced with other concurrent running workloads using the space

Engineering Contradiction:
Improvebulk load speedVSAvoidconcurrent operation stability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary determination of the maximum number of free storage units for the second database operation before the bulk load operation executes. This preliminary action ensures that sufficient storage units are reserved for the high-speed bulk load while still allowing the space release process to proceed, preventing conflicts between operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent allows the second database operation to use a limited (partial) number of free storage units determined by the maximum number, rather than allowing full access to all free space. This partial allocation is sufficient to maintain concurrent operation stability while enabling the first database operation to execute bulk loads at high speed.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If the execution of the first database operation is limited to storage units of the storage space, then resource conflicts are reduced, but resource utilization efficiency may be affected

Engineering Contradiction:
Improveconcurrent operation stabilityVSAvoiddatabase operation efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent uses feedback from the determined usage speed of the first database operation to adjust the maximum number of free storage units allocated to the second operation. This feedback mechanism ensures that the resource limitation for the first operation is optimized based on actual usage patterns, maintaining both stability and efficiency.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11409727B2Concurrent execution of database operations
Publication Date: 2022.08.09 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11409727B2 patent drawing
  • US11409727B2 patent drawing
  • US11409727B2 patent drawing

AI summary

The present disclosure relates to executing concurrent database operations in a database system during a time window. The database operations are configured to use storage units of a storage space of the database system. A first usage speed of free storage units is determined to be used by at least one first database operation and a second usage speed of free storage units to be used by a second database operation. The first and second usage speeds may be used for determining a maximum number of free storage units to be used by the second database operation during the time window. The second database operation may be executed during the time window in accordance with the maximum number. The first database operation may be executed, wherein the execution of the first database operation during the time window being limited to the storage units of the storage space.