Dynamic Task Generation for Database Resource Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database management systems (DBMS) face challenges in effectively utilizing CPU, memory, and I/O resources due to the need to specify a fixed task count, leading to inefficiencies in query processing time and resource utilization.

Innovation Solution

A database management apparatus dynamically generates tasks based on resource utilization, acquiring and adjusting task counts to ensure optimal use of CPU, memory, and I/O resources by monitoring and adjusting task execution in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a fixed task count is specified in a DBMS, then the system structure is simple and easy to implement, but resource utilization becomes inefficient and query processing time increases

Engineering Contradiction:
Improvesystem structureVSAvoidresource utilization
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements dynamic task generation by the query execution module, which automatically adjusts the number of tasks based on real-time resource utilization conditions. Instead of using a fixed predetermined task count, the system dynamically creates tasks during query execution, allowing the task count to adapt to changing system conditions and resource availability, thereby resolving the contradiction between simple structure and efficient resource utilization.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If a fixed task count is specified in a DBMS, then the configuration is easy to manage, but CPU resources, memory resources, and I/O resources cannot be utilized effectively

Engineering Contradiction:
Improveconfiguration managementVSAvoidresource utilization
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The query execution module autonomously determines the number of tasks to generate based on current resource utilization conditions without requiring external configuration or manual intervention. The system monitors CPU resources, memory resources, and I/O resources automatically and adjusts task generation accordingly, enabling the system to self-optimize resource utilization while maintaining ease of operation.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If different processing is applied to each query in a DBMS, then query-specific optimization is achieved, but resource utilization becomes unbalanced and overall system efficiency decreases

Engineering Contradiction:
Improvequery-specific processingVSAvoidresource utilization balance
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system implements a feedback mechanism where the query execution module continuously monitors resource utilization conditions and adjusts task generation dynamically. This feedback loop ensures that while each query receives appropriate processing attention, the overall resource utilization remains balanced across the system, preventing any single query from monopolizing resources and maintaining overall system efficiency.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10515078B2Database management apparatus, database management method, and storage medium
Publication Date: 2019.12.24 HITACHI LTD
  • US10515078B2 patent drawing
  • US10515078B2 patent drawing
  • US10515078B2 patent drawing

AI summary

Provided is a database management apparatus, having a processor, a memory, and a storage device, whereby a database which is stored in the storage device is managed, the database management apparatus further comprising: a query acceptance unit which accepts a query to the database; a query execution plan generating unit which generates a query execution plan which includes a database operation which is necessary for executing the accepted query; and a query execution unit which, in executing the accepted query on the basis of the generated query execution plan, dynamically generates a task for executing the database operation, and executes the dynamically generated task. The query execution unit acquires a resource usage state, and, when executing the next database operation, generates a new task on the basis of the resource usage state, and executes the new task in parallel with the task.