Database Tuning via Deep Reinforcement Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database performance tuning tools, such as OtterTune, face challenges in providing optimal configuration parameters across different stages of database operation due to their model-based methods, leading to inadequate cooperation between stages and poor performance tuning results.

Innovation Solution

A database performance tuning method utilizing a deep reinforcement learning model with two networks: a first network for providing a recommendation policy for configuration parameters based on a status indicator, and a second network for evaluating this policy to ensure optimal recommendations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a model-based method with multiple stages is used for database performance tuning, then the tuning process can be divided into manageable stages, but the different stages fail to cooperate adequately and provide poor recommended configuration parameters

Engineering Contradiction:
Improvetuning process structureVSAvoidparameter recommendation accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges multiple separate tuning stages into a unified deep reinforcement learning model. The actor-critic architecture integrates the recommendation policy (actor) and evaluation (critic) into a single coordinated system, eliminating the cooperation problems between separate stages while maintaining the benefits of structured tuning processes.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of manufacture

If a pipeline method is used to process database tuning through multiple models, then each stage can be optimized independently, but the overall model provides poor recommended configuration parameters due to lack of coordination between stages

Engineering Contradiction:
Improvemodel developmentVSAvoidparameter tuning precision
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent implements feedback through the critic network that continuously evaluates the actor's recommendations and provides guidance for improvement. This closed-loop feedback mechanism ensures that each tuning decision is optimized based on actual performance outcomes, maintaining both independent optimizability and overall coordination.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The critic network performs preliminary evaluation of potential tuning actions before they are executed, allowing the system to learn from anticipated outcomes. This preliminary action mechanism enables independent stage optimization while ensuring overall coordination through pre-evaluation of recommendations.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If traditional database performance tuning tools are used, then they can provide some recommendations, but they fail to provide optimal configuration parameters across different stages of database operation

Engineering Contradiction:
Improvetuning efficiencyVSAvoidadaptability to different database stages
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics through the deep reinforcement learning model that continuously adapts its recommendations based on real-time database state and performance feedback. The actor-critic architecture allows the system to dynamically adjust tuning parameters across different database stages, providing both efficiency and adaptability.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12287768B2Database performance tuning method, apparatus, and system, device, and storage medium
Publication Date: 2025.04.29 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12287768B2 patent drawing
  • US12287768B2 patent drawing
  • US12287768B2 patent drawing

AI summary

A database performance tuning method is provided, including: receiving a performance tuning request of tuning a configuration parameter of a target database; obtaining a status indicator of the target database; and inputting the status indicator of the target database into a deep reinforcement learning model, and outputting a recommended configuration parameter of the target database. The deep reinforcement learning model includes a first deep reinforcement learning network and a second deep reinforcement learning network. The first deep reinforcement learning network is configured to provide a recommendation policy for outputting a recommended configuration parameter according to a status indicator, and the second deep reinforcement learning network is configured to evaluate the recommendation policy provided by the first deep reinforcement learning network.