Deep Reinforcement Learning for Database Tuning Automation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current physical database design and tuning in relational database management systems are manually intensive and rely on inaccurate Query Optimizer-based Advisor tools, which overburden database administrators and fail to provide effective automated solutions due to challenges like large feature sets, complex permissible action sets, and the need for precise reward functions in commercial database query processing environments.

Innovation Solution

A Deep Reinforcement Learning (DRL) based feedback loop process is integrated with existing Query Optimizer-based Advisor tools to automate physical database design and tuning, using a neural network framework that learns from query workloads, reverses unsuccessful tuning actions, and operates in observation and active modes to improve recommendation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If Query Optimizer-based Advisor tools are used for physical database design and tuning, then automated tuning recommendations can be provided, but the accuracy and effectiveness of the recommendations are insufficient

Engineering Contradiction:
Improvetuning recommendation accuracyVSAvoidtuning effectiveness
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors query performance metrics after applying tuning actions, compares actual performance against expected improvements, and uses this feedback to refine future tuning recommendations. This closed-loop approach enables the system to learn from past actions and progressively improve recommendation accuracy while ensuring reliability through performance validation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary analysis of query workloads, database schemas, and performance patterns before generating tuning recommendations. By pre-processing and understanding the query characteristics and database structure in advance, the system can provide more accurate and effective recommendations rather than relying solely on generic Advisor tool outputs.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If manual physical database design and tuning is performed, then precise control over database performance can be achieved, but the process becomes highly labor intensive and time consuming

Engineering Contradiction:
Improvetuning control precisionVSAvoidtuning time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements a self-service tuning system that automatically analyzes query workloads, identifies performance bottlenecks, generates tuning recommendations, applies optimizations, and validates results without requiring manual database administrator intervention for each tuning task. The system serves itself by continuously learning from performance data and autonomously making tuning decisions, thereby eliminating time loss while maintaining precise control over database performance.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual process of database tuning with an automated intelligent system that uses machine learning algorithms to analyze performance patterns, generate recommendations, and apply optimizations. This substitution transforms the manual, time-consuming tuning process into an automated system that maintains precision while dramatically reducing the time and effort required.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Extent of automation

If existing Advisor tools are used for automated tuning, then some automation is provided, but the tools overburden database administrators and fail to provide effective solutions

Engineering Contradiction:
Improvetuning automation levelVSAvoidadministrator workload
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent implements a self-service tuning system that autonomously performs workload analysis, recommendation generation, and optimization application without requiring database administrators to manually review or manage each tuning action. The system independently monitors performance, learns from outcomes, and self-corrects, thereby providing high-level automation while reducing administrator workload rather than burdening them with additional manual tasks.

Inventive Principle:
Principle #25Self-service

4Measurement precision

If comprehensive query workload analysis is performed to improve tuning accuracy, then the quality of recommendations improves, but the system complexity and computational requirements increase

Engineering Contradiction:
Improverecommendation qualityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex query workload analysis into distinct modular components: query parsing, pattern recognition, performance metric collection, recommendation generation, and validation. Each module handles a specific aspect of the analysis independently, which reduces overall system complexity while maintaining comprehensive analysis capabilities. This modular architecture allows the system to process complex workloads without becoming unmanageably complicated.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary processing and categorization of query workloads before detailed analysis, pre-identifying patterns and characteristics that will guide subsequent tuning recommendations. By preparing and organizing query data in advance, the system reduces the computational complexity of the main analysis phase while maintaining high recommendation quality through thorough preliminary examination.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11593334B2Physical database design and tuning with deep reinforcement learning
Publication Date: 2023.02.28 TERADATA US INC
  • US11593334B2 patent drawing
  • US11593334B2 patent drawing
  • US11593334B2 patent drawing

AI summary

An apparatus, method and computer program product for physical database design and tuning in relational database management systems. A relational database management system executes in a computer system, wherein the relational database management system manages a relational database comprised of one or more tables storing data. A Deep Reinforcement Learning based feedback loop process also executes in the computer system for recommending one or more tuning actions for the physical database design and tuning of the relational database management system, wherein the Deep Reinforcement Learning based feedback loop process uses a neural network framework to select the tuning actions based on one or more query workloads performed by the relational database management system.