Dynamic Cost Profile Evolution for Heterogeneous Database Workloads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Static cost profiles are ineffective for heterogeneous workloads, as they do not adapt well to varying resource configurations and usage patterns, particularly in cloud deployments where resources can change over time, leading to suboptimal query execution plans.

Innovation Solution

A relational database management system (RDBMS) dynamically evolves a default cost profile into a multi-dimensional matrix of cost profiles using fixed or dynamic evolution methods, and employs a random or biased walk scoring algorithm to identify the optimal cost profile for each workload, ensuring efficient query execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If static cost profiles are used for query optimization, then the system configuration is simple and stable, but the query execution plan is suboptimal for heterogeneous workloads and changing resource configurations

Engineering Contradiction:
Improvequery execution efficiencyVSAvoidcost profile management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent transforms static cost profiles into dynamic cost profiles that automatically adapt to changing workload characteristics and resource configurations. The system continuously learns from executed queries and updates cost profiles in real-time, enabling the query optimizer to select execution plans that are optimal for the current system state rather than relying on predetermined static values.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements self-service through automatic cost profile learning and update mechanisms. The query optimizer autonomously monitors workload patterns, resource utilization, and execution performance, then automatically adjusts cost profiles without requiring manual intervention or reconfiguration by system administrators.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If static cost profiles are deployed for various system configurations, then the deployment process is simple, but the cost profile effectiveness deteriorates for heterogeneous workloads

Engineering Contradiction:
Improvecost profile adaptability to workloadVSAvoidoperational simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system implements feedback loops where execution performance metrics are continuously collected and fed back into the cost profile learning mechanism. The query optimizer monitors actual execution costs versus estimated costs, and uses this feedback to refine cost profiles for different workload types and resource configurations, progressively improving adaptability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent dynamically adjusts cost profile parameters based on learned workload characteristics and resource performance. Instead of using fixed cost values, the system modifies cost parameters in real-time to reflect actual system behavior, enabling effective adaptation across heterogeneous workloads while maintaining operational simplicity through automated parameter tuning.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If cloud deployment with on-demand capabilities is used, then resource flexibility is improved, but the reliability of query execution plans deteriorates due to changing resources

Engineering Contradiction:
Improveresource configuration flexibilityVSAvoidquery execution plan reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary learning and cost profile generation for various resource configurations before actual queries are executed. By pre-characterizing different cloud resource states and their performance implications, the query optimizer can reliably select appropriate execution plans even when resources dynamically change, as the cost profiles already encode knowledge about resource behavior.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional mechanical configuration approaches (manual cost profile setting for each resource state) with an intelligent learning system that automatically adapts to resource changes. The machine learning-based cost profile generation substitutes rigid mechanical configuration with flexible, data-driven adaptation, maintaining reliability through learned patterns rather than static rules.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11593371B2Dynamically learning optimal cost profiles for heterogenous workloads
Publication Date: 2023.02.28 TERADATA US INC
  • US11593371B2 patent drawing
  • US11593371B2 patent drawing
  • US11593371B2 patent drawing

AI summary

A relational database management system (RDBMS) accepts a workload comprised of one or more queries against a relational database. The RDBMS evolves a default cost profile into a plurality of cost profiles using fixed or dynamic evolution, wherein each of the cost profiles captures one or more cost parameters for the workload. The cost profiles are represented by a multi-dimensional matrix that has one or more dimensions, and each of the dimensions represents one of the cost parameters. The RDBMS dynamically determines which of the cost profiles is an optimal cost profile for the workload by mapping the cost profiles to the workload using a random walk scoring algorithm or a biased walk scoring algorithm that searches the multi-dimensional matrix to identify the optimal cost profile. The RDBMS selects and performs one or more query execution plans for the workload based on the optimal cost profile for the workload.