Soft Correlation Adjustment for Database Query Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Managing soft correlations in database systems is challenging due to the need to balance tightness of correlation mapping expressions with minimizing violations, as overly tight expressions lead to irrelevant data elimination but increase violations, while loose expressions reduce violations but decrease optimization effectiveness.

Innovation Solution

A soft correlation adjustment system (SCA) that collects and evaluates violation statistics to adjust soft correlations, allowing for the generation of adjusted correlations that optimize database queries by modifying the range or list of destination attributes based on density analysis, upper-bound thresholds, and step-wise statistics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If soft correlation mapping expressions are made tighter to eliminate irrelevant data, then query optimization effectiveness is improved, but the number of violations increases

Engineering Contradiction:
Improvequery optimization effectivenessVSAvoidcorrelation violation rate
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements dynamic adjustment of soft correlation mappings by introducing violation statistics collection and evaluation mechanisms. The system monitors actual violations in database records and automatically adjusts the tightness of correlation mappings based on observed data patterns, transforming static correlation definitions into dynamic, adaptive mappings that optimize query performance while maintaining acceptable violation rates

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameters of soft correlation mappings by adjusting the range of destination attributes based on violation statistics. Specifically, it modifies the correlation mapping expressions to expand or contract attribute ranges, thereby controlling the balance between eliminating irrelevant data and minimizing violations through parameter optimization

Inventive Principle:
Principle #35Parameter changes

2Reliability

If soft correlation mapping expressions are made looser to reduce violations, then correlation reliability is improved, but query optimization effectiveness decreases

Engineering Contradiction:
Improvecorrelation violation rateVSAvoidquery optimization effectiveness
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where violation statistics are collected from actual database queries and used to adjust soft correlation mappings. The system continuously monitors correlation violations, evaluates their impact on query optimization, and uses this feedback information to refine mapping expressions, creating a closed-loop control system that automatically balances reliability and productivity

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary analysis of violation statistics before finalizing soft correlation mappings. By collecting and evaluating violation data in advance, the system determines optimal mapping parameters that prevent excessive violations while maintaining query optimization effectiveness, rather than reacting to violations after they occur

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10997168B2Management of soft correlation for databases and optimization of database queries
Publication Date: 2021.05.04 TERADATA US INC
  • US10997168B2 patent drawing
  • US10997168B2 patent drawing
  • US10997168B2 patent drawing

AI summary

One or a soft correlation of a database can be adjusted (e.g., modified, replaced, overwritten) for use with respect to one or more record(s) of the database associated with the soft correlation, by considering at least one or more violations of the soft correlations in the one or more of records database records associated with the soft correlation. In addition, an adjusted soft correlation can be stored and used for optimizations of database queries pertaining to one or more records associated with the adjusted soft correlation. Typically, the adjusted soft correlation is adjusted by at least considering the violations of an original soft correlation in the one or more records relating to the database queries.