Hybrid Zone Map Index Maintenance for Database Storage Regions

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Database index maintenance is costly and inefficient, especially when dealing with large storage regions and unordered data, as it requires scanning entire tables and updating indices frequently, leading to high computational and I/O-intensive processes.

Innovation Solution

A hybrid zone map and indices scheme is employed, using probabilistic techniques to determine when to maintain indices based on the effectiveness of zone maps, thereby minimizing index maintenance costs by only generating indices for value ranges where they provide better information than zone maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If indices are maintained for all storage regions, then query efficiency is improved, but index maintenance costs increase

Engineering Contradiction:

Improvequery efficiencyVSAvoidindex maintenance costs

Core Design Contradiction:

SpeedVSDevice complexity

Solution Approach 1:

The patent applies local quality by maintaining indices selectively only for storage regions where they provide better information than zone maps, rather than uniformly across all regions. The system evaluates the effectiveness of zone maps versus indices for each storage region and maintains indices only where necessary, thereby improving query efficiency locally without incurring universal maintenance costs.

Inventive Principle:

Principle #3Local quality

2Measurement precision

If zone map scan regions are made small, then query precision is improved, but metadata processing overhead increases

Engineering Contradiction:

Improvequery precisionVSAvoidmetadata processing overhead

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies dynamics by making the zone map scan region size adaptive rather than fixed. The system dynamically adjusts the scan region size based on the specific query being executed and the characteristics of the data, allowing it to optimize between query precision and metadata processing overhead for each query rather than using a static configuration.

Inventive Principle:

Principle #15Dynamics

3Reliability

If indices are updated frequently, then data accuracy is improved, but computational overhead increases

Engineering Contradiction:

Improvedata accuracyVSAvoidcomputational overhead

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies discarding and recovering by selectively discarding (not maintaining) indices for storage regions where zone maps provide sufficient information. This reduces the frequency and amount of index updates required, thereby lowering computational overhead while maintaining data accuracy for the regions where indices are actually maintained.

Inventive Principle:

Principle #34Discarding and recovering

Data Source

PatentUS10102253B2Minimizing index maintenance costs for database storage regions using hybrid zone maps and indices

Publication Date: 2018.10.16 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Elements of a database object are stored among a plurality of different storage regions, each storage region being associated with a first value range indicating upper and lower range values for element values within that storage region. An index is generated and maintained for one or more second value ranges that include range values that comprise subsets of the first value ranges. A query is processed that includes a query value and one or more storage regions to be read is determined by using one of the index and the first value ranges based on the query value relative to a second value range.