Database Compression Analysis for Sampling-Based Method Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Database administrators face challenges in making intelligent choices among various data compression alternatives due to the exponential growth of data and the availability of multiple compression mechanisms, which requires efficient decision-making tools to conserve storage resources and reduce input/output costs.

Innovation Solution

A compression analyzer tool is developed to generate comparative reports on available compression mechanisms, allowing for the automatic selection of appropriate compression techniques based on weighted formulas, sampling data, and recording compression ratios, CPU costs, and I/O savings, enabling informed decision-making.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple compression mechanisms are available to conserve storage resources, then storage efficiency is improved, but the complexity of selecting the appropriate mechanism increases

Engineering Contradiction:
Improvestorage capacityVSAvoidselection complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system automatically evaluates multiple compression mechanisms and selects the optimal one based on performance metrics, eliminating the need for manual DBA intervention in the complex selection process

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameter of compression mechanism selection from a manual administrative task to an automated process driven by performance parameters such as compression ratio and CPU cost

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If data compression is applied to conserve storage resources, then storage usage is reduced, but the processing overhead increases

Engineering Contradiction:
Improvestorage usageVSAvoidprocessing overhead
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The system evaluates compression mechanisms based on multiple parameters including compression ratio and CPU cost, allowing optimization of the trade-off between storage savings and processing overhead

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system applies compression selectively based on data characteristics and performance requirements, rather than uniformly applying compression to all data, thus avoiding excessive processing overhead

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If compression analysis is performed on sampled data, then analysis speed is improved, but measurement precision decreases

Engineering Contradiction:
Improveanalysis speedVSAvoidcompression ratio accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system uses sampled data rather than analyzing entire datasets, accepting a trade-off where analysis speed is improved while measurement precision is partially reduced

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses the results from sampled data analysis to guide further compression decisions, allowing accurate enough measurements from samples to drive effective compression strategy

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8943028B2Database compression analyzer
Publication Date: 2015.01.27 TERADATA US INC
  • US8943028B2 patent drawing
  • US8943028B2 patent drawing
  • US8943028B2 patent drawing

AI summary

Apparatus, systems, and methods may operate to receive requests to execute a plurality of compression and/or decompression mechanisms on one or more database objects; to execute each of the compression and/or decompression mechanisms, on a sampled basis, on the database objects; to determine comparative performance characteristics associated with each of the compression and/or decompression mechanisms; and to record at least some of the performance characteristics and/or derivative characteristics derived from the performance characteristics in a performance summary table. The table may be published to a storage medium or a display screen. Other apparatus, systems, and methods are disclosed.