Self-Indexing Database Management System for Query Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional database-management systems (DBMSs) face inefficiencies in query performance due to the need to retrieve entire rows from tables, especially when dealing with large tables and massive indexes, which can lead to increased complexity, storage requirements, and reduced scalability.

Innovation Solution

A dynamically self-indexing DBMS that periodically reviews database-transaction logs and data-usage patterns to selectively index only the most frequently accessed columns, optimizing the number and selection of indexes over time to improve performance without degrading response times for less common queries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If indexes are created for all table columns to improve query performance, then query response time is improved, but device complexity and storage requirements increase

Engineering Contradiction:
Improvequery response timeVSAvoidindex management complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent implements dynamic index management where the database system automatically creates, maintains, and drops indexes based on real-time query patterns. The system monitors query frequency and dynamically adjusts the index set, transitioning from static predefined indexes to dynamic adaptive indexes that evolve with usage patterns.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The database management system performs self-optimization by automatically analyzing query logs, identifying frequently accessed columns, and creating appropriate indexes without manual intervention. The system serves its own optimization needs through automated monitoring and index management, eliminating the need for manual index tuning.

Inventive Principle:
Principle #25Self-service

2Loss of time

If indexes are created for all table columns to improve query performance, then query response time is improved, but storage space requirements increase

Engineering Contradiction:
Improvequery response timeVSAvoidstorage space
Core Design Contradiction:
Loss of timeVSVolume of stationary object

Solution Approach 1:

The system extracts only the essential indexing needs by analyzing query patterns and creating indexes solely for frequently accessed columns. Instead of maintaining indexes for all columns, the system selectively creates indexes only where they provide performance benefit, removing unnecessary index overhead.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies partial indexing by creating indexes for only a subset of columns that are most frequently queried. Rather than over-indexing all columns, the system performs partial action on the most critical columns, achieving sufficient performance improvement with minimal storage overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of time

If manual index selection is performed to optimize query performance, then query response time is improved, but ease of operation decreases

Engineering Contradiction:
Improvequery response timeVSAvoidindex management ease
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The database system automatically monitors query patterns, analyzes access frequencies, and makes intelligent decisions about which indexes to create and maintain. This self-service approach eliminates manual index management while optimizing query performance through automated adaptation to changing workloads.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors query logs and performance metrics, using this feedback to dynamically adjust the index set. By incorporating real-time feedback from actual query patterns, the system adapts its indexing strategy to match actual usage, improving performance without manual intervention.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11327988B2Dynamically self-indexing database-management system
Publication Date: 2022.05.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11327988B2 patent drawing
  • US11327988B2 patent drawing
  • US11327988B2 patent drawing

AI summary

A dynamically self-indexing database-management system selects database indexes associated with table columns that are most frequently accessed by user queries, deleting all other indexes. The system periodically reviews database-performance figures and data-usage patterns for each table of its database and revises its selection of indexes in order to ensure that only the most frequently accessed columns continue to be indexed and that the omission of other indexes does not degrade performance. The total number of selected indexes, the overall percent of selected indexes, or the selection itself is optimized over time through continued monitoring of database transaction logs. Optimization may comprise cognitive analytics or other methods of artificial intelligence by which the system learns over time how to best determine whether its current selection of indexes is likely to provide the best overall performance.