Multi-Column Index Interleaving Data Bits Selectivity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional database systems face inefficiencies in managing and querying data across multiple columns, as they often require multiple sorted copies of data or concatenated sort keys, which can lead to biased search efficiency and increased resource consumption.

Innovation Solution

A multi-column index is generated by interleaving data bits for selectivity, allowing for more even distribution of index values across multiple columns, thereby reducing the need for read operations and improving query processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple sorted copies of data are maintained for different columns, then query efficiency for multiple columns is improved, but storage requirements and system complexity increase

Engineering Contradiction:
Improvequery efficiencyVSAvoidstorage requirements
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent combines multiple column data into a single sorted structure by concatenating sort keys from multiple columns. Instead of maintaining separate sorted copies for each column, the invention merges them into one unified sorted dataset, reducing storage requirements while enabling efficient queries across multiple columns through the combined sort order.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The concatenated sort key structure serves multiple functions simultaneously: it enables sorting and efficient querying for multiple different columns within a single data structure. This multi-functional approach allows the same sorted dataset to support queries on any of the constituent columns without requiring separate sorted copies for each.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Quantity of substance

If concatenated sort keys are used for multi-column indexing, then storage requirements are reduced, but search efficiency becomes biased toward certain columns

Engineering Contradiction:
Improvestorage requirementsVSAvoidsearch efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent applies local quality by using selective filtering based on the specific query requirements. When a query targets a particular column, the system applies filtering logic tailored to that column's characteristics and position in the concatenated sort key, optimizing search efficiency for the specific query rather than treating all columns uniformly.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The invention performs preliminary filtering on the concatenated sort key before accessing the actual data blocks. By evaluating the query conditions against the concatenated sort key structure in advance, the system can eliminate irrelevant data blocks early in the query process, reducing the bias toward certain columns and improving overall search efficiency.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If traditional single-column indexes are used, then implementation simplicity is maintained, but query performance on multi-column conditions deteriorates

Engineering Contradiction:
Improveimplementation simplicityVSAvoidquery performance
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent merges multiple single-column index capabilities into a single concatenated sort key structure. This unified structure maintains the simplicity of single-column indexing implementation while providing multi-column query performance, as the concatenated sort key can be used to efficiently filter and retrieve data based on conditions across multiple columns simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12259909B2Generating a multi-column index for relational databases by interleaving data bits for selectivity
Publication Date: 2025.03.25 AMAZON TECH INC
  • US12259909B2 patent drawing
  • US12259909B2 patent drawing
  • US12259909B2 patent drawing

AI summary

A multi-column index is generated based on an interleaving of data bits for selectivity for efficient processing of data in a relational database system. Two or more columns may be identified for inclusion in the multi-column index for a relational database table. Based, at least in part, on the interleaving of data bits for selectivity from the identified columns, a multi-column index is generated for the relational database table that provides a respective index value for each entry in the relational database table. The entries of the relational database table may then be stored according to the index values of the multi-column index.