In-Memory Database Page Reorganization Based on Usage Patterns

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In-memory database systems face inefficiencies in managing pages with variable entry sizes due to fragmentation and uneven space allocation, which affects data access and storage performance.

Innovation Solution

A method is introduced where pages are reorganized based on usage metrics, such as entry size distribution and fragmentation, to create contiguous sections for entries and free space, using transient data structures to track reusable space within the in-memory database system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If pages are reorganized to fill free space gaps in memory, then space utilization efficiency is improved, but processor overhead and complexity increase

Engineering Contradiction:

Improvespace utilizationVSAvoidprocessor overhead

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The system performs self-diagnosis by monitoring its own page usage patterns and automatically triggers reorganization when fragmentation thresholds are exceeded, eliminating the need for external intervention or continuous complex management overhead

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system changes the state of pages from fragmented to contiguous by detecting usage patterns and applying reorganization only when parameters (fragmentation levels, access patterns) indicate it is beneficial, thus optimizing space without constant intervention

Inventive Principle:

Principle #35Parameter changes

2Speed

If reorganization is performed frequently to maintain contiguous free space, then data access efficiency is improved, but processing time and resource consumption increase

Engineering Contradiction:

Improvedata access efficiencyVSAvoidprocessing time

Core Design Contradiction:

SpeedVSLoss of time

Solution Approach 1:

Instead of continuous reorganization, the system employs periodic action by monitoring pages over time and reorganizing only when usage patterns indicate fragmentation has reached a threshold, balancing access efficiency with processing time

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system performs preliminary monitoring of page usage patterns before triggering reorganization, identifying candidates in advance based on fragmentation metrics and access patterns, thus preparing for efficient reorganization only when necessary

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10642660B2Database variable size entry container page reorganization handling based on use patterns

Publication Date: 2020.05.05 SAP SE

AI summary

A page is loaded into memory of an in-memory database system. Thereafter, it is determined whether to reorganized the page based on how such page is used. Based on such determination, the page is either reorganized by filling any free space gaps in memory and then, use of the reorganized page is enabled or, otherwise, use of the page is enabled without reorganization.