Elastic Columnar Cache Dynamic Adjustment

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Cloud databases face performance issues due to the static and reboot-dependent columnar cache, which fails to dynamically adjust to changing access patterns and memory requirements.

Innovation Solution

An elastic columnar cache system that dynamically adjusts the subset of columns cached in a column-major format based on access patterns and memory configuration, allowing for real-time expansion and contraction of cache size without restarting workloads.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a static columnar cache is implemented, then data access speed is improved for column-centric queries, but the cache cannot adapt to changing access patterns without a reboot

Engineering Contradiction:

Improvedata access speedVSAvoidadaptability to changing access patterns

Core Design Contradiction:

SpeedVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic columnar cache that automatically adjusts the cached columns based on real-time access patterns. The system monitors query workloads and dynamically modifies the cache content without requiring a reboot, allowing the cache to adapt to changing data access patterns while maintaining high access speeds.

Inventive Principle:

Principle #15Dynamics

2Productivity

If the cache stores all columns in column-major format, then query performance is improved, but memory consumption increases

Engineering Contradiction:

Improvequery performanceVSAvoidmemory consumption

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The patent implements a selective caching strategy where only the most frequently accessed columns are cached in column-major format, rather than caching all columns. The system monitors access patterns and maintains a subset of columns in the cache, achieving high query performance for common operations while conserving memory resources.

Inventive Principle:

Principle #16Partial or excessive action

3Quantity of substance

If the cache size is increased to store more columns, then more data is available for fast access, but the cost of memory allocation increases

Engineering Contradiction:

Improvecache sizeVSAvoidmemory allocation cost

Core Design Contradiction:

Quantity of substanceVSLoss of energy

Solution Approach 1:

The patent dynamically adjusts the cache size parameter based on observed access patterns and memory availability. The system monitors which columns are frequently accessed and adjusts the cache to store only those columns, optimizing the balance between cache size and memory cost without requiring over-provisioning of memory resources.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250036567A1Elastic Columnar Cache for Cloud Databases

Publication Date: 2025.01.30 GOOGLE LLC

AI summary

A method for providing elastic columnar cache includes receiving cache configuration information indicating a maximum size and an incremental size for a cache associated with a user. The cache is configured to store a portion of a table in a row-major format. The method includes caching, in a column-major format, a subset of the plurality of columns of the table in the cache and receiving a plurality of data requests requesting access to the table and associated with a corresponding access pattern requiring access to one or more of the columns. While executing one or more workloads, the method includes, for each column of the table, determining an access frequency indicating a number of times the corresponding column is accessed over a predetermined time period and dynamically adjusting the subset of columns based on the access patterns, the maximum size, and the incremental size.