NoSQL Cache State Tracking Through Deduplicated Log Tables

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Traditional SQL databases struggle with data storage and access requirements of modern applications due to their declarative nature, necessitating specialty hardware and skilled administrators, while No-SQL databases face challenges in determining real-time caching states without impacting runtime performance.

Innovation Solution

Maintain a log table based on modifications to a NoSQL database during a continuous runtime session, deduplicate it to remove stale entries, and create a cost table without querying the key-value table, allowing real-time caching state determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If real-time caching state assessment is performed by querying the key-value table during runtime, then measurement precision is improved, but productivity deteriorates due to runtime performance impact

Engineering Contradiction:

Improvecaching state assessment accuracyVSAvoidruntime performance

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent creates a log table before the continuous runtime session to store metadata about the key-value table structure. This preliminary action allows the system to assess caching states by querying the pre-prepared log table rather than querying the actual key-value table during runtime, thus maintaining measurement precision while avoiding runtime performance degradation.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If traditional SQL databases are used to ensure data storage and access, then reliability is improved, but device complexity worsens due to specialty hardware and skilled administrators requirements

Engineering Contradiction:

Improvedata storage and access reliabilityVSAvoidhardware and administrative complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates a log table that serves as a copy or representation of the key-value table's metadata and structure. This copy contains sufficient information to assess caching states and understand data organization without requiring access to the actual key-value table or specialized SQL database infrastructure, thereby reducing device complexity while maintaining reliability.

Inventive Principle:

Principle #26Copying

3Device complexity

If NoSQL databases are used to handle large datasets with inexpensive hardware, then device complexity is reduced, but measurement precision worsens due to difficulty in determining real-time caching states

Engineering Contradiction:

Improvehardware requirementsVSAvoidreal-time caching state determination

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a log table as an intermediary structure that bridges the gap between NoSQL database simplicity and the need for precise caching state measurement. The log table stores metadata about the key-value table that enables accurate caching state assessment without requiring complex querying mechanisms, thus maintaining measurement precision while preserving the simplicity of NoSQL databases.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250348486A1Understanding storage utilization of a caching system through incoming traffic

Publication Date: 2025.11.13 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Database management techniques can gauge real-time caching states of no-schema-based (noSQL) databases (DBs) during runtime operation by maintaining a log table to reflect modifications to the noSQL DB. The log table is maintained by adding row entries to reflect modifications to the noSQL DB and therefore does not requiring querying the noSQL DB. The log table may then be deduplicated to remove stale entries and queried to generate a cost table reflecting a real-time caching state of the noSQL DB.