Time-Series Database Indexing with Window-Based Update Intervals

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Traditional time-series databases face inefficiencies in indexing and updating processes due to frequent updates required for each data element, especially in high-volume scenarios, leading to computationally expensive operations.

Innovation Solution

Implementing a timestamp window and a window of interest for indexing, where updates are performed only when changes span across these windows, reducing the frequency of index updates and optimizing storage and retrieval processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If updates to the index are performed for each data element, then the index remains up-to-date and searchability is maintained, but the computational expense and resource consumption increase significantly

Engineering Contradiction:

Improveindex up-to-date statusVSAvoidcomputational expense

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic index updates at predetermined intervals instead of continuous updates for every data element. The time-series database performs index updates only at specific time intervals, reducing the frequency of write operations while maintaining acceptable searchability. This periodic action resolves the contradiction by sacrificing some real-time index freshness to dramatically reduce computational expense and resource consumption.

Inventive Principle:

Principle #19Periodic action

2Measurement precision

If index updates are performed frequently to maintain searchability, then query performance is improved, but the resource consumption and system load increase

Engineering Contradiction:

ImprovesearchabilityVSAvoidresource consumption

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs index updates at predetermined time intervals rather than continuously, reducing the total quantity of update operations. This periodic approach maintains adequate searchability by ensuring the index is refreshed regularly, while significantly reducing resource consumption compared to updating after every data element insertion.

Inventive Principle:

Principle #19Periodic action

3Measurement precision

If the index is updated for every data element insertion, then data retrieval accuracy is maintained, but the productivity of data ingestion decreases

Engineering Contradiction:

Improvedata retrieval accuracyVSAvoiddata ingestion rate

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

By updating the index only at predetermined intervals rather than after every insertion, the system removes a frequent bottleneck from the data ingestion pipeline. This allows data to be ingested continuously at high speed, with index updates occurring periodically in the background, thereby improving overall data ingestion productivity while maintaining acceptable retrieval accuracy through the periodic synchronization.

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS20260111408A1Time-Series Database for Storing and Indexing Events and Metrics

Publication Date: 2026.04.23 SERVICENOW INC

AI summary

In the present application, a system and method for storing and retrieving time-series data in a time-series database are disclosed. A data stream collected at a periodic collection time interval is stored. The stored data stream is indexed in an index, including by storing in the index a representative index entry corresponding to a plurality of data elements of the stored data stream collected during a period of time longer than the periodic collection time interval of the data stream.