Round Robin Database Delta Sample Storage Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing round robin database technique for storing time series data is inefficient in terms of storage space and read/write speed, as it stores absolute sample values rather than delta samples, leading to unnecessary space usage and suboptimal access times.
Innovation Solution
A system and method that accumulates delta samples over specified time periods, calculates field sizes based on the maximum delta value for each period, and stores these delta values in a database using an index system with adjustable field sizes, allowing for efficient storage and retrieval of time series data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If absolute sample values are stored in a round robin database, then the database can maintain a fixed size and enable sequential reading, but storage efficiency decreases and space is wasted
Solution Approach 1:
The patent changes the parameter being stored from absolute sample values to delta samples (differences between consecutive values). Since time series data typically exhibits gradual changes, delta values are much smaller and require fewer bits for storage. The system dynamically determines the number of bits needed based on the maximum delta value observed, optimizing storage efficiency while maintaining the round robin database structure.
2Quantity of substance
If fixed field size is used for storing samples, then database structure is simple and access is fast, but storage space is wasted when values are small
Solution Approach 1:
The patent implements dynamic field sizing where the number of bits allocated for storing delta samples is adjusted based on the actual data characteristics. The system monitors the maximum delta value and dynamically determines the minimum bits required to represent all delta values within a round robin cycle. This dynamic adaptation optimizes storage space utilization while maintaining efficient access patterns through the round robin structure.
3Quantity of substance
If delta samples are stored with dynamically calculated field sizes, then storage efficiency increases, but the complexity of managing variable field sizes increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating the maximum delta value within each round robin cycle before finalizing the field size. The system accumulates delta samples, determines the maximum value, and then calculates the required field size in advance. This preliminary determination simplifies subsequent storage operations by establishing a fixed field size for the entire cycle, avoiding the need for complex variable-length encoding while still optimizing for the actual data range.
Data Source
AI summary
A system for storing time series data in a database using round robin includes a user input interface and a round robin database file manager. The interface receives inputs specifying a time period and a sample rate for collection of delta samples. Each sample represents a difference between two subsequent values of the time series data. The manager accumulates the samples over the time period in accordance with the sample rate, calculates a field size for storing the samples for the time period based on a maximum one of the samples, and writes the delta values to the database using the calculated field size. The database is relatable to a plurality of records. Each record corresponds to a respective time period for delta sample collection and has an adjustable field size for delta sample storage based on a maximum delta sample value for the respective time period.