Hybrid Row-Column Time Series Data Injection Method
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current time series data injection methods by row have low storage efficiency and inefficient query performance, affecting database performance.
Innovation Solution
A time series data injection method that stores parameters identifying the data source in a row storage format and indicators and timestamps in a columnar storage format, improving storage and query efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If time series data is stored by row, then data structure simplicity is maintained, but storage efficiency and query performance deteriorate
Solution Approach 1:
The patent segments time series data into two distinct storage formats: row storage for parameters identifying the data source (tags) and columnar storage for indicators and timestamps. This segmentation allows each format to be optimized for its specific purpose, resolving the contradiction between structural simplicity and storage efficiency.
Solution Approach 2:
The patent applies different storage qualities to different parts of the data: row storage format is used for parameters that identify the data source, while columnar storage format is used for indicators and timestamps. This local differentiation optimizes both storage efficiency and query performance without compromising overall system simplicity.
2Ease of manufacture
If time series data is stored by row, then data insertion is straightforward, but query efficiency deteriorates
Solution Approach 1:
The patent segments data storage into row-based and columnar-based formats, where row storage handles data insertion simplicity while columnar storage optimizes query efficiency by organizing data vertically for faster retrieval of specific indicators and timestamps.
Solution Approach 2:
The patent applies row storage format locally to parameters for straightforward insertion, while applying columnar storage format locally to indicators and timestamps for efficient querying, thus resolving the contradiction between insertion simplicity and query speed.
3Productivity
If all data is stored in columnar format, then query efficiency improves, but storage overhead increases
Solution Approach 1:
The patent applies columnar storage format only to indicators and timestamps where query efficiency is critical, while using row storage for parameters, thereby achieving query optimization without excessive storage overhead.
Solution Approach 2:
The patent segments data into categories requiring different storage approaches: parameters in row format and indicators/timestamps in columnar format, optimizing query efficiency for time-series operations while maintaining reasonable storage overhead.
Data Source
AI summary
A time series data injection method is provided, including: receiving time series data, where the time series data includes at least one parameter identifying a data source that generates the time series data, an indicator indicating at least one attribute of the data source, and a timestamp indicating a time point when the indicator is generated; storing a first parameter group in a row storage format, where the first parameter group includes the at least one parameter identifying the data source that generates the time series data; and storing a second parameter group in a columnar storage format, where the second parameter group includes the indicator indicating the at least one attribute of the data source and the timestamp. In the method, the time series data is injected in a hybrid row-column storage manner.