Time Series Forecasting Models for Sparse Hierarchical Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing deep learning (DL) models struggle with sparse data availability and hierarchical relationships in time series data, leading to inaccurate forecasts and the need for large volumes of data for training, which are often unavailable in entity-based time series data sets.
Innovation Solution
The AI-based data processing system employs data flattening and stacking processes to transform time series data sets into multidimensional vectors, incorporating hierarchical relationships, and uses primary and extended DL models to generate forecasts, with automatic updates based on first-party and third-party data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If deep learning models are applied to time series data for forecasting, then forecast accuracy can be improved, but large volumes of training data are required which are often unavailable in entity-based time series data sets
Solution Approach 1:
The patent transforms univariate time series data into multivariate representations by creating multiple derived time series from a single source series. This includes generating reversed time series, differentiated time series (first, second, and third derivatives), and integrated time series. By transforming data from one dimension (single time series) to multiple dimensions (multiple related time series), the system creates sufficient training data volume for deep learning models without requiring additional external data sources.
Solution Approach 2:
The patent segments a single time series into multiple distinct time series components, each capturing different characteristics of the original data. The segmentation creates: original time series, reversed time series (capturing backward patterns), differentiated time series (capturing rates of change at multiple orders), and integrated time series (capturing cumulative patterns). This segmentation allows the deep learning model to learn from diverse patterns within the same underlying data source.
2Measurement precision
If deep learning models process entity-based time series data with hierarchical relationships, then forecast accuracy improves, but the complexity of processing hierarchical data structures increases
Solution Approach 1:
The patent addresses hierarchical relationships by transforming hierarchical time series data into a multivariate format that deep learning models can process efficiently. By creating multiple derived time series from hierarchical entities (including parent-child relationships in entity hierarchies), the system maintains the hierarchical information while presenting it in a flattened, processable format. This approach captures hierarchical patterns without requiring complex hierarchical processing architectures.
Solution Approach 2:
The patent introduces derived time series as intermediary representations that bridge the gap between hierarchical data structures and deep learning model inputs. These intermediaries (reversed, differentiated, and integrated time series) serve as mediators that encode hierarchical relationships in a form suitable for standard deep learning architectures, avoiding the need for specialized hierarchical processing while preserving hierarchical information.
3Measurement precision
If data transformation processes (flattening and stacking) are applied to time series data, then forecast accuracy improves, but the processing time and computational resources increase
Solution Approach 1:
The patent applies data transformation processes (flattening and stacking) as preliminary steps before model training and deployment. By pre-processing the time series data into the required multivariate format during the data preparation phase rather than during real-time inference, the system incurs the computational cost only once during setup. The transformed data structure is then reused for training and forecasting operations, minimizing repeated processing overhead.
Solution Approach 2:
The patent segments the data processing workflow into distinct transformation steps (flattening, stacking, reversing, differentiating, integrating) that can be independently optimized and executed. This segmentation allows for efficient implementation where each transformation operation is performed once on the raw data to create the complete set of derived time series, which are then cached and reused for multiple model training iterations and forecasting operations.
Data Source
AI summary
An Artificial Intelligence (AI) based data processing system transforms a plurality of time series data sets for processing by one or more deep learning (DL) models for generating forecasts. The DL models are initially trained on training data generated from the historical data. During operation, a plurality of transformed time series data sets are generated from the plurality of time series data sets associated with different entities in an entity hierarchy via data flattening and data stacking. A primary model of the one or more DL models is trained on first-party data for generating the forecasts. An extended model of the one or more DL models is trained on third-party data from external data sources. Whenever new data is available in the first-party data or the third-party data, the primary model and the extended model are correspondingly updated.


