Timeseries Service Nested Stream Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current web services platforms face delays in data presentation due to the need for applications to retrieve and process raw timeseries data from relational databases, as this processing is typically done in response to a request, leading to inefficiencies in data retrieval and visualization.
Innovation Solution
A web services platform that includes a data collector, timeseries service, and timeseries storage interface, which collects data points, applies processing workflows to generate derived timeseries, and stores both input and derived timeseries in a database, enabling pre-aggregation and efficient data retrieval.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If raw timeseries data is stored in a relational database without significant organization or processing at the time of data collection, then device complexity is reduced and ease of manufacture is improved, but data presentation delays increase due to processing being performed in response to requests
Solution Approach 1:
The patent applies preliminary action by performing data processing operations before data requests are made. The system automatically executes processing workflows that transform raw timeseries data into derived timeseries data and stores these processed results in advance. When applications request data, the pre-processed derived timeseries data is already available for immediate retrieval and presentation, eliminating the need to wait for request-time processing.
Solution Approach 2:
The patent segments the data processing function from the data retrieval function. Instead of processing data only when requested, the system divides the workflow into separate stages: automatic preprocessing of raw data into derived data, storage of both raw and derived data, and then rapid retrieval of pre-processed data. This segmentation allows processing and retrieval to occur at different times, resolving the contradiction between easy data collection and fast data presentation.
2Device complexity
If processing operations are performed in response to a request for timeseries data, then device complexity is reduced, but productivity of data presentation is worsened due to significant delays
Solution Approach 1:
The system performs data processing operations in advance, automatically transforming raw timeseries data into derived timeseries data before any application requests the data. This preliminary processing eliminates the time delay between data request and data presentation, significantly improving productivity while maintaining relatively simple device architecture through automated workflow execution.
3Device complexity
If raw timeseries data is stored without significant organization, then storage structure simplicity is improved, but data retrieval efficiency is worsened requiring applications to retrieve and generate views
Solution Approach 1:
The system pre-processes raw timeseries data into organized derived timeseries data with specific views and formats before storage. Applications can then retrieve this pre-organized data directly without needing to generate views themselves, significantly improving data retrieval efficiency while maintaining manageable storage structure complexity through systematic data organization.
Solution Approach 2:
The patent creates derived timeseries data as processed copies of the raw timeseries data. These copies contain pre-computed views and transformations that applications can use directly. Instead of requiring applications to process raw data, the system provides optimized copies that are ready for immediate use, improving retrieval efficiency without significantly increasing storage complexity.
Data Source
AI summary
A web services platform includes a data collector and a timeseries service. The data collector is configured to collect samples of data points and generate input timeseries including a plurality of the samples. The timeseries service is configured to identify a first timeseries processing workflow that uses the input timeseries as an input and defines processing operations to be applied to the samples of the input timeseries, perform the processing operations defined by the first timeseries processing workflow to generate a first derived timeseries comprising a first set of derived timeseries samples, identify a second timeseries processing workflow that uses the first derived timeseries as an input and defines processing operations to be applied to the samples of the first derived timeseries, and perform the processing operations defined by the second timeseries processing workflow to generate a second derived timeseries comprising a second set of derived timeseries samples.


