Historian Query Retrieval Using Summary Cycle Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional industrial data retrieval systems are inefficient due to cyclical retrieval services that burden processor resources and network bandwidth, even when only a few data rows are queried, as they process millions of source data values, leading to slow query results and overutilization of communications network bandwidth.
Innovation Solution
Implementing a summarization cycle duration and query cycle duration to determine whether to retrieve source tag data or summary tag data from memory storage devices, using a replication component to generate summary data values and store them in a summary database, and a retrieval component to retrieve summary data when the query cycle duration matches or exceeds the summarization cycle duration, thereby reducing unnecessary data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional cyclical retrieval services are used to retrieve process data, then complete data coverage is achieved, but processor resources and network bandwidth are excessively utilized
Solution Approach 1:
The patent segments the data retrieval process into two distinct paths: (1) retrieving pre-computed summary data for queries that align with summarization cycles, and (2) retrieving detailed source data only when necessary. This segmentation allows the system to avoid processing millions of source data values for every query, thereby reducing processor resource utilization while maintaining complete data coverage when needed.
Solution Approach 2:
The system performs preliminary summarization of source data into aggregated data structures before queries are executed. By pre-computing summary statistics (such as averages, maximums, minimums) and storing them in optimized formats, the retrieval service can quickly return results for aligned queries without processing the underlying source data, thus reducing energy consumption while preserving data completeness for non-aligned queries.
2Measurement precision
If conventional cyclical retrieval services process all source data values, then accurate query results are obtained, but query response time increases
Solution Approach 1:
The patent segments query handling into two categories: (1) queries aligned with summarization cycles that can use pre-computed summary data for instant retrieval, and (2) non-aligned queries that require detailed source data processing. This segmentation enables the system to provide accurate results for both types while dramatically reducing response time for the majority of aligned queries.
Solution Approach 2:
The system performs preliminary organization of source data into summary data structures that capture essential statistics and patterns. When queries arrive, the system can immediately return accurate results for aligned queries using these pre-processed structures, eliminating the need to scan through millions of raw data values and thus reducing query response time while maintaining accuracy.
3Loss of information
If conventional retrieval services retrieve source data for every query, then data completeness is ensured, but network bandwidth is overutilized
Solution Approach 1:
The patent segments data transfer into two streams: (1) compact summary data for queries aligned with summarization cycles, and (2) detailed source data for non-aligned queries. This segmentation reduces network bandwidth utilization by transmitting only the necessary data volume for each query type, while still ensuring complete information is available when required.
Solution Approach 2:
The system performs preliminary aggregation of source data into compressed summary structures that retain essential information in a compact form. When queries are processed, the system can transmit these pre-aggregated summaries for aligned queries, dramatically reducing the volume of data transferred over the network while maintaining data completeness for queries that require full detail.
Data Source
AI summary
Operational historian system retrieving summary data values and source data values based on alignment between a summarization cycle duration and a query cycle duration. A retrieval service process executing on a historian device utilizes a summarization cycle duration, including start and/or end times thereof, and a query cycle duration, including start and/or end times thereof, to determine whether to retrieve, via a communications network, source tag data and/or summary tag data from memory storage devices.