Streaming Sensor Data Validation in Utility Metering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Utility meter data management systems face challenges in processing and validating the large volume of data generated by utility meters, particularly in real-time, which hinders efficient monitoring and detection of anomalies such as water usage violations and system effectiveness.
Innovation Solution
A computer-implemented system with a central event management system that processes streamed sensor data from utility meters, applies invalidation event definitions to identify and validate meter data, and provides notifications for invalid readings, enabling real-time monitoring and validation of water usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If meter data is processed and stored in massive information databases for later use, then data volume capacity is improved, but real-time data validation and anomaly detection capability deteriorates
Solution Approach 1:
The system performs preliminary validation actions by applying invalidation event definitions to meter data as it streams in, before the data is stored in massive databases. This preliminary filtering and validation occur in real-time, ensuring data quality is assessed immediately upon receipt, while the validated data is then stored for later analysis.
Solution Approach 2:
The patent introduces an intermediary validation layer between data ingestion and database storage. This intermediary system applies predefined invalidation rules and thresholds to filter and validate streaming meter data in real-time, acting as a mediator that ensures data quality before committing to long-term storage, thus maintaining both storage capacity and validation capability.
2Device complexity
If manual processing methods are used to validate meter data, then system complexity is reduced, but productivity and efficiency of data processing deteriorates
Solution Approach 1:
The system implements self-service validation by automatically applying invalidation event definitions and rules to meter data streams without requiring manual intervention. The system autonomously detects anomalies, validates readings against predefined thresholds, and generates alerts, thereby maintaining simple operational procedures while achieving high processing efficiency through automation.
Solution Approach 2:
The patent utilizes parameter changes by dynamically adjusting validation thresholds and invalidation criteria based on predefined event definitions. The system automatically modifies validation parameters such as flow rate thresholds, pressure ranges, and temporal patterns to detect anomalies, enabling efficient automated processing without increasing system complexity through fixed rigid rules.
3Reliability
If real-time validation of streamed sensor data is implemented, then anomaly detection capability is improved, but computational resources and processing load increase
Solution Approach 1:
The system applies partial validation actions by focusing computational resources on detecting specific anomaly types defined by invalidation event definitions. Rather than performing exhaustive validation on all possible data parameters, the system selectively applies validation rules to critical metrics such as flow rates, pressures, and temporal patterns, achieving effective anomaly detection with reduced computational overhead.
Solution Approach 2:
The patent segments the validation process into distinct modular components, each handling specific types of anomalies or data parameters. Invalidation event definitions are divided into separate rules for different anomaly types (e.g., flow anomalies, pressure anomalies, temporal pattern anomalies), allowing the system to process and validate different data streams independently, thereby reducing overall computational resource consumption while maintaining comprehensive anomaly detection capability.
Data Source
AI summary
A computer-implemented system for validating meter data in a utility monitoring system based on streamed sensor data is described. The system includes a metering analytics system configured to receive a stream of meter data received from sensors in or in proximity with utility meters, the meter sensor data being generated by the sensors and a central event management system for validating meter sensor data in the streamed sensor data based on a plurality of sequential sensor reads in the streamed sensor data. The central event management system is configured to receive an invalidation event definition defining a sensor value usage invalidation threshold, apply the invalidation event definition to read messages received through the streamed sensor data, monitor read messages in the streamed sensor data to identify a first read message for a watched meter, and identify an invalid meter satisfying the invalidation event definition based upon receipt of at least a second read message for the violating meter indicating that the meter sensor data is outside of a defined range for the sensor value usage invalidation threshold range.