IoT Data Hardening for Reliable Cloud Analytics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Delays in Internet of Things (IoT) data can lead to unreliable data processing, particularly due to unpredictable ordering and delayed arrival of data, which affects time-dependent decision-making in enterprise operations.
Innovation Solution
Implementing a mechanism to 'harden' timestamps and timespans for IoT data, allowing only data within a defined timeframe to be used in analytics, and segmenting IoT data based on start and end dates to improve data reliability and accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If IoT data is processed in real-time without hardening, then data processing speed is improved, but data reliability deteriorates due to unpredictable ordering and delays
Solution Approach 1:
The patent applies preliminary action by establishing hardening timestamps and timespans before data processing occurs. The system pre-defines acceptable time windows for data validation, ensuring that only data within the expected time range is processed. This prevents delayed or out-of-order data from compromising reliability while maintaining real-time processing capability, as the hardening parameters are set in advance rather than during processing.
2Reliability
If hardening is applied to IoT data, then data reliability is improved, but data processing complexity increases
Solution Approach 1:
The patent applies parameter changes by modifying temporal parameters (timestamp and timespan) of IoT data through hardening. Instead of fundamentally changing the data structure or processing architecture, the system adjusts time-related parameters to validate data within acceptable windows. This approach improves reliability by filtering out delayed or invalid data while maintaining relatively simple processing logic, as it only modifies existing time parameters rather than introducing complex new mechanisms.
3Ease of operation
If IoT data is segmented by timespan, then data accessibility is improved, but data storage requirements increase
Solution Approach 1:
The patent applies segmentation by dividing IoT data into segments based on hardening timespans. Data is organized into time-based segments that can be independently accessed and processed. This improves accessibility by allowing queries to target specific time ranges without processing the entire dataset. Regarding storage, the segmentation approach organizes data efficiently by time without requiring additional storage for metadata, as the timespan information is derived from existing timestamp fields rather than requiring separate storage structures.
Data Source
AI summary
Methods, systems, and computer-readable storage media for selective use of Internet-of-Things (IoT) data in data analytics systems. Implementations include receiving IoT data from an IoT device, determining that hardening is to be applied to the IoT data, comparing a timestamp of the IoT data to a hardening value, and in response to comparing, selectively using the IoT data in one or more uses by the data analytics system.


