Data Verification System for IoT Field Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
IoT data processing systems face challenges in managing unknown devices and unstructured data, leading to data loss due to simple authorization mechanisms and lack of cost control, resulting in operational inefficiencies and increased resource consumption.
Innovation Solution
A data processing system with a data verification system that performs validation checks on incoming data from field devices, routing permitted data to a primary store and unknown or unstructured data to a data landing zone for cleaning and potential reprocessing, with user interface-driven work rules for problem resolution and cost control features.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a simple authorization challenge is used to permit or deny field devices, then security is improved, but data loss increases when unknown devices attempt to connect
Solution Approach 1:
The patent segments the data processing system into multiple functional components: an authorization service that handles security challenges, a data landing zone that temporarily stores data from unauthorized devices, and a data processing service that attempts to process the data. This segmentation allows the system to maintain security while preserving data from unknown devices for potential later processing.
Solution Approach 2:
The data landing zone acts as an intermediary between the authorization service and the data processing service. It temporarily holds data from devices that fail authorization, allowing the system to attempt processing later without immediately discarding the data. This intermediary component resolves the contradiction by preventing data loss while maintaining security boundaries.
2Loss of information
If all data from field devices is accepted and stored, then data completeness is improved, but operational costs increase due to additional storage resources
Solution Approach 1:
The system performs preliminary authorization checking and data validation before committing data to permanent storage. By pre-screening data in the landing zone and only transferring validated data to the data store, the system avoids storing incomplete or malformed data structures, thereby reducing unnecessary storage costs while maintaining data completeness.
Solution Approach 2:
The patent changes the storage parameter by implementing a two-tier storage system with different retention policies. The data landing zone provides temporary storage with automatic expiration for unprocessed data, while the data store provides permanent storage only for validated data. This parameter change optimizes storage resource utilization by eliminating the need to permanently store all incoming data.
3Reliability
If data from unknown devices is immediately rejected, then security is improved, but the ability to process potentially valuable data is reduced
Solution Approach 1:
The system dynamically adjusts its handling of data from unknown devices through a multi-stage process. Initially, data is rejected at the authorization stage for security reasons, but then redirected to the landing zone for potential processing. The system dynamically evaluates each data item against known data structures and can adaptively learn from new data types, balancing security with processing capability.
Solution Approach 2:
The patent implements feedback mechanisms where the data processing service provides information about unrecognized data structures back to the system. This feedback allows the system to learn from unknown devices and potentially update its authorization and processing rules, enhancing adaptability while maintaining security through controlled feedback loops.
Data Source
AI summary
A data processing system is provided with a data verification system that is configured to perform a validation check upon receipt of a request from a field device to transfer data to the data processing system. The data verification system is also configured to verify a permission of the field device to exchange data and to validate the data integrity. A data landing zone is provided for temporary storage of the data in the event that a validation check fails, so that data errors may be corrected.