Edge Server Data Transformation for IoT Analytics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The massive amount of data generated by IoT devices poses a challenge for existing technologies, as it overwhelms networks and is difficult to process in a timely manner due to energy limitations in battery-powered devices and logistical constraints, necessitating a solution for data storage, processing, and analysis at the edge before cloud upload.
Innovation Solution
Implementing an edge server that receives data from multiple IoT devices, transforms it, stores it in a database, performs analytics, and selectively uploads processed data to a remote server via a network, utilizing windowing and transformation components for aggregation and statistical analysis, and enabling machine learning models for predictive analytics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data from multiple IoT devices is transmitted to cloud computing resources, then data processing capacity is improved, but network bandwidth consumption increases and network burden increases
Solution Approach 1:
The system segments data processing between edge servers and cloud computing resources. Edge servers perform local processing of IoT device data, transforming and filtering data before selective upload to the cloud. This segmentation reduces the volume of data transmitted over the network while maintaining processing capacity for both local and cloud-based operations.
Solution Approach 2:
Edge servers act as intermediary components between IoT devices and cloud computing resources. These intermediaries receive raw data from devices, perform transformations and analytics locally, and selectively upload only processed or aggregated data to the cloud, thereby reducing network bandwidth consumption while preserving data processing capabilities.
2Loss of time
If data is processed and transmitted in real-time from IoT devices, then response time is improved, but energy consumption of battery-powered devices increases
Solution Approach 1:
The system extracts data processing functions from battery-powered IoT devices and relocates them to edge servers with sufficient computational resources. IoT devices transmit raw data with minimal processing, while edge servers perform transformations and analytics, thereby reducing energy consumption at the device level while maintaining timely response through local processing capabilities.
3Loss of information
If all raw data from IoT devices is uploaded to the cloud, then data availability is improved, but network burden increases and processing efficiency decreases
Solution Approach 1:
Edge servers perform preliminary actions on IoT device data by transforming, aggregating, and filtering data before upload to the cloud. This preliminary processing ensures that essential information is preserved and made available in the cloud, while reducing the overall data volume to improve processing efficiency and reduce network burden.
Data Source
AI summary
A computer implemented method includes receiving data from multiple devices at an edge server, transforming the data received from the multiple devices, storing the transformed data in an edge server database, performing analytics on the transformed data in the database, and selectively uploading data to a remote server via a network.