IoT Data Collection Storage Split for Faster Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The processing speed in IoT systems decreases due to the increasing amount of data, leading to slower access and display speeds on servers, particularly in traditional IoT systems where vendor-specific applications and cloud servers need to store large amounts of data.
Innovation Solution
A data collection system with a data collection apparatus that includes a receiver, data analyzer, first data storage (write-once table), and second data storage (in-memory table) to store frequently accessed data quickly and efficiently, using tags for easy retrieval and managing data storage and access speeds.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in cloud servers to collect data from IoT devices, then data storage capacity is improved, but processing speed decreases
Solution Approach 1:
The patent segments the data storage system into two distinct storage units: a first storage unit for storing received data and a second storage unit for storing analyzed data. This segmentation allows the system to manage different types of data separately, with the second storage unit optimized for faster access to frequently queried analyzed data, thereby resolving the contradiction between storage capacity and processing speed.
Solution Approach 2:
The patent introduces a data analysis component that acts as an intermediary between raw data storage and data retrieval operations. By pre-analyzing data and storing the analyzed results in a dedicated second storage unit, the system creates an intermediate layer that speeds up data processing and retrieval without compromising the overall storage capacity.
2Speed
If analyzed data is stored separately from raw data, then data access speed is improved, but device complexity increases
Solution Approach 1:
The patent divides the data storage system into two distinct storage units: a first storage unit for raw received data and a second storage unit for analyzed data. This segmentation enables faster access to analyzed data while maintaining the original raw data for reference, balancing improved access speed with manageable system complexity through clear functional separation.
Solution Approach 2:
The data collection apparatus is designed to perform multiple functions: receiving data, analyzing data, and storing both raw and analyzed data in appropriate locations. This multi-functional design consolidates what could be multiple separate systems into a single integrated apparatus, reducing overall system complexity while maintaining fast data access capabilities.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A data collection system including a device having a communication function and a data collection apparatus configured to collect data transmitted from the device. The data collection apparatus includes a receiver configured to receive data transmitted from the device, a data analyzer configured to acquire analyzed data by analyzing the received data according to analysis data format different for each device, a first data storage which is a non-rewritable storage, a second data storage which is storage that can be accessed faster than the first data storage and that stores a smaller amount of data than the first data storage, a data writer configured to writes and stores the data received by the receiver to the first data storage, and writes and stores the analyzed data acquired by the data analyzer to the second data storage.