An Efficient Method for Archiving Sensor History Data

Abstract

The invention discloses an efficient sensor historical data archiving method. The method comprises the following steps: 1) establishing two levels of caches on a server to cache historical data records generated by a sensor, wherein each level of ache comprises a plurality of cache blocks; 2) firstly caching to-be-cached historical data records in the currently used and unfilled cache block of a first level of cache, and extracting data from the first level of cache in real time, and compressing and caching the data in a second level of cache; in the second level of cache, storing the historical data records generated by the same sensor in the cache block of the same serial number according to the sources of the historical data records; and 3) extracting a plurality of unfilled cache blocks from the second level of cache, and determining the writing positions of these extracted cache blocks in a file according to a filling time sequence; and then writing these extracted cache blocks in the file according to the determined writing positions, and clearing these extracted cache blocks. The method has the advantages of high efficiency for the archiving of sensor historical data.

Description

technical field [0001] The invention relates to the technical field of information processing, in particular to a technical method adopted for archiving historical data generated by sensors, which can be applied to the technical field of software development for the research and development of historical data management systems under the Internet of Things environment, and belongs to the field of information technology. Background technique [0002] The Internet of Things (IoT), also known as the sensor network, is an important part of the new generation of information technology, and it is also a research hotspot for researchers and industry circles in various countries in the information age. [0003] According to the latest statistics released by market research firm ABI Research, the total number of wirelessly connected devices on the Internet of Things has exceeded 10 billion, and it expects this figure to triple again to 30 billion by 2020. With such a huge number of d...

AI Technical Summary

Problems solved by technology

Finally, the archiving process is completed only when the data is written from the cache to the disk. This process often becomes a time bottleneck, because the read and write efficiency of the disk is much lower than that of the cache, and this writing process is limited. For the write performance of the disk, it is certainly a feasible solution to use solid-state hard disks, but mechanical hard disks are basically still used in actual scenarios, so if we want to improve efficiency based on the actual situation, we still need to design a method to minimize the mechanical hard disk. Seek time, so that write performance is as high as possible

Images