High-performance mass data synchronization method and device

Abstract

The invention discloses a high-performance mass data synchronization method. The method comprises the steps of obtaining the past state data of an Internet of Things adapter; configuring a data synchronization strategy according to the past state data; calculating a synchronization frequency according to the past state data and a data synchronization strategy to obtain a synchronization frequencylist; acquiring the real-time state data of the Internet of Things adapter through an operator interface according to the synchronization frequency list; and performing data filtering on the real-timestate data through Redis, and writing the filtered real-time state data into a database. A device using the method is also disclosed. By configuring different synchronization strategies and buffer strategies, the synchronization efficiency, flexibility and real-time performance of the data are improved, and the pressure of the synchronization data on a service system and a database is greatly reduced.

Description

technical field [0001] The invention belongs to the field of Internet of Things data synchronization, and in particular relates to a high-performance massive data synchronization method and device. Background technique [0002] The era of the Internet of Everything has arrived, and the use of IoT cards can be seen everywhere. Facing the massive data of IoT cards, a high-performance IoT card management system is very important. The business of the IoT card is extremely complex, and the data management capability of the IoT card itself is enough to reflect whether a system is excellent. The data of the IoT card itself is mainly reflected in the status of the card, the traffic information of the card, and the package information data of the card. How to efficiently and quasi-real-time synchronize these data with operators will directly affect the operation of IoT cards. A high-performance mass data synchronization strategy is the magic weapon for every IoT card system. [0...

AI Technical Summary

Problems solved by technology

However, a company may have hundreds of thousands or even millions of cards that need to access the operator interface, and the existing synchronization strategy is far from meeting the operational needs;

[0005] (2) The status of the card recorded by the IoT card management system is not synchronized with the status recorded by the upstream operator

For example, the status of the card in the operator's system is already in use, but due to synchronization delays, the status of the card recorded by the IoT card management system is still in the non-use status

The same is true for the traffic, the card traffic has been exceeded, but the card traffic recorded by the IoT card system can still be used normally, which seriously affects the normal operation of the IoT card management system;

Images