Data synchronization method and system, and computer readable storage medium

Abstract

The invention relates to the technical field of the internet, in particular to a data synchronization method and system, and a computer readable storage medium. In a synchronization process of masterand slave databases, logs formed by modification of the master database are maintained in a mode that a shared memory and a magnetic disk are combined; when the logs in the shared memory are not accumulated, the logs are synchronized from the shared memory to the slave database in a memory mode; when the logs in the shared memory are accumulated due to the fact that the slave database is abnormalor the pressure of the slave database is relatively large, the logs are automatically transferred into the magnetic disk, and the logs are synchronized from the magnetic disk to the slave database ina magnetic disk mode; and when the synchronization of the logs in the magnetic disk is completed and the logs in the shared memory are not accumulated, the memory mode is automatically restored. According to the data synchronization method and system, data loss under an abnormal synchronization condition can be avoided.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a data synchronization method, system and computer-readable storage medium. Background technique [0002] Redis is a key-value storage system. Similar to Memcached (a high-performance distributed memory object caching system), it supports relatively more stored value types, including string (string), list (linked list), set (collection), zset (sorted set-- ordered collection) and hash (hash type). These data types support push / pop, add / remove, intersection, union, difference and richer operations, and these operations are atomic. On this basis, redis supports sorting in various ways. Like Memcached, data is cached in memory to ensure efficiency. The difference is that redis will periodically write updated data to disk or write modification operations to additional record files, and on this basis, master-slave (master-slave) synchronization is realized. [0003...

AI Technical Summary

Problems solved by technology

[0005] In the master-slave synchronization scheme adopted by Redis, when the slave library or the network fails for a long time, the ring buffer will be full, and the historical data in the ring buffer will be discarded. When the fault is restored, the required historical data cannot be found. , so the slave library needs to be fully rebuilt, resulting in the slave library being unavailable for a long time, and the restoration will have a great impact on the main library

Images