A data synchronization system and method

Abstract

The invention provides a data synchronization system and a data synchronization method. The system comprises a cache file, a reading pointer file and a writing pointer file, arranged on a hard disk. The cache file is used for storing the data to be cached; A read pointer file for storing a read position of cache data to be synchronized at present; A write pointer file for storing a write positionof cache data to be added at present; When data synchronization is carried out, the system reads the reading pointer file, obtains the reading position of the cache data to be synchronized, and readsthe data to the corresponding cache file according to the reading position to complete data synchronization. When adding new cache data, the system reads the write pointer file, obtains the write position of the cache data to be added, and writes the new cache data to the corresponding cache file according to the write position. The invention can ensure that the read and write of the cached file are not in the same position, thus avoiding the read-write conflict.

Description

Technical field [0001] The invention relates to the field of computer technology, in particular to a data synchronization system and method. Background technique [0002] Data synchronization means that when there are multiple data sources at the same level, in order to make the system usable, the data consistency of multiple data sources must be guaranteed. To ensure data consistency, it is necessary to synchronize differential data from a single data source to other data sources. In the actual operating system, various abnormal situations may occur when synchronizing data. For example, a data source is out of service, the network is disconnected, and the main data source updates data faster than other data sources receive speed, resulting in backlog After a large amount of data, data loss and other issues. In this way, when data needs to be synchronized, the difference data is cached at the end of the main data source to avoid the above problems. For the ATS system, the data...

AI Technical Summary

Problems solved by technology

[0004] 1. Caching in the memory is limited by the size of the memory. Once the cached data exceeds the size of the memory, the data will be lost; at the same time, once a program error occurs and the computer is shut down, the data will also be lost

[0005] 2. The method of creating a sequential format cache file on the hard disk can solve the problem of memory caching through persistent storage of data. However, since the data is written in the cache, the read data will be read in the file at the same time. Do the delete operation, the delete operation will cause the entire file to be rewritten, which will seriously slow down the speed of data synchronization

There are other problems in this method. Once power failure or abnormal termination of the program occurs, the probability of data loss is relatively high due to the rewriting of the entire file.

Images