MongoDB data synchronization method and related equipment

Abstract

The invention discloses a MongoDB data synchronization method and device, electronic equipment and a computer readable storage medium. The MongoDB data synchronization method comprises: exporting dataof a MongoDB to generate an exported file; generating a synchronization script file of the synchronization tool according to the file parameters of the exported file and the configuration parametersof the preset data warehouse; and executing the synchronization script file so as to call a synchronization tool to synchronize the exported file to a preset data warehouse. According to the method, the data is exported from the MongoDB database, and then a data synchronization task is completed by utilizing a synchronization tool. As the data exporting operation on the MongoDB database does not cause a large amount of data query accumulation; the operation and data export of the MongoDB database cannot be influenced by the data synchronization operation of the local but off-line exported file, so that the influence on the performance of the database can be avoided, and the data synchronization efficiency is effectively improved.

Description

technical field [0001] The present application relates to the technical field of data synchronization, and in particular to a MongoDB data synchronization method, device, electronic equipment, and computer-readable storage medium. Background technique [0002] MongoDB is an open source database system written in C++ and based on distributed file storage. MongoDB aims to provide scalable high-performance data storage solutions for WEB applications. Under high load conditions, server performance can be guaranteed by adding more nodes. It stores data as a document. The data structure is composed of key-value (key=>value) pairs. The document is similar to a JSON (JavaScript Object Notation, JS Object Notation) object, and the field value can contain other documents, arrays and document arrays. [0003] In practical applications, as data security issues become increasingly important, MongoDB's data synchronization work is of great significance. In the prior art, some synchro...

AI Technical Summary

Problems solved by technology

Since the target address in the data synchronization process is mostly a data storage system that needs to be accessed online, and even the source address in some cases, the data movement process is not only limited by the performance of the relevant hardware, but also by network resources.

Therefore, in the prior art, when the data to be synchronized is queried from MongDB, a large amount of data query accumulation will often be generated in the database, which makes the data synchronization rate slow, and makes the database performance of MongoDB drop sharply, which will affect the business system in severe cases. Normal function, even need to restart the database to restore

Images