Method and device for updating data of Mysql database to Es database

Abstract

The invention provides a method and device for updating data of a Mysql database to an Es database, and the method comprises the steps: building a local message list based on the Mysql database, and writing a data updating record corresponding to a data updating event into the local message list when the Mysql database generates the data updating event; then, reading the data updating record in the local message list in real time by utilizing a pre-started first-class resident process, and publishing the read data updating record to a Topic corresponding to the message queue; if the Topic message concerned by the Es database is monitored in the message queue by adopting a pre-started second type of resident process, obtaining the monitored Topic message, and updating the Es database basedon the obtained Topic message. Therefore, according to the embodiment of the invention, the data updating record in the Mysql database is firstly written into the local message list of the Mysql database, and then the complete updating data is written into the Es database, so that the data finally updated into the Es database is high-availability complete data.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a method and a device for updating data in a Mysql database to an Es database. Background technique [0002] Usually, the list of items.page needs to use a lot of information. If you read the information directly from the Mysql database, you need to check many data tables, which leads to a slow speed of information search. Therefore, you can consider the database The data in is indexed into the Es (Elastic Search, distributed search server) database. [0003] However, in the prior art, for example, for the update (update) action of the Mysql database, the updated data is usually written directly into the message queue, and the resident process will immediately consume the message as soon as it listens to the message written into the message queue. This message, the data that is prone to update like this may not be completely written in the message queue, and the resident proce...

AI Technical Summary

Problems solved by technology

[0002] Usually, the list of items.page needs to use a lot of information. If you read the information directly from the Mysql database, you need to check many data tables, which leads to a slow speed of information search. Therefore, you can consider the database The data in is indexed into the Es (Elastic Search, distributed search server) database

[0003] However, in the prior art, for example, for the update (update) action of the Mysql database, the updated data is usually written directly into the message queue, and the resident process will immediately consume the message as soon as it listens to the message written into the message queue. This message, the data that is prone to update may not be completely written into the message queue, and the resident process will update the incomplete or untrustworthy or unavailable data to the Es database, thus affecting the accuracy of data update

And if you want to write the complete update data into the Es database later, you need to rely on the compensation mechanism to compensate, which will lead to poor real-time data update

Images