Method and device for asynchronous update of data based on message queue

Abstract

The invention discloses a method and a device for asynchronously updating data based on a message queue, comprising: a modeling service module determines initial data to be updated according to a data update instruction; the message service module writes target data determined by the initial data into a first message queue; The cache service module reads the target data from the first message queue and loads it into the memory, and the data loaded into the memory is used for publishing; the write library service module writes the target data read from the first message queue into the database. It can be seen that the present invention can receive data through a message queue and store it locally in a persistent manner, avoiding the process of writing data to the database first, and also pushing the data to the cache service and publishing it by the cache service, reducing the process of directly reading data from the database. Finally, the write library service asynchronously writes the data to the database, reducing the amount of data written to the database, reducing the pressure on reading and writing the database, reducing the stall phenomenon during data update, and improving the efficiency of data update.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a method and device for asynchronously updating data based on a message queue. Background technique [0002] At present, fields with a large number of users (such as the power grid field, etc.) generate a large amount of data every day. These data include but are not limited to submitted data, data that needs to be modified, and automatically collected data, and relevant personnel can also be based on actual needs. Actively access newly generated data or acquire newly generated data in real time through subscription. [0003] In practical applications, for newly generated data, it needs to be successfully written to the database and loaded into the cache before it can be retrieved. However, it has been found in practice that the process of data being written to the database is relatively slow, and relevant personnel use related terminals (such as modeling clients) to update the da...

AI Technical Summary

Problems solved by technology

However, in practice, it has been found that the process of data being written into the database is relatively slow, and related personnel use related terminals (such as modeling clients) to update data. In the process of caching, the database will be read and written frequently, which will reduce the performance of the database, and will further lead to the phenomenon of unsmooth operation during data update, which is not conducive to improving the efficiency of data update

Images