Database and object storage transaction consistency processing method and system

Abstract

The invention discloses a database and object storage transaction consistency processing method and system, and the method comprises the steps: obtaining a transaction data file and file metadata information; recording data file storage information in the flexible transaction table; uploading the data file to an object storage position; if the uploading of the data file fails, returning transaction failure information; if the data file is uploaded successfully, continuing to execute the database transaction, recording the corresponding file metadata information in the database data table, anddeleting data file storage information corresponding to the data file in the flexible transaction table; if the database transaction is successfully executed, returning transaction success information; if the execution fails, returning transaction failure information; regularly reading data file storage information in the flexible transaction table; searching corresponding data files in the objectstorage in batches and deleting the data files; when the data file is successfully deleted or the corresponding data file is not found in the object storage, deleting the information recorded in theflexible transaction table.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a transaction consistency processing method and system for databases and object storage. Background technique [0002] In the process of IT system design and construction, technicians need to ensure the atomicity of a single user transaction, that is, a single user transaction may involve multiple database operations. It is necessary to ensure that if the transaction is successful, all database operations are successful. If the transaction fails, regardless of At any step in the transaction, it is necessary to ensure that all database operations in this operation are rolled back to the state before the operation. Existing mature commercial database products can usually use their own mechanisms to ensure the transactional consistency of all database operations in a single transaction for users. [0003] However, for a distributed image management platform, a single image upload...

AI Technical Summary

Problems solved by technology

[0005] This method cannot strictly guarantee the consistency of transactions. For example, insert the image metadata information into the database first, and then upload the image file to the object storage operation process. If the long-term upload of the image file to the temporary storage fails, delete the database metadata. information, deletion may fail, resulting in garbage data in the database. May cause image file deletion to fail and generate junk files

[0006] In summary, only relying on the original transaction mechanism of the database cannot guarantee the transaction consistency of the database and object storage. Therefore, a new method is urgently needed to ensure its transaction consistency

Images