A transaction processing method, apparatus, electronic device, and storage medium

Abstract

An embodiment of the present invention discloses a transaction processing method, apparatus, electronic device, and storage medium. The method includes: a transaction initiator processes a transaction of a product label, and performs a write message operation on a processing message of the transaction of the product label through a message middleware to obtain a message to be processed; a transaction responder consumes the message to be processed in the message middleware in response to a message processing request of the transaction initiator; the transaction responder notifies the transaction initiator of a first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the transaction of the product label according to the first message processing result. By running the technical solution provided by the embodiment of the present invention, it is possible to solve the problem that the label data storage method is based on a relational database, and when processing the transaction of the product label, a single application single-task mode is used for synchronous processing, resulting in low execution efficiency, and achieve the effect of improving the transaction processing efficiency.

Description

Technical Field

[0001] Embodiments of the present invention relate to computer technology, and in particular, to a transaction processing method, apparatus, electronic device, and storage medium. Background Art

[0002] With the development of modern Internet and the rapid update of intelligent devices, the concurrent processing pressure faced by various Internet applications is increasing, and at the same time, users' requirements for request response time are becoming more and more stringent, such as the request response for product label data. When the data volume is large, the query efficiency is time-consuming. In the context where the processing and storage of large amounts of data have reached a certain bottleneck, due to the limited processing capacity of a single database, requests need to be scattered and distributed to multiple servers, resulting in slower operations such as querying, inserting, and updating, and high loads will be generated for operations such as adding fields, adding indexes, and machine migration, affecting the provision of services.

[0003] Currently, the storage method of label data for a large number of products is based on a relational database. When performing transaction processing on product labels, a single application single-task mode is used for synchronous processing, and the execution efficiency is low. Summary of the Invention

[0004] Embodiments of the present invention provide a transaction processing method, apparatus, electronic device, and storage medium to improve the transaction processing efficiency.

[0005] In a first aspect, an embodiment of the present invention provides a transaction processing method, which includes:

[0006] The transaction initiator processes the transaction of the product label and performs a write message operation on the processing message of the product label transaction through a message middleware to obtain a message to be processed;

[0007] The transaction responder responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware;

[0008] The transaction responder notifies the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the product label transaction according to the first message processing result.

[0009] In a second aspect, an embodiment of the present invention further provides a transaction processing apparatus, which includes:

[0010] A message to be processed obtaining module, configured to enable the transaction initiator to process the transaction of the product label and perform a write message operation on the processing message of the product label transaction through a message middleware to obtain a message to be processed;

[0011] A to-be-processed message consumption module, configured to consume the to-be-processed messages in the message middleware for the passive party of a transaction in response to a message processing request from the active party of the transaction;

[0012] A transaction submission determination module, configured to notify the active party of the transaction of a first message processing result of the to-be-processed messages by the passive party of the transaction through the message middleware, and the active party of the transaction determines whether to submit the transaction of the product label according to the first message processing result.

[0013] Thirdly, an embodiment of the present invention further provides an electronic device, which includes:

[0014] One or more processors;

[0015] A storage device, configured to store one or more programs,

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the transaction processing method as described above.

[0017] Fourthly, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the transaction processing method as described above is implemented.

[0018] In the embodiment of the present invention, the active party of the transaction processes the transaction of the product label, and performs a write message operation on the processing message of the transaction of the product label through the message middleware to obtain to-be-processed messages; the passive party of the transaction consumes the to-be-processed messages in the message middleware in response to the message processing request from the active party of the transaction; the passive party of the transaction notifies the active party of the transaction of a first message processing result of the to-be-processed messages through the message middleware, and the active party of the transaction determines whether to submit the transaction of the product label according to the first message processing result, so as to solve the problem that the label data storage method is based on a relational database, and when processing the transaction of the product label, a single application single-task mode is used for synchronous processing, resulting in low execution efficiency, and achieve the effect of improving the processing efficiency of transactions. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flowchart of a transaction processing method provided in Embodiment 1 of the present invention;

[0020] Figure 2 It is a schematic structural diagram of a transaction processing device provided in Embodiment 2 of the present invention;

[0021] Figure 3 It is a schematic structural diagram of an electronic device provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0022] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present invention, rather than limiting the present invention. In addition, it should be noted that for the convenience of description, only the parts related to the present invention rather than all the structures are shown in the drawings.

[0023] Embodiment 1

[0024] Figure 1 FIG. is a flowchart of a transaction processing method provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of processing transactions of product tags to facilitate subsequent query of tag data. This method can be executed by the transaction processing device provided in the embodiments of the present invention, and this device can be implemented in the form of software and / or hardware. Refer to Figure 1 , the transaction processing method provided in this embodiment includes:

[0025] Step 110: The transaction initiator processes the transaction of the product tag, and performs a write message operation on the processing message of the product tag transaction through the message middleware to obtain a message to be processed.

[0026] Among them, the party that actively starts to process the transaction is called the transaction initiator, for example, the party that actively updates the data. The transaction of the product tag is a transaction related to the product tag, such as the update and addition of the product tag. The product tag is a data form used to describe the entity characteristics of the product. The product entity is characterized by the tag, and the characteristics of the product entity are reflected from multiple angles. For example, wealth management products in banks, etc.

[0027] The transaction initiator processes the transaction of the product tag, which means that the transaction initiator actively processes the transaction of the product tag. The processing method can be that the transaction initiator performs batch transaction processing on the product tag in the local database, such as batch update.

[0028] Performing a write message operation on the processing message of the product tag transaction through the message middleware can generate a synchronization file while the transaction initiator processes the transaction of the product tag, and write the synchronization file into the message middleware to obtain a message to be processed. Among them, the message middleware is a supporting software system that provides synchronous or asynchronous and reliable message transmission for application systems in a network environment based on queue and message passing technologies, such as RocketMQ, etc.

[0029] Optionally, for data consistency, when executing Step 110 and encountering an error that needs to be retried, the fault tolerance processing rule can be transaction rollback, which is equivalent to nothing happening.

[0030] Step 120: The transaction responder responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware.

[0031] Among them, the passive party of the transaction is the party that processes the transaction according to the message processing request sent by the active party of the transaction. One active party of the transaction can correspond to one or more passive parties of the transaction. The active party of the transaction can inform the passive parties of the transaction to process the messages to be processed in the message middleware by sending batch message processing requests respectively.

[0032] If there are multiple passive parties of the transaction, the messages to be processed processed by each passive party of the transaction can be pre-allocated or randomly allocated, and this embodiment does not limit this. Consuming the messages to be processed in the message middleware can be to write the data corresponding to the messages to be processed into the database, and this embodiment does not limit this.

[0033] Optionally, for data consistency, when executing step 120 and encountering an error that requires retry, the fault tolerance processing rule can be that since the unprocessed transaction is saved in the active party of the transaction, the local transaction operation can be retried or revoked.

[0034] If the passive party of the transaction consumes abnormally and needs to be retried continuously, the transaction processing logic needs to ensure idempotency.

[0035] In this embodiment, optionally, the passive party of the transaction responds to the message processing request of the active party of the transaction and consumes the message to be processed in the message middleware, including:

[0036] The passive party of the transaction determines a target message to be processed from the candidate messages to be processed in response to the message processing request of the active party of the transaction;

[0037] Obtain a message processing record table, and determine the historical processing record of the target message to be processed according to the message processing record table;

[0038] Consume the target message to be processed according to the historical processing record.

[0039] Among them, the target message to be processed is the message processed by each passive party of the transaction, and can be determined according to the preset relationship between the passive party of the transaction and the message to be processed in the message processing request.

[0040] The message processing record table can be established and recorded locally by the active party of the transaction, and is used to record the occurrence and processing status of the message, that is, each status of the message can be recorded in this table.

[0041] Determine the historical processing record of the target message to be processed according to the message processing record table, where the historical processing record can include the processing status of the target message to be processed. If the processing status is processing or completed, it indicates that the target message to be processed has been processed before, and there is no need to process it again. Avoid repeated processing of the same message to be processed and improve the processing efficiency of the transaction.

[0042] Step 130: The passive party of the transaction notifies the active party of the transaction of the first message processing result of the to-be-processed message through the message middleware, and the active party of the transaction determines whether to commit the transaction of the product label according to the first message processing result.

[0043] Wherein, after the passive party of the transaction processes the to-be-processed message, the first message processing result of the to-be-processed message is obtained. Each passive party of the transaction executes the message processing operation but does not perform the submission, and records the UNDO log and the REDO log. If the passive party of the transaction executes successfully, the first message processing result fed back to the active party of the transaction is success; if the execution fails, the first message processing result fed back to the active party of the transaction is failure, etc., and this embodiment does not limit this.

[0044] The active party of the transaction determines whether to commit the transaction of the product label according to the first message processing result. Among them, committing the transaction of the product label is to actually execute the transaction of the labeled product, that is, after the transaction is committed, the corresponding transaction is actually executed. For example, the updated product label is actually sent to each passive party of the transaction.

[0045] If there is a first message processing result of failure, it can be notified through the message middleware to the active party of the transaction to roll back the transaction, that is, not to commit the transaction of the product label. If multiple passive parties of the transaction have consumed the information, when the active party of the transaction needs to roll back the transaction, it notifies the passive parties of the transaction to perform a full rollback.

[0046] In this embodiment, optionally, the active party of the transaction determines whether to commit the transaction of the product label according to the first message processing result, including:

[0047] If there is a processing timeout result in the first message processing result, notify the passive party of the transaction corresponding to the processing timeout result to process again to obtain the second message processing result;

[0048] Determine whether to commit the transaction of the product label according to the second message processing result.

[0049] If there is a processing timeout result in the first message processing result, notify the passive party of the transaction corresponding to the processing timeout result to process again, that is, if the passive party of the transaction times out when consuming the to-be-processed message, it consumes again to obtain the second message processing result. If the second message processing result is success and all other message processing results are success, it is determined to commit the transaction of the product label. Avoid directly rolling back the transaction due to temporary problems such as network reasons that cause processing timeouts, and improve the success rate of transaction processing.

[0050] In this embodiment, optionally, the active party of the transaction determines whether to commit the transaction of the product label according to the first message processing result, including:

[0051] If all the first message processing results are successful, determine the transaction for submitting the product label.

[0052] When all the first message processing results are successful, determine the transaction for submitting the product label. That is, if there is one failure, the transaction is rolled back, ensuring the requirement for strong consistency in distributed transactions.

[0053] In this embodiment, optionally, in response to the message processing request of the transaction initiator, the transaction passive party consumes the to-be-processed message in the message middleware, including:

[0054] The transaction passive party performs a sharding operation on the to-be-processed message through a preset sharding algorithm in response to the message processing request of the transaction initiator, obtaining local to-be-processed messages.

[0055] The transaction passive party consumes each of the local to-be-processed messages to write the local label data corresponding to the local to-be-processed data into the main database corresponding to each transaction passive party, obtaining the written label data.

[0056] Construct at least one slave database corresponding to the main database according to the written label data, and read the target label data from the slave database.

[0057] In response to the message processing request of the transaction initiator, the transaction passive party obtains the sharding requirement. For example, shard the to-be-processed message according to the primary key of the table corresponding to the product. Exemplarily, if the primary key of the table corresponding to the product is numbered 1 - 100, then shard every consecutive ten numbers, obtaining ten portions of local to-be-processed messages.

[0058] Perform a sharding operation on the to-be-processed message through a preset sharding algorithm to obtain local to-be-processed messages. The preset sharding algorithm can be the sharding-JDBC sharding algorithm, and this embodiment does not limit this. The transaction passive party writes each local to-be-processed message into the main database corresponding to each transaction passive party respectively, obtaining the written label data. At this time, the data in the main database is only the written label data.

[0059] Construct at least one slave database corresponding to the main database according to the written label data. The slave database is used to back up the data content in the main database. Different slave databases corresponding to the same main database store the same data content, so as to facilitate subsequent queries from the idle slave database and improve the query efficiency.

[0060] The master database is used to write tag data, and the slave database is used to read the target tag data corresponding to the query product during subsequent queries. The transparent read-write separation allows the user to use the master-slave database model as if using a single database. By restricting the master database to writing data and having multiple slave databases perform read operations, the read-write bottleneck in the database is optimized.

[0061] In the technical solution provided in this embodiment, the transaction initiator processes the transaction of the product tag, and performs a write message operation on the processing message of the transaction of the product tag through the message middleware to obtain a message to be processed; the transaction passive party responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware; the transaction passive party notifies the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the transaction of the product tag according to the first message processing result, ensuring data consistency, consumption non-loss, improving the consumption efficiency of messages, and thus improving the processing efficiency of transactions.

[0062] Embodiment 2

[0063] Figure 2 It is a schematic structural diagram of a transaction processing device provided in Embodiment 2 of the present invention. This device can be implemented in a hardware and / or software manner, can execute a transaction processing method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method. As Figure 2 shown, the device includes:

[0064] A message-to-be-processed obtaining module 210, configured to process the transaction of the product tag by the transaction initiator, and perform a write message operation on the processing message of the transaction of the product tag through the message middleware to obtain a message to be processed;

[0065] A message-to-be-processed consumption module 220, configured to consume the message to be processed in the message middleware by the transaction passive party in response to the message processing request of the transaction initiator;

[0066] A transaction submission determination module 230, configured to notify the transaction initiator of the first message processing result of the message to be processed by the transaction passive party through the message middleware, and the transaction initiator determines whether to commit the transaction of the product tag according to the first message processing result.

[0067] In the embodiment of the present invention, the transaction initiator processes the transaction of the product label, and performs a write message operation on the processing message of the transaction of the product label through a message middleware to obtain a message to be processed; the transaction passive party responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware; the transaction passive party notifies the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the transaction of the product label according to the first message processing result, which solves the problem that the label data storage method is based on a relational database, and when processing the transaction of the product label, the single-application single-task mode is used for synchronous processing, resulting in low execution efficiency, and realizes the effect of improving the processing efficiency of the transaction.

[0068] On the basis of the above technical solutions, optionally, the transaction submission determination module includes:

[0069] A second message processing result obtaining unit, configured to, if there is a processing timeout result in the first message processing result, notify the transaction passive party corresponding to the processing timeout result to process again to obtain a second message processing result;

[0070] A first transaction submission determination unit, configured to determine whether to commit the transaction of the product label according to the second message processing result.

[0071] On the basis of the above technical solutions, optionally, the transaction submission determination module includes:

[0072] A second transaction submission determination unit, configured to, if all the first message processing results are successful, determine to commit the transaction of the product label.

[0073] On the basis of the above technical solutions, optionally, the message to be processed consumption module includes:

[0074] A target message to be processed determination unit, configured to the transaction passive party determines a target message to be processed from the candidate messages to be processed in response to the message processing request of the transaction initiator;

[0075] A historical processing record determination unit, configured to obtain a message processing record table and determine the historical processing record of the target message to be processed according to the message processing record table;

[0076] A target message to be processed consumption unit, configured to consume the target message to be processed according to the historical processing record.

[0077] On the basis of the above technical solutions, optionally, the message to be processed consumption module includes:

[0078] A local message to be processed obtaining unit, configured to, in response to a message processing request of the transaction initiator by the transaction responder, perform a sharding operation on the message to be processed through a preset sharding algorithm to obtain local messages to be processed;

[0079] A local message to be processed consuming unit, configured to consume each of the local messages to be processed by the transaction responder, so as to write local tag data corresponding to local data to be processed into a main database corresponding to each of the transaction responders to obtain written tag data;

[0080] A slave database constructing unit, configured to construct at least one slave database corresponding to the main database according to the written tag data, so as to read target tag data from the slave database.

[0081] Embodiment III

[0082] Figure 3 The following is a schematic structural diagram of an electronic device provided in Embodiment III of the present invention. As Figure 3 shown, the electronic device includes a processor 30, a memory 31, an input device 32, and an output device 33; the number of processors 30 in the electronic device may be one or more. Figure 3 Here, one processor 30 is taken as an example; the processor 30, the memory 31, the input device 32, and the output device 33 in the electronic device may be connected through a bus or other means. Figure 3 Here, connection through a bus is taken as an example.

[0083] The memory 31, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the transaction processing method in the embodiments of the present invention. The processor 30 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the memory 31, that is, implements the above-mentioned transaction processing method.

[0084] The memory 31 may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 31 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some instances, the memory 31 may further include a memory remotely provided relative to the processor 30, and these remote memories may be connected to the electronic device through a network. Examples of the above network include but are not limited to the Internet, an enterprise internal network, a local area network, a mobile communication network, and combinations thereof.

[0085] Embodiment IV

[0086] Embodiment 4 of the present invention further provides a storage medium containing computer-executable instructions, and the computer-executable instructions are used to execute a transaction processing method when executed by a computer processor. The method includes:

[0087] The transaction initiator processes the transaction of the product label, and performs a write message operation on the processing message of the transaction of the product label through a message middleware to obtain a message to be processed;

[0088] The transaction passive party consumes the message to be processed in the message middleware in response to the message processing request of the transaction initiator;

[0089] The transaction passive party notifies the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to submit the transaction of the product label according to the first message processing result.

[0090] Certainly, for a storage medium containing computer-executable instructions provided by an embodiment of the present invention, the computer-executable instructions are not limited to the method operations described above, and can also execute related operations in the transaction processing methods provided by any embodiment of the present invention.

[0091] From the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software and necessary general-purpose hardware. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as a floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk, or optical disc of a computer, etc., and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention.

[0092] It should be noted that in the embodiments of the above transaction processing device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the present invention.

[0093] Note that the above is only a preferred embodiment of the present invention and the technical principles applied. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, re-adjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments. Without departing from the concept of the present invention, more other equivalent embodiments can be included, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A transaction processing method, characterized in that, including: The transaction initiator processes the transaction of the product label, and performs a write message operation on the processing message of the transaction of the product label through a message middleware to obtain a message to be processed; The transaction passive party responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware; The transaction passive party notifies the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the transaction of the product label according to the first message processing result; The transaction passive party responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware, including: The transaction passive party responds to the message processing request of the transaction initiator, performs a sharding operation on the message to be processed through a preset sharding algorithm to obtain a partial message to be processed; The transaction passive party consumes each partial message to be processed to write the partial label data corresponding to the partial data to be processed into the main database corresponding to each transaction passive party to obtain written label data; Construct at least one slave database corresponding to the main database according to the written label data to read target label data from the slave database; wherein, different slave databases corresponding to the same main database store the same data content.

2. The method according to claim 1, characterized in that, The transaction initiator determines whether to commit the transaction of the product label according to the first message processing result, including: If there is a processing timeout result in the first message processing result, notify the transaction passive party corresponding to the processing timeout result to process again to obtain a second message processing result; Determine whether to commit the transaction of the product label according to the second message processing result.

3. The method according to claim 1, characterized in that, The transaction initiator determines whether to commit the transaction of the product label according to the first message processing result, including: If all the first message processing results are successful, determine to commit the transaction of the product label.

4. The method according to claim 1, characterized in that, The transaction passive party responds to the message processing request of the transaction initiator and consumes the message to be processed in the message middleware, including: The transaction passive party determines a target message to be processed from the message to be processed in response to the message processing request of the transaction initiator; Obtain a message processing record table, and determine the historical processing record of the target message to be processed according to the message processing record table; Consume the target message to be processed according to the historical processing record.

5. A transaction processing device, characterized in that, including: A message to be processed obtaining module, configured to enable the transaction initiator to process the transaction of the product label, and perform a write message operation on the processing message of the transaction of the product label through a message middleware to obtain a message to be processed; A message to be processed consumption module, configured to enable the transaction passive party to respond to the message processing request of the transaction initiator and consume the message to be processed in the message middleware; A transaction submission determination module, configured to enable the transaction passive party to notify the transaction initiator of the first message processing result of the message to be processed through the message middleware, and the transaction initiator determines whether to commit the transaction of the product label according to the first message processing result; The to-be-processed message consumption module includes a local to-be-processed message acquisition unit, a local to-be-processed message consumption unit, and a slave database construction unit; The local to-be-processed message acquisition unit is configured to, in response to a message processing request from the transaction initiator by the transaction responder, perform a sharding operation on the to-be-processed message through a preset sharding algorithm to obtain local to-be-processed messages; The local to-be-processed message consumption unit is configured to consume each of the local to-be-processed messages by the transaction responder to write local tag data corresponding to local to-be-processed data into a master database corresponding to each of the transaction responders, thereby obtaining written tag data; The slave database construction unit is configured to construct at least one slave database corresponding to the master database according to the written tag data, so as to read target tag data from the slave database; wherein, different slave databases corresponding to the same master database store the same data content.

6. The device according to claim 5, characterized in that, The transaction submission determination module includes: A second message processing result acquisition unit, configured to, if there is a processing timeout result in the first message processing result, notify the transaction responder corresponding to the processing timeout result to process again to obtain a second message processing result; A first transaction submission determination unit, configured to determine whether to submit the transaction of the product tag according to the second message processing result.

7. The device according to claim 6, characterized in that, The transaction submission determination module includes: A second transaction submission determination unit, configured to, if all of the first message processing results are successful, determine to submit the transaction of the product tag.

8. An electronic device, characterized in that, The electronic device includes: One or more processors; A storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the transaction processing method according to any one of claims 1-4.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the transaction processing method according to any one of claims 1-4.

Images