118 results about "Distributed transaction processing" patented technology

The invention provides an online document processing method and system based on a document processing model, and the method comprises the steps: obtaining an editing request of a user for a target data unit, generating a temporary locking identifier according to a user authority identifier and a request timestamp, limiting the modification operation of other users for the target data unit, and obtaining a conflict isolation result; constructing a data consistency module according to a conflict isolation result, extracting editing state information of the current data unit from the temporary locking identifier, and performing sequential recording on concurrent operation by adopting a distributed transaction processing technology; if it is detected that version conflicts exist in the sequenced records, a rollback mechanism is triggered, operation priorities are redistributed, and data versions after consistency verification are determined; and designing a hierarchical cache structure according to the data version after consistency verification, storing the high-frequency access data into a memory cache region, and storing the low-frequency access data into a disk cache region to obtain a hierarchical storage structure. The data consistency and security are good, and the storage and access efficiency is improved.

The invention relates to the technical field of distributed system transaction management, and discloses an inventory consistency management method and device based on distributed transactions, and the method comprises the following steps: pre-occupying an inventory, and recording the state information of the inventory to a Redis hash structure; after the inventory is pre-occupied successfully, generating a pre-deducted snapshot, generating a compensation identifier, and writing the pre-deducted snapshot and the compensation identifier into a MySQL transaction log together; verifying the uniqueness of the compensation identifier, and submitting the current database transaction after the uniqueness of the compensation identifier is confirmed; when the submission of the current database transaction fails, executing a compensation operation on the current database transaction; and after the compensation operation is executed, performing data consistency verification on the MySQL transaction log and the Redis hash structure. According to the method and the system, the consistency of inventory management during distributed transaction processing is highly guaranteed.

The invention discloses a non-inductive payment system and method based on adaptive multi-modal fusion and behavior prediction, and the system comprises a non-inductive payment system, a user module, and a non-inductive payment machine body, and the non-inductive payment system is installed in the non-inductive payment machine body. The non-inductive payment system comprises a user module, an edge computing module, a cloud computing module, a block chain network module and an inter-module communication module, a biological feature collection device and an environment feature collection device are arranged in the user module, the self-adaptive multi-modal fusion algorithm is different from a fixed weight method, the weight is dynamically adjusted, and the recognition accuracy is improved; a behavior prediction model of reinforcement learning predicts customer behaviors in real time, and shopping experience is improved; the edge of the distributed transaction processing mechanism is coordinated with the cloud, the efficiency is improved, and high concurrency is adapted; and data security policy homomorphic encryption is combined with the block chain, so that data security is ensured, and laws and regulations are met.

Embodiments of the present application provide a transaction processing method, a device, and a storage medium. For a distributed transaction, it is proposed innovatively that exclusive locks are added to data records involved in a read set of the distributed transaction in a read phase; in a write phase, write operations for a write set can be directly executed based on these exclusive locks, and an exclusive lock on a related data record can be released immediately after a write operation is completed. In the write phase, the exclusive locks added to the data records can maintain the exclusivity of the distributed transaction over these data records, which can avoid the write operation abort problem in the write phase. That is, all write operations of the distributed transaction are bound to succeed, thereby ensuring the atomicity of distributed transaction processing. In addition, since the exclusive lock is released immediately after the write operation is completed, the lock-holding time of the distributed transaction is only the time inherently required to execute transaction logic of the distributed transaction, thereby greatly reducing the lock-holding time of the distributed transaction, effectively increasing the throughput for distributed transactions and improving the transaction processing efficiency.

The invention relates to a data management method and a data management system based on OpenHarmony. The method comprises the following steps: constructing a cross-device data storage layer by utilizing a distributed soft bus technology, and carrying out fragmentation storage and redundant backup on target data to obtain a distributed data storage architecture; performing feature extraction to obtain a data classification result and a fine-grained data mark; comprehensively analyzing the network condition, the equipment performance and the user behavior to obtain a data synchronization strategy; executing two-stage protocol submission and vector clock concurrency control on the cross-device operation to obtain a distributed transaction processing result; performing structural feature and repetitive mode analysis to obtain a compression algorithm selection result and a compression parameter; and carrying out compression processing, and carrying out adaptive routing selection and load balancing on the compressed data transmission path to obtain a multi-device data flow management scheme. According to the method, data integrity and availability are guaranteed, data are effectively compressed, and storage space and transmission bandwidth are saved.

The invention provides a distributed transaction processing system and method. The system comprises a transaction coordinator, a transaction manager and a resource manager, the transaction manager is configured to: register a global transaction with the transaction coordinator; the transaction coordinator is used for creating a global transaction identifier for the global transaction; creating a branch transaction identifier for each branch transaction; the resource manager is configured to: register branch transactions with the transaction coordinator; the service processing statement is executed to obtain updated service data, a rollback log is generated, the updated service data and the rollback log are submitted to a database, and resources used for submitting operation are released; the transaction coordinator is further used for judging whether the submission operation of each branch transaction in the first stage is successful or not; if both are successful, the transaction manager is notified, so that the transaction manager initiates a global submission confirmation request of a second stage; and asynchronously notifying each resource manager to delete the rollback log. According to the invention, the concurrency performance can be improved and the complexity can be reduced.

The disclosed embodiments relate to systems / methods for low latency regulation of distributed, e.g., geographically and / or logically, transaction processing, such as trading of financial instruments, in accordance with centralized demand-based dynamically reallocated post-trade-based limits, e.g., credit / risk limits. In particular, the disclosed embodiments relate to monitoring credit demand across execution venues, as opposed to actual utilization, and, based thereon, modifying execution specific limits to reallocate of portions of a credit / risk allotment, such as a credit / risk limit, to multiple execution venues for use in approving transactions, which may implement order driven and / or quote driven markets, so as to dynamically rebalance the allocations to the execution venues based on demand / need, rather than utilization, thereby avoiding having to mitigate latencies in determining and responding to utilization. In addition, the disclosed embodiments may maximize the total available amount for reallocation by recognizing inter-execution venue limit offsetting positions, i.e., trades, during the rebalancing process.

The invention relates to a micro-service architecture system based on business function and data double isolation, and the system comprises a business function splitting module which splits a single application into independent micro-services; the data physical isolation module is used for distributing an independent database instance for each micro-service; the dynamic routing control module is used for dynamically distributing flow through a load sensing strategy and integrating a fusing mechanism; and the gray release module supports flow hierarchical diversion and abnormal automatic rollback, and ensures safe switching of service versions. According to the invention, by realizing double isolation of service functions and data, the independence and the expandability of the system are improved, and the data coupling degree and the maintenance cost are reduced; the stability and reliability of the system are ensured, and the risk in the migration process is reduced; according to the method, rapid iteration and continuous delivery can be realized, the development and deployment period of new functions is accelerated, and the user experience is improved through efficient service governance and data consistency guarantee, so that the system can better cope with challenges of high concurrent access and distributed transaction processing.

The invention provides a distributed transaction processing method based on a message queue, computer equipment and a medium. The processing method comprises the steps that a producer sends a semi-transaction message to a Rocket MQ server; the semi-transaction message refers to a transaction message which is marked as a temporary non-delivery state by the Rocket MQ; the producer receives a semi-transaction confirmation message returned by the Rocket MQ server, and starts to execute a local transaction; if the local transaction is successfully executed, the producer immediately submits a secondary confirmation result of the semi-transaction message to the Rocket MQ server; if the secondary confirmation result of the semi-transactional message is submission, marking the semi-transactional message as a deliverable state, and delivering the semi-transactional message to the consumer; if rollback, the semi-transactional message will be deleted. By means of the distributed transaction processing method, the transaction processing efficiency can be remarkably improved, and operation and control are simplified.

The present disclosure relates to software technologies, and in particular, to a distributed transaction processing method, system, apparatus and readable storage medium. The method includes a policy data management module creating and initializing a historical version table used to record data content and version information of each version of a target data entity. The initialized version information includes first version information that corresponds to first version data content of the target data entity. The method includes a transaction process processing module sending a received first-type operation request to the policy data management module; and the policy data management module reading the historical version table and recording the second version data content acquired by performing the first-type operation on the first version data content. In this way, distributed transaction processing efficiency and service rollback capability can be improved based on a historical version table, which helps improve user experience.

The embodiments of the present application provide a method, device, and storage medium for processing transactions. For distributed transactions, it is innovatively proposed to add exclusive locks to the data records involved in the read set during the read phase; during the write phase, the write operations for the write set can be directly executed based on these exclusive locks, and the exclusive locks on the relevant data records are released immediately after the write operations are completed. The exclusive locks added to the data records during the write phase can maintain the exclusivity of the distributed transaction to these data records, which can avoid the problem of write operation abortion during the write phase. That is, all write operations of the distributed transaction will surely succeed, which ensures the atomicity of distributed transaction processing. In addition, since the exclusive locks are released immediately after the write operations are completed, the lock holding time of the distributed transaction is only the time required for executing its transaction logic inherently, which greatly shortens the lock holding time of the distributed transaction, thereby effectively improving the throughput of the distributed transaction and improving the transaction processing efficiency.

The invention discloses a distributed transaction processing method and device based on a message queue and a compensation strategy, and the method comprises the steps: initiating a transaction request crossing multiple services or databases, and packaging the transaction request into one or more transaction messages; carrying out message distribution, and distributing the messages to corresponding service nodes through message queues; each service node asynchronously obtains the transaction message from the message queue, and controls each service node to execute a corresponding local transaction operation according to the received transaction message; and carrying out rollback or compensation operation on failed or partially successful transactions on the basis of the transaction global state updated by the operation execution result and a preset intelligent compensation strategy so as to ensure the final consistency of the transactions. According to the method, transaction initiation, message distribution, transaction execution, state confirmation, message compensation, transaction confirmation and the like are adopted, so that the final consistency of the distributed system data can be realized through a message queue and a message compensation mechanism, and convenience is provided for the use of a user.

Provided in the embodiments of the present disclosure are a distributed transaction processing method, an electronic device, a storage medium, and a program product. In the embodiments of the present disclosure, the process during which a coordination node persists a transaction state log is offloaded to each participating node, such that each participating node persistently records a transaction state of each transaction in a commit procedure by means of a state storage area and finally maintains a completion state of each transaction; and when a participating node has a fault and recovers again, transaction recovery can be performed on the basis of the transaction state of each transaction persistently recorded by the participating node, such that not only can it be ensured that after any participating node has a fault or a network is interrupted, all participating nodes still have a consistent final state, but the operations that the coordination node perform to persist the transaction state log can also be saved on, thereby reducing the response delay of transaction commit and increasing the throughput.

The invention provides an SKU efficient ex-warehouse method and device in a SaaS commodity system, and belongs to the technical field of data processing, and the method comprises the steps: importing an SKU inventory exchange code; acquiring a user request based on the token bucket; requesting a transaction to lock the SKU according to a user request; selecting an unused redemption code according to the SKU inventory redemption code and a user request based on the ZPOPMIN command; if selection succeeds, unused redemption code logic is processed, and the lock is released; and if the redemption code is used up, reminding that there is no available redemption code. According to the SKU efficient ex-warehouse method and device in the SaaS commodity system, based on the token bucket, the user request is acquired, the commodity requested to be exchanged by the user is locked, based on the ZPOPMIN command, the unused exchange code is selected, the unused exchange code logic is processed, and the corresponding SKU is accessed based on the distributed lock to complete ex-warehouse, so that distributed transaction processing is more efficient, and ex-warehouse efficiency is higher.

The application provides a distributed transaction processing system and method, comprising: a client-oriented fusion server and a plurality of incremental servers connected with the fusion server, each incremental server having a plurality of corresponding backup servers, each incremental server being used for storing incremental data, the incremental data stored by the plurality of incremental servers being non-overlapping; the fusion server being used for: when receiving a data update request sent by the client, acquiring a data division rule; determining an incremental server involved in this data update according to data information involved in the data request and the data division rule; if the number of the incremental servers involved is N, splitting a physical update plan corresponding to this data update into N update sub-plans; controlling the N incremental servers involved to execute respective corresponding update sub-plans, and realizing data update. The application can improve the processing efficiency of incremental data.

The invention discloses a distributed transaction processing method and system, and belongs to the technical field of database systems, the method is suitable for a distributor, and the method comprises the following steps: obtaining transaction processing information of a current to-be-processed transaction, determining a target site for processing the transaction, sending the transaction processing information to the target site, and sending the transaction processing information to the target site; after the target site receives the transaction processing information, if new transaction processing information is not received within a preset time period, transaction processing is carried out according to the transaction processing information, and a transaction processing result is obtained and fed back; and otherwise, taking the current to-be-processed transaction and a new to-be-processed transaction received in the preset time period as target processing transactions, sorting according to the timestamps, sequentially processing the transactions, obtaining a transaction processing result, feeding back the transaction processing result to the distributor, and feeding back the result by the distributor according to the transaction processing result. By implementing the method and the device, the problem of low processing efficiency caused by transaction processing by using a traditional lock mechanism in the prior art can be solved.

The embodiment of the invention provides a trusted payment refund method and system based on a distributed system. The method comprises the following steps: receiving a refund request; preliminary verification and information verification are carried out on the received refund request, the refund request passing the verification is persisted to a database refund information record table, the refund request passing the verification is marked as a to-be-processed refund request, the input interface supports idempotent operation, and distributed lock locking processing is carried out on a refund original order number field; and obtaining the refund request marked as the to-be-processed state in the refund record table by adopting timed task scanning, marking the refund request as in-processing, and executing a refund service on the to-be-processed refund order based on the distributed transaction processing mechanism and the capital flow of the trusted payment service. According to the application, the efficiency, security and consistency of the refund operation are realized by introducing the distributed lock, the distributed transaction processing mechanism and the intelligent contract technology.

Techniques for distributing transaction processing based on processor capacity and configuration are described herein. For example, a computer system can determine a trigger event indicating that transactions are no longer to be processed by a first processor. The computer system can select a second processor to which the transactions are to be sent. The second processor can be selected based on a transaction processing capacity of the second processor and a configuration of the second processor that indicates that the second processor is configured to process the transactions. The computer system can receive transaction data indicating that a transaction is to be processed. The transaction can be associated with transaction attributes. The computing system can send the transaction data to the second processor in real-time relative to the transaction data being received based at least in part on the second processor being selected and the transaction attributes.

The present disclosure provides a distributed transaction processing method and related devices. A business application starts a distributed transaction; the business application calls the attempt interfaces of a personnel account sub-server, a personnel status sub-server, and a to-do transaction sub-server; the business application sequentially determines the attempt interfaces of the personnel account sub-server, the personnel status sub-server, and the to-do transaction sub-server; in response to determining that the call of the attempt interface of any one of the personnel account sub-server, the personnel status sub-server, and the to-do transaction sub-server fails, it is determined that any one of the distributed transaction processing fails, and the business application sends a transaction rollback request to the transaction coordinator; in response to determining that the transaction coordinator receives the transaction rollback request, the rollback interfaces of the personnel account sub-server, the personnel status sub-server, and the to-do transaction sub-server are sequentially called.

This application relates to the field of software technology, and more specifically, to a distributed transaction processing method, system, apparatus, and readable storage medium. The method includes creating and initializing a history version table, where the history version table is for recording the data content and version information of each version of a target data entity, the initialized version information includes first version information, and the first version information corresponds to the data content of the first version of the target data entity; the service flow processing module sending a first type of operation request for the received target data entity to the insurance securities data management module; and the insurance securities data management module reading the history version table and recording the data content of the second version obtained by performing a first type of operation on the data content of the first version. This application can improve the efficiency of distributed transaction processing and the service rollback ability based on the history version table, which is advantageous for improving the user experience.

The present application provides a distributed transaction processing method, apparatus and system based on a programmable switch. The method includes: the programmable switch receives first messages sent by at least one service node participating in the current transaction processing stage of the distributed transaction. If the number of first messages received by the programmable switch for a non-final transaction processing stage is equal to the message number threshold and the type information in each first message indicates success, the programmable switch sends a second message to the target node. If the number of first messages received by the programmable switch for the final transaction processing stage is equal to the corresponding message number threshold and the type information in each first message indicates success, or if the type information in the first messages received by the programmable switch in the current transaction processing stage indicates failure, the programmable switch sends the distributed transaction processing result to the client node. Therefore, the performance of distributed transaction processing can be greatly improved.

The present specification relates to the technical field of big data storage and processing, and provides a distributed transaction processing method, device and equipment based on append-only file storage, which is applied to the master node side of a distributed database system, and includes: receiving a data insertion request sent by a client; dispatching an append-only operation task to multiple slave nodes according to the data insertion request, so that the multiple slave nodes execute the append-only operation task based on lanes in a distributed file system; receiving the append-only operation results returned by the multiple slave nodes; and submitting the append-only operation results returned by the multiple slave nodes as a transaction. The embodiments of the present specification can improve the data consistency and processing efficiency of distributed transaction processing.

This invention provides a distributed transaction processing method for BOM data in a PLM system, belonging to the technical field of PLM systems. When initiating a BOM data modification transaction, this invention sends a preparation request to participating nodes and performs field-level lock acquisition. A majority vote determines whether the transaction should be committed or rolled back. Transaction logs are batch-aggregated into group commit log blocks according to time windows and copied to persistent memory via RDMA. A closure table is established for the BOM tree structure to store ancestor-descendant relationships. An artificial intelligence model is used to monitor node response latency and log write rate to dynamically adjust parameters. When a network partition is detected, nodes holding a majority lease continue processing the transaction. After partition recovery, data merging is performed using version vector conflict detection and a compensation transaction mode. This solves the problem of data consistency being difficult to guarantee due to network partitions when processing BOM data modification transactions in a distributed PLM system.

The present invention discloses a distributed transaction processing method based on a microservices architecture, specifically relating to the field of transaction processing. The method comprises a business management unit, a business execution preparation unit, and a business execution unit. The business management unit comprises a business receiving unit for receiving and distributing business messages, a business status storage unit for recording the initial business processing status, and a business feedback unit for providing feedback on the business processing status. The present invention further self-diagnoses and classifies sub-items in the distributed transaction processing process based on the microservices architecture, and incorporates an information feedback design to enable self-search and feedback, thereby lowering the user threshold and making the present invention very easy to promote.

The embodiment of the invention discloses a distributed transaction processing system transaction processing method and a computer readable storage medium. According to the method, a lock-free conflict detection mechanism is introduced, on the premise that any read-write lock is not used, writing-writing conflicts, writing-reading conflicts or read-writing conflicts of data item granularity between concurrent transactions are detected, and the three data inconsistency problems of dirty reading, unrepeatable reading and magical reading are avoided. Meanwhile, transactions with reading conflicts are allowed to be executed concurrently, and the concurrency of transaction processing is improved. When a timeout problem occurs, the coordinator and the participants respectively execute different protocol termination processes, so that the coordinator and the participants can be timely and properly processed when faults occur, and the 2PC protocol is optimized. Besides, after the participants enter the submission stage of the transaction submission step, the multi-copy mechanism of the system ensures that the sub-transactions undertaken by the participants are not influenced to execute correct submission or rollback operation even if the participants fail, so that the fault tolerance of the system is ensured.

The invention provides a continuously improved corpus problem classification method, and belongs to the technical field of information processing and corpus construction. The method is realized based on a cluster and comprises the following steps: judging whether the electronic equipment generates parallel corpora or not, verifying the electronic equipment by adopting a verification equipment set, performing pre-submission operation on each parallel corpus stored in a pre-submission corpus, and updating a standard corpus according to a feedback result of the pre-submission operation. The updating comprises the steps of carrying out reclassification on parallel corpora of the standard corpus according to source corpora or target corpora and the like. The cluster is a translation server cluster or a question and answer server cluster. According to the technical scheme, the constructed corpus information can be continuously improved and updated, and corpus input errors caused by subjective deviation accumulation of individual users or devices can be effectively avoided in the updating process; in addition, the updating process is based on a distributed transaction processing mechanism, and the consistency of standards is ensured.

The invention provides a transaction processing method and device, a storage medium and electronic equipment, and is applied to the technical field of distributed transaction processing. The method comprises the following steps: acquiring transaction request data containing transaction uniqueness elements, and sequentially executing at least one preposed business transaction to obtain a local pipeline record; after the pre-transaction succeeds, acquiring auxiliary reconciliation information based on the transaction uniqueness element and the execution result set; then executing an auxiliary reconciliation transaction to obtain an auxiliary reconciliation registration result; and finally, a real-time transaction state associated with the transaction request is generated in combination with a local flow record and an auxiliary reconciliation registration result, synchronization and automatic reconciliation of cross-system transaction states are realized, and the accuracy of transaction state confirmation and the efficiency of accounting checking are improved.

The invention discloses a distributed transaction processing method and system. The method comprises the steps that a message node determines a transaction execution sequence corresponding to distributed transactions to be processed; and if the message node monitors that a first transaction node in the plurality of transaction nodes successfully executes a first branch transaction in the distributed transaction, determining transaction data required for executing a second branch transaction based on execution data of the first branch transaction, and pushing the transaction data to a second transaction node corresponding to the second branch transaction, the second branch transaction is located next to the first branch transaction in the transaction execution sequence; the second transaction node operates the corresponding data source based on the transaction data of the second branch transaction to execute the second branch transaction, and stores the execution data of the second branch transaction; and if the message node monitors that the second transaction node does not successfully execute the second branch transaction, the message node sends a rollback instruction to the second transaction node, so that the second transaction node restores a corresponding data source according to the stored execution data of the second branch transaction.

This disclosure provides a method for distributed transaction processing, relating to the field of computer technology, and particularly to the field of database technology. The specific implementation scheme is as follows: The current action state of a business state machine is obtained as the first action state; the business state machine is a state machine that presents the business processing status. A first business operation interface corresponding to the first action state of the business state machine is called, causing the business end to execute the operation corresponding to the first business operation interface. This decouples the transaction coordinator from each business, reduces the intrusion of the transaction coordinator into the business end, and lowers the operational costs of the business.

The invention relates to the technical field of distributed computing, and particularly provides a distributed transaction processing method, system and device, a storage medium and a program product. The method comprises the following steps: a transaction manager sends a registration and opening request of a global transaction to a transaction coordinator; the transaction coordinator registers and opens a global transaction, and allocates a global lock for the global transaction; the transaction manager sends a calling request to each resource manager according to a preset execution sequence; each resource manager starts a branch transaction indicated by the call request and determines an execution state of a preparation stage; respectively sending an execution state to a transaction manager and a transaction coordinator; the transaction manager determines an execution decision of an execution stage based on the execution states of the plurality of branch transactions; sending a decision confirmation request to the transaction coordinator based on the execution decision; releasing the local locks of the plurality of branch transactions under the condition that the execution decision is submission; the transaction coordinator determines a decision confirmation result based on the execution states of the plurality of branch transactions; under the condition that the decision confirmation result is submission, submission instructions are sent to a plurality of resource managers, and the global lock is released; and each resource manager asynchronously submits each branch transaction and asynchronously deletes the rollback log. The resource locking time can be remarkably shortened, and the concurrent processing capacity of the distributed transaction processing system is improved.