System and method used for processing multi-phase distributed task scheduling

A technology of distributed tasks and scheduling methods, which is applied in the system for processing multi-stage distributed task scheduling and the processing field required by multi-stage distributed complex transaction processing, can solve the problem of not reflecting the idea of ​​staged processing of complex transactions, high overhead, Unable to implement sub-stage rollback and redo and other problems, to achieve the effect of efficient and reliable processing, no after-effects, and cost reduction

Active Publication Date: 2014-03-19
SHANGHAI STOCK EXCHANGE
View PDF4 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The overall processing method ensures the integrity of the transaction, but once a rollback occurs, the overall processing overhead will be very high, and the existing distributed two-stage transaction processing divides the distributed transaction into two stages: The preparation phase of the first phase and the commit phase of the second phase. In the preparation phase, each sub-transaction can be processed in a distributed manner, and each sub-transaction has completed almost all

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method used for processing multi-phase distributed task scheduling
  • System and method used for processing multi-phase distributed task scheduling
  • System and method used for processing multi-phase distributed task scheduling

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0027] Example 1

[0028] Such as figure 1 As shown, figure 1 It is a schematic diagram of a system deployment method used to process multi-stage distributed task scheduling. The figure uses a cluster composed of two hosts as an example. The cluster nodes use synchronization locks to support the main node election and inter-node control message triggering functions. The transaction sent from the foreground is routed to the architecture module of the master node through the communication layer. The master node architecture module records the transaction data into the work page log file of the shared disk, and triggers the replay of the work page log file of the slave node architecture module through the synchronization lock , The architecture module of the master-slave node will send its own transaction request to the functional module of the machine for processing, and the response information processed by the functional module will be summarized to the master node architecture mo...

Example Embodiment

[0029] Example 2

[0030] figure 2 It is a flowchart of the cooperative work of the master-slave node architecture module and its functional modules in the multi-stage processing of transaction requests. As shown in the figure, all transaction requests are first processed by the master node architecture module, and the master node architecture module completes the necessary schooling. After verifying the work, create an asynchronous job for the transaction request and send the asynchronous transaction job to the function module for execution. After that, the master node architecture module immediately triggers the replay of the log file of the work page by the slave node architecture module, and the slave node architecture module is based on the log The data recorded in the file creates the same transaction asynchronous job and request data locally, and sends the job request to the local function module for processing. The function module of each node receives the transaction req...

Example Embodiment

[0033] Example 3

[0034] image 3 It is the process flow chart of the node failure backup machine takeover processing in the cluster. If a node failure exit occurs in the cluster, the synchronization message lock between the cluster nodes will trigger the node exit event on all nodes, and the remaining nodes in the cluster will respond to the event. If the master node fails, the newly elected master node will replay according to the work page log file recorded by the failed master node on the shared disk, restore to the state consistent with the last record of the failed master node, and then continue to take over task processing; if it is If the slave node fails, the standby machine directly takes over the work of the failed slave node, and the master node resends the unfinished transaction to the takeover slave node for processing. This mechanism ensures that the multi-stage distributed complex transaction can still be processed correctly in the case of the host failure .

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses the data processing field and specifically relates to a system and a method used for processing multi-phase distributed task scheduling. The system comprises multiple host computers for specific business processing, each host computer is for set processing of one or more products, sharing access to a disk is realized through a storing area network among the host computers, data synchronization among the host computers is carried out through a sharing disc, message synchronization among all the transaction host computers is realized through distributed locks, a function module is for classification of request processing of a present machine product set, distributed subtransaction processing is mainly accomplished at the function module of each host computer. Compared with the prior art, the system is advantaged in that processing efficiency of a multi-phase distributed complex transaction is improved through a distribution mode, rollback cost of the transaction caused by processing failure is reduced, and the system is especially suitable for high-efficiency reliable processing of the multi-stage, no-aftereffect and sub-phase-distribution complex transaction in the security data processing industry.

Description

[technical field] [0001] The present invention relates to the field of data processing, in particular to a processing method suitable for multi-stage distributed complex transaction processing requirements of a high-availability cluster computer system, in particular to a system and method for processing multi-stage distributed task scheduling. [Background technique] [0002] At present, in the field of securities data processing, we are faced with a type of complex business called multi-stage distributed complex transactions, such as ETF (Exchange Tradable Fund, Exchange Traded Fund) purchase and redemption, simultaneous trading of a basket of stocks and other data processing requirements. This type of business often has the following characteristics: In the time dimension, it can be divided into multiple natural sub-phase transactions that are relatively independent in time sequence. If and only when the current sub-phase transaction is completed, the next sub-phase transac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 龚伟武剑锋王泊楼晓鸿林志高黄寅飞吴征徐乾白硕
Owner SHANGHAI STOCK EXCHANGE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products