System and method for guaranteeing distributed data processing consistency

A distributed data and consistent technology, applied in the direction of digital transmission system, transmission system, data exchange network, etc., can solve problems such as inconsistent expected results, abnormal data processing, etc., and achieve the effect of reducing delay and ensuring reliability

Active Publication Date: 2014-03-19
SHANGHAI STOCK EXCHANGE
View PDF5 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to solve the consistency problem existing in the distributed data processing in the existing transaction system and the technical problem that when the log mechanism is used, the abnormal data processing leads to th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for guaranteeing distributed data processing consistency
  • System and method for guaranteeing distributed data processing consistency
  • System and method for guaranteeing distributed data processing consistency

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0056] Example 1

[0057] Such as figure 1 As shown, figure 1 It is the basic data maintenance framework diagram in the distributed trading system of the present invention. The computer distributed trading system platform consists of several trading platforms responsible for transaction processing. The trading host will use one host as the master node, and other nodes will become transactions. Standby machine, the master node is responsible for all order processing tasks, and is responsible for logging and maintenance, triggering the basic data synchronization of the slave node. The slave node does not perform real-time order processing, but can maintain the basic data memory consistent with the master node through synchronization. There is a synchronization router inside. The synchronization router obtains order information and basic data update messages from order generation software, front-end data management software or other platforms. The synchronization router is connected ...

Example Embodiment

[0058] Example 2

[0059] The basic data memory organization structure diagram is as figure 2 As shown, each record in the figure consists of multiple versions. In addition to the KEY (password) value used for indexing in the record header structure, a TAG (tag) field is also added to record the current version number, where TAG ( The tag) field is of INT64 type, and the reading and writing of the TAG (tag) field are all atomic operations, and no conflict occurs. The basic data memory supports one write and multiple reads, and supports the cancel instruction of the write operation. While the HFM (Basic Data Management Module) updates the basic data record, the read operation of the application is not affected.

Example Embodiment

[0060] Example 3

[0061] A method to ensure the consistency of distributed data processing. The request messages involved in the data processing process mainly include order requests and basic data update requests. The order message comes from the order generation software, and the basic data update message comes from the foreground data management software or other platforms. The specific method is as follows:

[0062] a. After the request message arrives at the host, it will be sent to the shared message queue by the synchronization router according to the message category, and handed over to the corresponding process for processing;

[0063] b. In the order processing process, the application process first connects to the basic data memory, and then verifies the order based on the information recorded therein. After the verification is successful, it writes to the order book memory, and updates the status information in the application log file record. The application process on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the distributed data processing technology field and particularly relates to a system and a method for guaranteeing distributed data processing consistency. The system comprises a computer transaction system platform. The computer transaction system platform comprises multiple transaction platforms for transaction business processing, a host in a transaction host is taken as a main node, other nodes are taken as standby transaction machines, the main node is for processing tasks of all orders and further for log record, maintenance and triggering basic data synchronization of secondary nodes, the secondary nodes do not carry out real-time order processing but realizes consistency with the main node through synchronization maintenance of basic data memory. Compared with the prior art, the system is advantaged in that a log structure with a message execution state is employed; a problem of time delay conflict of real-time reading and updating of the basic data of the transaction system can be solved; complexity of replay of the transaction system is reduced; consistency during data processing between platforms and switching between main and standby machines, system performance and reliability are improved.

Description

[technical field] [0001] The invention relates to the technical field of distributed data processing, in particular to a system and method for ensuring the consistency of distributed data processing. [Background technique] [0002] For transaction systems that require high reliability and real-time performance, the design and implementation of good data processing methods are of great significance. Among them, the data consistency strategy in distributed systems has always been the most complicated issue in data system design, such as highly parallel Problems caused by multi-task parallelism in the machine, difficulties caused by multi-machine parallelism, unpredictable network delay, multiple copies in the system, data modification is usually performed on different copies, etc. A design can often only solve several of the above problems and cannot cover them all. [0003] In the current distributed system, the methods used to ensure data consistency are based on the lock m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
Inventor 胡丽聪武剑锋王泊黄俊杰林征刘乐黄寅飞白硕
Owner SHANGHAI STOCK EXCHANGE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap