A distributed system data synchronization method and system based on a message engine

A distributed system and data synchronization technology, applied in the transmission system, electrical components, etc., can solve the problems of unrecognized direct connection mode of data security, inability to update data in time, concurrency pressure of service providers and large data transmission, etc. Achieve the effect of improving data synchronization speed, reducing system pressure, and reducing occupation ratio

Active Publication Date: 2022-05-20
SHANDONG LUNENG SOFTWARE TECH
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to ensure reliable data application results, it is required to use complete, consistent, accurate, and real-time data. In traditional data integration, it is generally simple to perform regular extraction through ETL tools, which causes data to be unable to be updated in time. At the same time, due to data security considerations, the direct connection mode is becoming less and less recognized;
[0004] However, common business system data integration generally only pushes individual data. This integration mode has the following technical problems: each business subsystem can only passively accept data update pushes from service providers, and cannot actively update data; each business subsystem is updated at the same time , the concurrency pressure and data transmission of the service provider are relatively large; when any business subsystem is unexpectedly down, the latest data cannot be updated and synchronized in time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed system data synchronization method and system based on a message engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] The present disclosure provides a message engine-based distributed system data synchronization method, including:

[0039] Step 1: Obtain the configuration file of the business system, the configuration file includes the business type, the latest business data and the latest time stamp, and store it on the integration platform;

[0040] Step 2: Create a new data query database, obtain business update data, and classify and store them in the data query database according to the business type to which the business update data belongs;

[0041] Step 3: According to the business type to which the business update data belongs, send a heartbeat request to the corresponding business system, and receive heartbeat feedback information from the business system;

[0042] Step 4: Extract the business update data to be pushed, and publish the business update data to be pushed to the business system through the message engine.

[0043] In the step 1, the integration platform needs t...

Embodiment 2

[0061] The present disclosure provides a message engine-based distributed system data synchronization system, including:

[0062] Business system configuration module, which is used to obtain the configuration file of the business system, the configuration file includes business type, latest business data and latest time stamp, and is stored to the integration platform;

[0063] A storage module, which is used to create a new data query database, obtain business update data, and classify and store it in the data query database according to the business type to which the business update data belongs;

[0064] A judging module, which is used to send a heartbeat request to the corresponding business system and receive heartbeat feedback information from the business system according to the business type to which the business update data belongs;

[0065] The push module is used to extract the service update data to be pushed, and publish the service update data to be pushed to th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The disclosure discloses a method and system for synchronizing distributed system data based on a message engine, which acquires configuration files of a business system and stores them on an integration platform; builds a new data query database, acquires business update data, and according to the business type to which the business update data belongs, Classified and stored in the data query database; according to the business type of the business update data, send a heartbeat request to the corresponding business system, and receive the heartbeat feedback information of the business system; extract the business update data to be pushed, and send the to-be-pushed data through the message engine The business update data is published to the business system. The business system maximizes the integrity of the basic data of each business subsystem by actively sending update requests; the integration platform uses the message engine service subscription model to ensure that each business system can be restarted even when it is down. Update the latest business data at a time.

Description

technical field [0001] The present disclosure relates to the technical field of computer software system data integration, in particular to a message engine-based distributed system data synchronization method and system. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] With the continuous improvement of informatization, group-based business applications have generated a large amount of basic business data, and enterprises have higher and higher requirements for data synchronization of refined business classification. In order to ensure reliable data application results, it is required to use complete, consistent, accurate, and real-time data. In traditional data integration, it is generally simple to perform regular extraction through ETL tools, which causes data to be unable to be updated in time. At the same time, due to data security ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/1095H04L67/30H04L67/55
CPCH04L67/1095H04L67/30H04L67/55
Inventor 张天雷任成宾郭英端赵金栋自明曹福森于庆海王圣皎赵德峰刘汝玉邓志龙纪晓龙
Owner SHANDONG LUNENG SOFTWARE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products