Data migration method based on message-oriented middleware and related equipment

A message middleware and middleware technology, applied in the field of data processing, can solve the problems of rising time consumption cost, inability to achieve high-speed data landing, and inability to ensure data timeliness, etc., to achieve the effect of ensuring delay.

Active Publication Date: 2019-10-15
PING AN TECH (SHENZHEN) CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1) The cost of time consumption caused by the delay problem increases, and the timeliness of the data cannot be guaranteed. When the data in the source database changes during migration, the change may not correspond to the target database;
[0006] 2) It is impossible to achieve high-speed landing of data, that is, the speed of data migration is relatively slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method based on message-oriented middleware and related equipment
  • Data migration method based on message-oriented middleware and related equipment
  • Data migration method based on message-oriented middleware and related equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] Embodiments of the present invention provide a message middleware-based data migration method and related equipment, which are used to transfer data from a source database to a target database at high speed and in real time.

[0052] In order to enable those skilled in the art to better understand the solutions of the present invention, the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

[0053] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the term ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data processing, in particular to a data migration method based on message-oriented middleware and related equipment, and the method comprises the steps: extracting to-be-migrated data from a source database, and writing the to-be-migrated data into first-stage message-oriented middleware of a message-oriented middleware cluster; carrying out streaming computation processing on the to-be-migrated data and then transmitting the to-be-migrated data to the secondary message middleware; judging whether a data asynchronous landing requirement exists or not according to the next-level connection of the secondary message middleware; when the secondary message middleware exists, transmitting the data to be migrated to an intermediate database connected with the secondary message middleware, and the data falling into a target database in an ETL mode; and when the to-be-migrated data does not exist, performing streaming computation processing on the to-be-migrated data, transmitting the to-be-migrated data to subsequent cascaded message middleware, and the to-be-migrated data falling into a target database. According to the method, the middleware is constructed to serve as an intermediate bridge of data migration, so that the data falls from the source database to the target database, and the method has the advantages of high real-time performance, low time delay and high transmission rate.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a message middleware-based data migration method and related equipment. Background technique [0002] Data migration is a typical method of data storage technology, which is used to transfer data stored on one storage system to another storage system. For example, based on the replacement requirements of the hardware of the data storage device, data is migrated from the source database where the old device is located to the target database where the new device is located. In general use, it is also commonly used to transfer data that is less frequently used or even not used from the source database to the target database, for example, using a high-speed, high-capacity off-line storage device as the next-level device of the disk device, Then, the commonly used data in the disk is automatically migrated to secondary mass storage devices such as tape libraries (referred to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21
CPCG06F16/214Y02D10/00
Inventor 丁明
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap