Supercharge Your Innovation With Domain-Expert AI Agents!

High-speed data migration method and system

A high-speed data and database technology, applied in the database field, can solve the problems of slow data migration, low data migration efficiency, and inability to realize source data migration, and achieve the effect of rapid migration, accurate and rapid migration

Pending Publication Date: 2022-01-28
广东南方通信建设有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, repeated full-volume transmission and data transcoding will undoubtedly lead to slow data migration and low data migration efficiency, and it is impossible to accurately and quickly migrate source data to heterogeneous target databases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-speed data migration method and system
  • High-speed data migration method and system
  • High-speed data migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] Please refer to figure 1 as shown, figure 1 A high-speed data migration method of the present invention is shown, including:

[0035] Step S1: full data migration: determine the target data transmission path according to the set algorithm, and call the DTS tool to migrate the full amount of data from the source database to the target database through the target data transmission path;

[0036] Among them, the full amount of data refers to all the data in the source database; the incremental data refers to the newly added data after the data was exported last time.

[0037] It should be noted that DTS, the full name of Data Transformation Service, is a set of data transformation service tools for importing, exporting, and transforming various data between one or more data sources. Data can be extracted, transformed, and merged from different sources to one or more target locations.

[0038] Specifically, the determination of the target data transmission path according...

Embodiment 2

[0063] Please refer to figure 2 as shown, figure 2 A high-speed data migration system of the present invention is shown, including:

[0064] Full data migration unit 10: used to determine the target data transmission path according to the set algorithm, and call the DTS tool to migrate the full amount of data in the source database to the target database through the target data transmission path;

[0065] Incremental data migration unit 20: used to synchronize the incremental data of the source database on the middleware; and configure a heterogeneous data conversion strategy for converting the source database data structure into the target database data structure on the middleware, according to the The heterogeneous data conversion strategy dynamically generates a configuration file that can be recognized by the DTS tool; according to the configuration file, the DTS tool is called to migrate the incremental quantity synchronized by the middleware to the target database syn...

Embodiment 3

[0067] image 3 A schematic structural diagram of an electronic device provided in the embodiment of this application, which can be passed in this application image 3 The schematic diagram shown is used to describe the electronic device 100 for implementing the high-speed data migration method of the present invention according to the embodiment of the present application.

[0068] Such as image 3 Shown is a schematic structural diagram of an electronic device, the electronic device 100 includes one or more processors 102, one or more storage systems 104, these components are interconnected through a bus system and / or other forms of connection mechanisms (not shown) even. It should be noted that image 3 The components and structure of the electronic device 100 shown are only exemplary, not limiting, and the electronic device may have image 3 Some components shown may also have image 3 Other components and structures not shown.

[0069] The processor 102 may be a cen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a high-speed data migration method and system, and the method comprises the steps: full data migration: determining a target data transmission path according to a set algorithm, and calling a DTS tool to migrate full data of a source database to a target database through the target data transmission path; incremental data migration: synchronizing the incremental data of the source database on the middleware; dynamically generating a configuration file which can be identified by a DTS tool according to the heterogeneous data conversion strategy; and calling a DTS tool according to the configuration file to synchronously migrate the increment quantity synchronized by the middleware to a target database. The online data of the source database can be accurately and quickly migrated to the heterogeneous target database.

Description

technical field [0001] The invention relates to the field of databases, in particular to a high-speed data migration method and system. Background technique [0002] With the development of the entire industry chain from basic software and hardware at the bottom of the IT layer to application software at the upper layer, and the requirement for independent and controllable domestic ecological information systems, business data has shifted from non-localized environments to localized heterogeneous CPUs, operating systems, databases, The main migration scenarios for cloud architecture environment migration include: migration from a local non-localized environment to a localized environment, migration from a non-localized cloud to a localized cloud, and migration from a local non-localized environment to a localized cloud. [0003] Among them, since the data structures of domestic databases and non-domestic databases are usually different, if the technical details of the hetero...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/27
CPCG06F16/214G06F16/27
Inventor 肖磉张国胜吴志勇潘一峰冯杰文郑铭康王珏文
Owner 广东南方通信建设有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More