Data migration method, data migration device and readable storage medium

A data and database technology, applied in the field of data processing, can solve problems such as wasting time

Pending Publication Date: 2020-10-27
SHENZHEN ZTE NETVIEW TECH +1
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, due to system upgrades and other reasons, the data in the distributed storage system needs to be migrated to the search server. However, the data is so large that if th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method, data migration device and readable storage medium
  • Data migration method, data migration device and readable storage medium
  • Data migration method, data migration device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0055] The main solution of the embodiment of the present invention is: read the data fragments in the first database, write the read data fragments into the data file; obtain the index information corresponding to the data fragments in the first database, and Write the index information into an index file; execute a data write operation to write the data in the data file into the target database; when the data write operation is interrupted and restarted, according to the index information in the index file , read the unmigrated data in the first database and write it into the target database.

[0056] Because in the prior art, when a large amount of data is being migrated, if the program is interrupted during the migration process, it is difficult to locate the unmigrated data, and it is necessary to re-migrate from...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data migration method, which comprises the following steps: reading a data fragment in a first database, and writing the read data fragment into a data file; obtaining indexinformation corresponding to the data segment in the first database, and writing the index information into an index file; executing a data writing operation to write data in the data file into a target database; and when the data writing operation is interrupted and restarted, reading non-migrated data in the first database according to the index information in the index file and writing the non-migrated data into the target database. The invention further discloses a data migration device and a readable storage medium. The invention aims to realize that data transmission can be continued based on the data transmission progress before interruption after interruption occurs in a large number of data migration processes, reduce the data migration time and improve the overall transmission efficiency of the interrupted data migration process.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a data migration method, a data migration device and a readable storage medium. Background technique [0002] With the continuous development of big data and artificial intelligence, data has become particularly important, and most data applications require data migration. For example, in the face big data system, the data is stored in a distributed storage system (such as Hbase) in units of PB, and the data is synchronized to the search server (such as Elasticsearch) for later query, search and other operations. Among them, due to system upgrades and other reasons, the data in the distributed storage system needs to be migrated to the search server. However, the data is so large that if the program is interrupted during the migration process, it is difficult to locate the unmigrated data, and it is necessary to re-migrate from the beginning , a serious waste of time. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/22
CPCG06F16/214G06F16/22
Inventor 孔海飞陈晓东章云
Owner SHENZHEN ZTE NETVIEW TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap