Data migration method and storage medium

A storage medium and data technology, applied in the field of data processing, can solve problems such as inability to achieve efficient data migration, data unsupported, etc., and achieve the effect of reducing data migration time and efficient data migration

Inactive Publication Date: 2018-07-06
TAIJI COMP
View PDF11 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a data migration method and a storage medium to solve the following problems in the prior art: the existing data migration tool supports relational data well, but does not support the original BLOB type data and cannot achieve high efficiency data migration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method and storage medium
  • Data migration method and storage medium
  • Data migration method and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to solve the following problems in the prior art: the existing data migration tool supports relational data well, but does not support the original BLOB type data, and cannot achieve efficient data migration; the present invention provides a data migration method and storage media, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0020] The first embodiment of the present invention provides a data migration method, the flow of the method is as follows figure 1 As shown, including steps S101 to S103:

[0021] S101, divide the Hbase database into multiple predetermined areas;

[0022] S102, converting the relational data in the predetermined relational database into data in TLV format, and storing it in a preset TLV format file;

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data migration method and a storage medium. The method comprises the steps that an Hbase database is divided into multiple predetermined regions; relational data in a predetermined relational database is converted into TLV-format data, and the TLV-format data is stored into a preset TLV-format file; and the data in the preset TLV-format file is concurrently migrated to the predetermined regions through predetermined migration instances. According to the method, the relational data in the predetermined relational database is converted into the TLV-format data, and therefore original BLOB-type data also can be migrated; and in the migration process, the Hbase database is partitioned, therefore, the data can be migrated concurrently, data migration time is greatly shortened, and the problem that in the prior art, existing data migration tools can well support the relational data but do not support the original BLOB-type data, and consequently efficient data migration cannot be realized is solved.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data migration method and a storage medium. Background technique [0002] At present, data storage and data analysis based on Hadoop (a distributed system infrastructure) big data ecological environment has become the mainstream direction of massive data storage and data analysis. The storage of massive data is a basic advantage of the Hadoop cluster environment over relational database storage, but how to migrate the original massive data from the relational database to the Hadoop cluster environment is still an urgent problem to be solved. In response to such problems, various application vendors and open source communities have proposed corresponding solutions, such as the popular and general sqoop tool (an open source tool, mainly used for data transfer between Hadoop and traditional databases), etc. , but these methods or tools, after preliminary tests, found that the exist...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/214G06F16/278
Inventor 毕永新赵春国田志兵
Owner TAIJI COMP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap