Method and device for migrating relational data to HBase database

A database and relational technology, applied in database design/maintenance, structured data retrieval, etc., can solve problems such as immature data migration methods, and achieve the effect of ensuring completeness and effectiveness, improving accuracy, and improving data migration efficiency

Inactive Publication Date: 2019-07-16
AEROSPACE INFORMATION
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a method and device for migrating relational data to an HBase database, which is used to solve the technical problem that the current data migration method for migrating data from a relational database to an HBase database is not mature enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for migrating relational data to HBase database
  • Method and device for migrating relational data to HBase database
  • Method and device for migrating relational data to HBase database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. In the case of no conflict, the embodiments and the features in the embodiments of the present invention can be combined arbitrarily with each other. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0048]In add...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for migrating relational data to an HBase database, which are used for solving the technical problem that the data migration mode of migrating data from arelational database to an HBase database is not mature enough so as to improve the data migration efficiency, and can ensure integrity and effectiveness of data migration through a fault-tolerant verification mode so as to improve the accuracy of data migration. The method comprises: obtaining a data table needing to be migrated from a relational database; creating a column family name and a column name for a target HBase database according to the data table needing to be migrated; converting the field type into a character type to carry out data conversion on the data in the data table needing to be migrated to obtain converted data, and recording the converted data volume; importing the converted data into the target HBase database and generating an import record report; and judging theintegrity of data migration according to the converted data volume and the import record report so as to obtain a verification result about whether the data is completely migrated or not.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a method and device for migrating relational data to an HBase database. Background technique [0002] HBase is a sub-project of the Hadoop project. It is an implementation of a NOSQL database on Hadoop. It is also a distributed, column-oriented open source database. It can be said that HBase not only has the advantages of most NOSQL databases, but also has It is seamlessly integrated with Hadoop, so it provides more powerful scalability and data operation performance. And as cloud computing technology continues to become an important pillar supporting the development of information technology in various industries, due to the huge advantages of HBase database, more and more scenarios need to use Philippine relational database such as HBase database for data storage and management. [0003] Taking invoice data as an example, according to effective statistics, up to now, ther...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21
CPCG06F16/214
Inventor 周舟
Owner AEROSPACE INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products