Tool and method for transferring relational database to HBase

A database and relational technology, applied in the database field, can solve the problems of spending time and energy of developers, achieve the effect of reducing disk storage space, reducing development time, and simplifying the migration process

Inactive Publication Date: 2014-10-29
JILIN JIYUAN SPACE TIME CARTOON GAME SCI & TECH GRP CO LTD
View PDF4 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a tool and method for migrating a relational database to an HBase database, aiming to solve the problem that the existing HBase database data migration method needs to spend a lot of time and energy for developers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Tool and method for transferring relational database to HBase
  • Tool and method for transferring relational database to HBase
  • Tool and method for transferring relational database to HBase

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the object, technical solution and advantages of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0033] The HBase database has the following characteristics: cells are versioned, data rows are ordered, and columns can be added by the client at any time as long as the column family exists. Except for the three features mentioned above, HBase tables are actually similar to RDBMS tables. However, these differences need to be considered when designing a schema for it, and when designing a schema for column-oriented storage such as HBase, you can take advantage of the fact that it can manage wider sparse tables with minimal overhead. difference.

[0034] When querying data in HBase, the following three situations will occur depending on the requested data:

[0035] 1. Full table scan. This kind of query is generally used to obtain all ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a tool and method for transferring a relational database to the HBase. The tool comprises a parser, a table mode transformer, a table mode adapter and a data table manager. The parser is used for parsing a table mode definition document exported out of the traditional relational database through an external tool. The table mode transformer is used for transforming a table mode definition in the traditional relational database into the table mode in the HBase and supports four table transform modes. The table mode adapter is used for saving the table mode definition transformed by the table mode transformer to an assigned file, reading the table mode definition transformed by the table mode transformer and providing interfaces for other modules to search for new table mode definitions. The data table manager is used for transferring data saved in the traditional relational database to a table corresponding to a new definition in the HBase. Through the tool and method for transferring the relational database to the HBase, the performance for connecting and querying tables in the transferred database can be effectively improved.

Description

technical field [0001] The invention relates to the field of databases, in particular to a tool and method for migrating a relational database to an HBase database. Background technique [0002] With the improvement of network bandwidth in the 20th century and the further popularization of the Internet around the world, the continuous emergence of SNS social application platforms represented by Facebook and Twitter and e-commerce Internet applications represented by Taobao and Amazon have marked the We have entered the era of Web2.0. From a developer's point of view, complex Web2.0 applications mean higher requirements for the rationality, robustness, and performance of the application itself. How to enable the database to Providing stable and reliable performance is one of the important issues to be solved by current Web2.0 applications. In countless developments and researches, it has been found that even traditional relational databases with mature technology are diffic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/258G06F16/214
Inventor 郑立国贾金原赵龙
Owner JILIN JIYUAN SPACE TIME CARTOON GAME SCI & TECH GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products