Structure synchronization method and device from relational database to Hadoop database

A database and relational technology, applied in the field of big data processing, can solve the problems of non-standard HBase structure, too many fields, and difficulty in maintaining database structure mapping relationship, so as to facilitate operation and maintenance management, reduce workload, and realize automatic synchronization of tables. effect of structure

Pending Publication Date: 2019-09-17
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the process of researching related technologies, the inventor found that: the traditional method is manual synchronization, that is, first exporting the structure of the relational database, and then manually converting it into Hbase table creation stateme

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Structure synchronization method and device from relational database to Hadoop database
  • Structure synchronization method and device from relational database to Hadoop database
  • Structure synchronization method and device from relational database to Hadoop database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0035] It can be understood that the terms "first", "second" and the like used in this application may be used to describe various elements herein, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element.

[0036] figure 1 It is a schematic structural diagram of a computer device in an embodiment of the present application. Such as figure 1 As shown, the computer device includes a processor connected through a system bus, a non-volatile storage medium, a memory, and a network interface. Wherein, the non-volatile storage medium...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a structure synchronization method and device from a relational database to a Hadoop database, computer equipment and a storage medium. The method comprises the steps of determining the type of the relational database of a service party to be synchronized; determining data source information; connecting a relational database of a service party to be synchronized, and extracting metadata information from the connected relational database; converting the metadata information into a preset standard table structure of a Hadoop database in a data management and control platform, and storing a field mapping relation between a relational database of a business party to be synchronized and the Hadoop database into a preset mapping table; periodically monitoring whether the table structure of the relational database of the service party to be synchronized changes or not, and if the table structure changes, updating the preset standard table structure converted from the metadata information and the preset mapping table. The table knots of the relational database can be synchronized to the preset standard table structure of the Hadoop database, namely, the table knots are synchronized to the unified standard table structure, and operation and maintenance management is facilitated.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a structure synchronization method, device, computer equipment and storage medium from a relational database to a Hadoop database. Background technique [0002] In the process of synchronizing a relational database to a Hadoop database (that is, HadoopDatabase, referred to as Hbase), structure synchronization is the first step. The so-called structure synchronization refers to synchronizing the metadata of the business party to the data management and control platform. [0003] In the process of researching related technologies, the inventor found that: the traditional method is manual synchronization, that is, first exporting the structure of the relational database, and then manually converting it into Hbase table creation statement execution. This manual synchronization solution often has many disadvantages, such as , the converted Hbase structure is not standard (...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/23G06F16/27
Inventor 刘浩
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap