Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data synchronization method and device from relational database to Hadoop database

A data synchronization and database technology, applied in the field of big data processing, can solve problems such as lack of versatility and heavy workload, and achieve the effect of improving data synchronization efficiency and reducing workload

Pending Publication Date: 2019-09-06
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This data synchronization method has a large workload and is not universal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device from relational database to Hadoop database
  • Data synchronization method and device from relational database to Hadoop database
  • Data synchronization method and device from relational database to Hadoop database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0027] It can be understood that the terms "first", "second" and the like used in this application may be used to describe various elements herein, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element.

[0028] figure 1 It is a schematic structural diagram of a computer device in an embodiment of the present application. Such as figure 1 As shown, the computer device includes a processor connected through a system bus, a non-volatile storage medium, a memory, and a network interface. Wherein, the non-volatile storage medium...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data synchronization method and device from a relational database to a Hadoop database, computer equipment and a storage medium. The method comprises the steps of recognizing invariant parameters in each table of a relational database of a service party according to the invariant parameters pre-stored for the service party to be synchronized and configuration data of theinvariant parameters, and configuring the recognized invariant parameters; for the variable parameters in each table of the relational database, providing a corresponding configuration data modification interface for a user to configure the variable parameters; determining configuration data of the variable parameters according to configuration operation on the variable parameters in the configuration data modification interface; determining a data synchronization level from the relational database of the service party to the Hadoop database; and determining a corresponding synchronization scheme, and executing data synchronization from the relational database to the Hadoop database according to the synchronization scheme. The workload can be reduced, and the synchronization efficiency isimproved.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a data synchronization method, device, computer equipment and storage medium from a relational database to a Hadoop database. Background technique [0002] In the synchronization process from a relational database to a Hadoop database (that is, HadoopDatabase, referred to as Hbase), no matter which tool is used, it is generally designed for the synchronization of a single table mixed with business logic. Synchronization design with mixed business logic for a single table refers to designing a synchronization scheme for each table. Because different data tables have different stored content and designed fields and other information, for example, the order table has fields such as order ID, order name, order amount, and delivery time, and the user table has user name and user ID. , user phone number and other field information. For example, if there are 100 tables in ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/27G06F16/28
CPCG06F16/27G06F16/284
Inventor 刘浩
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com