Data extraction method from mongoDB to mysql based on json

A data extraction and database technology, which is applied in electronic digital data processing, structured data retrieval, database management systems, etc., can solve problems such as poor user experience, high professional knowledge requirements, and no visual operation interface, and achieve easy operation, The effect of improving efficiency

Inactive Publication Date: 2020-02-14
UNICLOUD (NANJING) DIGITAL TECH CO LTD
View PDF1 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this processing method has the following disadvantages: a. Reading data from mongoDB requires command line operations, which requires high professional knowledge of operators; b. Writing data to mysql requires writing sql scripts or shell scripts, which require operators to master the necessary professional skills; c, no visual operation interface, poor user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data extraction method from mongoDB to mysql based on json
  • Data extraction method from mongoDB to mysql based on json
  • Data extraction method from mongoDB to mysql based on json

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment 1

[0058] Such as image 3 First, on the home page of Data Integration, click Add Data Integration; Figure 4 , enter the new data integration configuration page; for example Figure 5 Fill in the integration name, integration type, and integration description on the new data integration configuration page; Figure 6 , enter the process configuration page and select the corresponding process configuration; Figure 7 , enter the process configuration page to configure the data source, database, data table and extracted fields; for example Figure 8 , configure cleaning rules and cleaning fields on the cleaning configuration page; for example Figure 9 , configure conversion rules and conversion fields on the conversion configuration page; for example Figure 10 , configure the data source, database, data table, warehousing method, and database field on the output configuration page; after the configuration is completed, the data in the mongoDB database is extracted to the mysq...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data extraction method from mongoDB to mysql based on json, and relates to the technical field of data extraction. The method comprises: loading and storing configuration information of a mongoDB database through a UGetMOongoPlus processor, and reading data from the mongoDB database by executing an sql query statement; outputting the data in the json format into a queue;loading and storing the json conversion configuration information through a MongoMappingProcesor processor, and storing the json conversion configuration information through the MongoMappingProcesor processor; mapping the data in the json format to a mysql data table field; and loading the mysql connection configuration information, the data information and the data table information of the relational database through a ULoadProcesor processor, and storing the json format data into the mysql database. According to the method, the transfer information of the page configuration data from mongoDBto mysql is visualized, and the method is simple, visual, convenient and rapid. The data flows from the source mongoDB to the target mysql database in a json format. Operators do not need to write command lines, sql scripts or shell scripts, and the efficiency is improved.

Description

technical field [0001] The invention belongs to the technical field of data extraction, in particular to a data extraction method from mongoDB to mysql based on json. Background technique [0002] With the continuous increase of mongoDB non-relational database in software applications, the use advantages brought by document storage have been recognized by more and more programmers and companies, and mongoDB has been widely used; and there are many scenarios using relational databases to show The advantages of business data cannot be replaced by mongoDB. Therefore, there is a transfer of data from the mongoDB database to the relational database mysql; in addition, many original business systems are built on the mysql database, and there is also a need to transfer from the mongoDB database to the mysql database. [0003] As shown in Figure 11, the common technical solution for transferring data from the mongoDB database to the mysql database is to first export the data in the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/2455G06F16/25
CPCG06F16/214G06F16/2455G06F16/258
Inventor 汤同伟何静霍荣
Owner UNICLOUD (NANJING) DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap