Data migration method and system and storage medium

A data and data source technology, applied in the fields of systems, storage media, and data migration methods, can solve the problems of increasing the complexity of data integration, failing to improve the efficiency of data migration and integration, simplifying the process of data migration and integration, and achieving configurable effect of improving efficiency

Active Publication Date: 2021-08-10
广东好太太智能家居有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to present valuable data analysis results on the mobile terminals of managers at all levels in the organization, it is necessary to extract data from various sources and load the data into the data lake before analyzing the data in the data lake according to the analysis requirements However, due to the different sources of data, it is possible to import data in different formats during the data extraction process, so that in the process of data migration and integration, it is necessary to perform unified format conversion on the mixed data in different formats before the data can be analyzed according to The requirements are stored in the data warehouse or data mart, which greatly increases the complexity of data integration and cannot improve the efficiency of data migration and integration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method and system and storage medium
  • Data migration method and system and storage medium
  • Data migration method and system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] This embodiment provides a data migration method, using a migration tool to migrate data in various data forms to the target data platform, simplifying the data migration and integration process, and improving efficiency; and the migration process can be customized and configured through the migration tool to achieve Configurable to improve practicability.

[0038] Such as figure 1 As shown, the data migration method of this embodiment is applied to a server connected to multiple data sources and destination data platforms, and specifically includes the following steps:

[0039] Step S1: Connect the server to multiple data sources and destination data platforms in advance, and establish corresponding data transmission channels between multiple data sources and destination data platforms through the server; wherein, multiple data sources Contains data in multiple data formats;

[0040] Step S2: the server calls a migration tool to create a migration task in response to...

Embodiment 2

[0050] This embodiment provides a data migration system, a data migration system that executes the data migration method described in Embodiment 1, such as figure 2 As shown, it specifically includes the following modules:

[0051] The communication module is used to establish a data transmission channel between the system and multiple data sources and destination data platforms, so that data transmission can be performed between multiple data sources and destination data platforms to complete the data migration step; wherein, multiple said data Sources contain data in multiple data forms;

[0052] The creation module is used to call the migration tool according to the migration instruction to create the migration task; in this embodiment, the data flow can be customized when creating the migration task, and the migration tool can also be called to configure the migration execution cycle;

[0053] The migration module is configured to integrate data in different data forms i...

Embodiment 3

[0055] This embodiment provides a computer storage medium on which a computer program is stored. If the method of the present invention is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in the computer storage medium. Based on such an understanding, the present invention realizes all or part of the processes in the methods of the above embodiments, and can also be completed by instructing related hardware through a computer program. The computer program can be stored in a computer storage medium, and the computer program is in When executed by the processor, the steps in the above-mentioned various method embodiments can be realized. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. The computer storage medium may include: any entity or device capable of carrying the computer progr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data migration method and system and a storage medium; the data migration method is applied to a server connected with multiple data sources and a target data platform, and the data migration method comprises the steps that the server calls a migration tool to create a migration task in response to a migration instruction; the server activates a data transmission channel between a corresponding data source and a target data platform based on the migration task, integrates data in different data forms in multiple data sources and migrates the data into the target data platform through the data transmission channel for storage. According to the method, the data in various data forms are migrated into the target data platform by utilizing the migration tool, other codes do not need to be written to realize data import and migration steps of the cross platform, the data migration and integration process is simplified, and the efficiency is improved; in addition, the migration process can be customized and configured through the migration tool, so that the configurability is realized, and the practicability is improved.

Description

technical field [0001] The invention relates to the field of data storage and analysis, in particular to a data migration method, system and storage medium. Background technique [0002] Data migration and integration is the extensive use of internal data (for example: ERP, CRM, POS, equipment data, logs) and external data (industry data, macroeconomic data, social media, comments) to conduct various analyzes on existing businesses and Predicting the future and ultimately driving business with data is a necessary means for any organization to survive. In order to present valuable data analysis results on the mobile terminals of managers at all levels in the organization, it is necessary to extract data from various sources and load the data into the data lake before analyzing the data in the data lake according to the analysis requirements However, due to the different sources of data, it is possible to import data in different formats during the data extraction process, so...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/21G06F16/27G06F16/25H04L12/26H04L29/06
CPCG06F16/214G06F16/27G06F16/258H04L43/0811H04L63/0263H04L43/0894H04L43/10
Inventor 王妙玉周亮周小桥吴宁泉
Owner 广东好太太智能家居有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap