Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data migration method and system, storage medium and electronic equipment

A technology for migrating systems and data, applied in database design/maintenance, database indexing, and other database retrieval, etc. It can solve problems such as data transmission on different platforms, and achieve the effects of multiple types of platforms, efficient data synchronization, and simplified complexity

Pending Publication Date: 2021-11-19
BEIJING XUEZHITU NETWORK TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present application provides a data migration method, system, storage medium and electronic equipment, to at least solve the problem that the existing data migration method cannot solve the problem of direct data transmission between different platforms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method and system, storage medium and electronic equipment
  • Data migration method and system, storage medium and electronic equipment
  • Data migration method and system, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] Please refer to figure 1 , figure 1 is a flowchart of the data migration method. like figure 1 As shown, the data migration method of the present invention includes:

[0047] Collection step S1: collecting the link information of the data source table and the link information of the target table;

[0048] Processing step S2: performing data synchronization on the data source table and the target table through spark according to the link information of the data source table and the link information of the target table;

[0049] Checking step S3: checking the synchronized data;

[0050] Dag construction step S4: Construct a dag-based operation interface according to the data source table, the migration device and the target table.

[0051] Please refer to figure 2 , figure 2 is a flowchart of processing step S2. like figure 2 As shown, the processing step S2 includes:

[0052] Adjustment step S21: According to the size of the data to be migrated, adjust and a...

Embodiment 2

[0070] Please refer to Image 6 , Image 6 It is a structural schematic diagram of the data migration system of the present invention. like Image 6 The data migration system of the present invention is shown, which includes:

[0071] A collection module, the collection module collects the link information of the data source table and the link information of the target table;

[0072] A processing module, the processing module carries out data synchronization to the data source table and the target table through spark according to the link information of the data source table and the link information of the target table;

[0073] A checking module, the checking module checks the synchronously completed data.

[0074] Among them, also include:

[0075] A Dag construction module, the Dag construction module constructs a dag-based operation interface according to the data source table, the migration device and the target table.

[0076] Wherein, the processing module includ...

Embodiment 3

[0082] combine Figure 7 As shown, this embodiment discloses a specific implementation manner of an electronic device. The electronic device may include a processor 81 and a memory 82 storing computer program instructions.

[0083] Specifically, the processor 81 may include a central processing unit (CPU), or an Application Specific Integrated Circuit (ASIC for short), or may be configured to implement one or more integrated circuits in the embodiments of the present application.

[0084]Among them, the memory 82 may include mass storage for data or instructions. For example without limitation, the memory 82 may include a hard disk drive (Hard Disk Drive, referred to as HDD), a floppy disk drive, a solid state drive (SolidState Drive, referred to as SSD), flash memory, optical disk, magneto-optical disk, magnetic tape or universal serial bus (Universal Serial Bus, referred to as USB) drive or a combination of two or more of the above. Storage 82 may comprise removable or no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data migration method and system, a storage medium and electronic equipment. The data migration method comprises the following steps: an acquisition step: acquiring link information of a data source table and link information of a target table; a processing step: performing data synchronization on the data source table and the target table through spark according to the link information of the data source table and the link information of the target table; a checking step: checking the synchronized data; and a dag construction step: constructing a dag-based operation interface according to the data source table, the migration device and the target table. According to the data method, the complexity of data cross-platform synchronization can be simplified, data migration can be achieved in an interface and dragging mode, data synchronization of different platforms is efficiently achieved by constructing the DAG, the supported platforms are multiple in type, and the migration speed is high.

Description

technical field [0001] The invention belongs to the field of data migration, and in particular relates to a data migration method, system, storage medium and electronic equipment. Background technique [0002] In the era of big data, data is becoming more and more important and indispensable. There are various platforms for storing data, and the problem of how to synchronize data between different platforms arises as the times require. This patent provides a data migration device based on DAG (Directed Acyclic Graph). This patent uses a flexible drag-and-drop method for cross-platform data migration. It can also provide very friendly functions for people without programming foundation , data migration can be realized through the interface. Greatly reduces the difficulty of cross-platform data synchronization. Contents of the invention [0003] Embodiments of the present application provide a data migration method, system, storage medium, and electronic device, so as to a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/21G06F16/22G06F16/27G06F16/901
CPCG06F16/214G06F16/27G06F16/2282G06F16/9024
Inventor 汪月
Owner BEIJING XUEZHITU NETWORK TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products