Data migration method and system, storage medium and electronic equipment
A technology for migrating systems and data, applied in database design/maintenance, database indexing, and other database retrieval, etc. It can solve problems such as data transmission on different platforms, and achieve the effects of multiple types of platforms, efficient data synchronization, and simplified complexity
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0046] Please refer to figure 1 , figure 1 is a flowchart of the data migration method. like figure 1 As shown, the data migration method of the present invention includes:
[0047] Collection step S1: collecting the link information of the data source table and the link information of the target table;
[0048] Processing step S2: performing data synchronization on the data source table and the target table through spark according to the link information of the data source table and the link information of the target table;
[0049] Checking step S3: checking the synchronized data;
[0050] Dag construction step S4: Construct a dag-based operation interface according to the data source table, the migration device and the target table.
[0051] Please refer to figure 2 , figure 2 is a flowchart of processing step S2. like figure 2 As shown, the processing step S2 includes:
[0052] Adjustment step S21: According to the size of the data to be migrated, adjust and a...
Embodiment 2
[0070] Please refer to Image 6 , Image 6 It is a structural schematic diagram of the data migration system of the present invention. like Image 6 The data migration system of the present invention is shown, which includes:
[0071] A collection module, the collection module collects the link information of the data source table and the link information of the target table;
[0072] A processing module, the processing module carries out data synchronization to the data source table and the target table through spark according to the link information of the data source table and the link information of the target table;
[0073] A checking module, the checking module checks the synchronously completed data.
[0074] Among them, also include:
[0075] A Dag construction module, the Dag construction module constructs a dag-based operation interface according to the data source table, the migration device and the target table.
[0076] Wherein, the processing module includ...
Embodiment 3
[0082] combine Figure 7 As shown, this embodiment discloses a specific implementation manner of an electronic device. The electronic device may include a processor 81 and a memory 82 storing computer program instructions.
[0083] Specifically, the processor 81 may include a central processing unit (CPU), or an Application Specific Integrated Circuit (ASIC for short), or may be configured to implement one or more integrated circuits in the embodiments of the present application.
[0084]Among them, the memory 82 may include mass storage for data or instructions. For example without limitation, the memory 82 may include a hard disk drive (Hard Disk Drive, referred to as HDD), a floppy disk drive, a solid state drive (SolidState Drive, referred to as SSD), flash memory, optical disk, magneto-optical disk, magnetic tape or universal serial bus (Universal Serial Bus, referred to as USB) drive or a combination of two or more of the above. Storage 82 may comprise removable or no...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com