Data Transfer Support Layer for Low-Downtime Cloud Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transfer methods from on-premises databases to cloud services face challenges such as format changes, the need to stop services during transfer, and the inability to identify table relationships, leading to prolonged downtime and inefficient data transfer.
Innovation Solution
A data transfer support system that includes a storage unit, acquisition unit, transfer unit, and re-registration unit to manage data transfer from a source to a destination system, allowing for sequential storage, conditional transfer, and re-registration of unsuitable data, thereby optimizing the transfer process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all tables are transferred to ensure data completeness, then data loss is prevented, but transfer time increases significantly
Solution Approach 1:
The patent segments the data transfer process into multiple phases: first transferring parent table data, then child table data, and finally performing consistency checks. This segmentation allows the system to transfer only necessary tables in a specific order rather than all tables simultaneously, reducing overall transfer time while ensuring data completeness through structured phase management.
Solution Approach 2:
The patent performs preliminary actions by first identifying table relationships and transfer dependencies before the actual data transfer. The system pre-processes the database schema to determine which tables are parents and which are children, establishing the transfer sequence in advance. This preliminary analysis enables optimized transfer paths that prevent data loss while minimizing transfer time.
2Reliability
If the on-premises service is stopped during data transfer, then data consistency is ensured, but service downtime increases
Solution Approach 1:
The patent enables continuous useful action by allowing the on-premises service to remain operational during the data transfer process. The system implements real-time data capture and transfer mechanisms that maintain service continuity while ensuring data consistency through transactional integrity and consistency check phases that verify transferred data without requiring service interruption.
Solution Approach 2:
The patent introduces an intermediary data transfer layer that acts as a mediator between the running on-premises service and the cloud service. This intermediary captures data in real-time, performs necessary transformations, and transfers it to the cloud while the original service continues to operate. The intermediary ensures data consistency through structured transfer protocols and verification mechanisms without requiring the source service to stop.
3Device complexity
If table relationships are not identified, then transfer complexity is reduced, but transfer efficiency decreases due to unnecessary data transfer
Solution Approach 1:
The patent performs preliminary analysis of the database schema to identify table relationships, parent-child connections, and transfer dependencies before the actual data transfer begins. This pre-processing step creates a transfer map that guides the segmented transfer process, enabling the system to transfer only necessary tables in the correct sequence, thereby improving efficiency without significantly increasing overall complexity.
Solution Approach 2:
The patent changes the parameter of table transfer from a uniform all-or-nothing approach to a selective phased approach based on relationship identification. By analyzing and categorizing tables according to their relationships (parent/child, independent, dependent), the system adjusts transfer parameters to optimize the process, transferring only necessary data in appropriate sequences, thus improving efficiency while managing complexity through structured classification.
Data Source
AI summary
A data transfer tool is a data transfer support system that collectively acquires data that is managed in a plurality of tables that have been stored on a transfer source service DB, and works in cooperation with a data migration service for performing a transfer, wherein the data transfer support system includes a data storage unit that executes storage processing to sequentially store data that is sequentially output by the data migration service based on acquisition from the transfer source service DB on a transfer-use DB; a processing target data acquisition unit that acquires data from the transfer-use DB; a transfer processing unit that, in the case in which the data that has been acquired satisfies a condition, performs registration processing for transferring the data to a transfer destination cloud service DB; and a data re-registration unit that, in the case in which the data that has been acquired does not satisfy the condition, re-registers the data to the transfer-use DB.