1results about How to "Reliable preservation" patented technology

The application relates to an FTP unstructured file transmission breakpoint continuation implementation method and device based on DataX. The method comprises the following steps: integrating a progress tracking module into a DataX Writer, creating a transmission progress metadata file (TPMF) containing information such as the number of uploaded bytes and the state for each file and dynamically updating; deploying an independent process monitor to monitor task interruption and trigger progress persistence to the TPFM; a user selects a file through an independent FTP continuation scheduler, reads the TPFM and the server-side target file size to determine the breakpoint, calls an FTP REST command to continue from the breakpoint, updates the state after completion, and the like. The method realizes accurate progress recording, active saving in abnormal interruption and user-controllable continuation, avoids redundant retransmission, improves transmission efficiency and resource utilization, enhances data synchronization robustness and reduces operation and maintenance complexity. The method has small invasiveness to the DataX core, is strong in universality and is suitable for high-reliability synchronization scenes of large-scale unstructured files.