The invention discloses a heterogeneous
database data transmission method based on a DataX framework. The method comprises the steps that
bidirectional transmission from MySQL to
Oracle and
bidirectional transmission from
Oracle to MySQL are conducted, in the direction from MySQL to
Oracle, a TXT file is generated and uploaded, after downloading, the TXT file is converted into a CSV through a Python script, then a
Java program is triggered by XXL-Job to be loaded and put in storage, and manual
retransmission is conducted when the
Java program is abnormal; in the direction from Oracle to MySQL, CSV files are generated and cleaned,
breakpoint resume is loaded and started through DataX, full-amount and increment synchronization is supported, and manual
retransmission is carried out when abnormity occurs. According to the method, a
data source is decoupled through standard
JSON configuration, format differences are processed through Python scripts, cross-network obstacles are broken through FTP transfer, efficiency and reliability are guaranteed through XXL-Job and
breakpoint resume, and efficient and reliable
data transmission between heterogeneous databases is achieved.