Method for importing data into target directory based on data platform and electronic device

Abstract

The invention discloses a method for importing data into a target directory based on a data platform and an electronic device. The method comprises the following steps: importing the target data intoa big data engine database from a relational database through a data migration tool; operating a pre-edited script file in the big data engine database, wherein the script file comprises a big data engine database and a target directory, the big data engine database automatically generates a plurality of data partitions, data of the data partitions are stored in the target directory, the data partitions all comprise target data, and the script file comprises the target directory and a partition rule. Using the method, the target data can be imported into the big data engine database, and thenthe edited script file is operated through the cloud top, so that the big data engine database generates a plurality of data partitions, the data in the data partitions are stored in the target directory, the data uploading efficiency is greatly improved, and the time is saved.

Description

technical field [0001] The invention relates to the field of data transmission, in particular to a method and electronic equipment for importing data into a target directory based on a data platform. Background technique [0002] Data transmission refers to the process of transmitting data between a data source and a data sink through one or more links in accordance with appropriate procedures. Also refers to the operation of sending data from one place to another by means of a signal on a channel. [0003] For example, upload text or pictures to the server, or download text or pictures from the server. [0004] For another example, the data platform imports massive data from the relational database into the HDFS (Hadoop File System) file system, and then adds the imported data to each table in the HIve (SQL engine) database. [0005] However, after the data is imported to the file system, you need to manually specify each file directory for the Hive data table and add eac...

AI Technical Summary

Problems solved by technology

[0008] In view of the above-mentioned deficiencies in the prior art, the purpose of the present invention is to provide a method and electronic device for importing data into a target directory based on a data platform, aiming at solving the problem that the file directory cannot be automatically selected or the efficiency of data import is too low in the prior art

Images