Data import method and device, electronic equipment and storage medium

Abstract

The invention relates to the field of big data, and provides a data import method and device, electronic equipment and a storage medium. The method comprises steps of obtaining first structured data;converting the first structured data into a first SQL statement through SQL; storing the first SQL statement into a cache file; calculating a preset quantity threshold value according to the data storage state; judging whether the number of the first SQL statements stored in the cache file is greater than or equal to a preset number threshold value or not; if yes, dividing the first SQL statementsstored in the cache file according to a preset quantity threshold value to obtain multiple groups of first SQL statements; and according to the queue form, sequentially inserting each group of firstSQL statements into a target data table of a database. The method can be applied to the fields of intelligent buildings, intelligent government affairs, intelligent medical treatment, intelligent security and protection, intelligent transportation, intelligent logistics, intelligent home furnishing, intelligent communities, intelligent finance, intelligent laws, intelligent life and the like needing to import data into a database, so that the development of intelligent cities is promoted.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a data import method, device, electronic equipment and storage medium. Background technique [0002] With various application requirements, it is often necessary to import different manual report data into the database for management. At present, there are two main types of data import using the built-in database: one is static query import, which needs to generate similar table structures in advance, define field types and data types, and then manually copy and import, which is inefficient. The other is DMP query import, which is more professional and requires technicians to import through the database background. Although the efficiency is good, it requires a technical development foundation, and it is difficult to meet the requirements of different types of databases, and the versatility is not great. [0003] Therefore, how to improve the efficiency of data import w...

AI Technical Summary

Problems solved by technology

At present, there are two main types of data import using the database itself: one is static query import, which requires pre-generated similar table structures, defined field types and data types, and then manually copied and imported, which is inefficient

The other is DMP query import, which is more professional and requires technicians to import through the database background. Although the efficiency is good, it requires a technical development foundation, and it is difficult to meet the requirements of different types of databases, and the versatility is not great.

Images