General structured query language (SQL) data processing method and system

Abstract

The invention relates to a general SQL data processing method and a system. The general SQL data processing method comprises installing tool command language (TCL) scripts; reading database connection configuration files when executing the TCL scripts; reading TCL function mapping files corresponding to an object database functions after accessing the object database successfully; analyzing corresponding TCL functions in the TCL scripts to generate the object database functions by using the TCL function mapping files; and submitting the generated object database functions and SQL statements to object database execution. The general SQL data processing method and the system are characterized in that a plurality of heterogeneous data sources are supported, a set of codes can run without any modification in a plurality of database, and the function accords with final data; through custom SQL standards, the problem of modification of a large number of program codes in a data migration process for enterprises is solved, and labor and financial investments are reduced.

Description

technical field [0001] The invention relates to the field of data warehouses, in particular to data migration in the field of data warehouses. Background technique [0002] Existing technology 1: calculating, summarizing, cleaning and transforming data by writing related stored procedures or functions in the database. For data warehouse environments such as DB2, SYBASE, ORACLE, GREENPLUM, and TERDATA, the existing technical solutions are to write a large number of stored procedures in DB2, SYBASE, ORACLE, GREENPLUM, and TERDATA. The calculated data is inserted into its own data warehouse environment. When these internal stored procedures and functions are created or modified, they need to be compiled and then run, otherwise they will not take effect. [0003] The disadvantage of prior art 1 is: all stored procedures or functions need to be recompiled after any modification to make the latest modification take effect, and it will also involve stored procedures and function ...

AI Technical Summary

Problems solved by technology

[0003] The disadvantage of prior art 1 is: all stored procedures or functions need to be recompiled after any modification to make the latest modification take effect, and it will also involve stored procedures and function dependencies. If there are stored procedures and functions Dependency, all dependent stored procedures and functions must be recompiled to take effect, otherwise an error will be reported during execution, which will be very troublesome to maintain, which is not conducive to management and maintenance, and also brings certain pressure to the data warehouse

[0005] The disadvantage of prior art 2 is that the syntax and usage of SQL statements for each type of database are different, and the SQL nested in the external perl and she11 programs only support one database environment, so they do not support cross-platform heterogeneous databases environment, when the program is migrated to another database environment, all perl and she11 programs must be modified to support the new database environment

Therefore, the workload of changes during migration is very large, and it is impossible to realize that a set of codes can run in all database environments

Images