Test method, device, electronic equipment and medium for data structure conversion function

Abstract

The application provides a test method, device, electronic equipment and medium for a data structure conversion function, wherein the method comprises: storing first bank business data having a first data structure to a first database table; converting the first bank business data into second bank business data having a second data structure; performing data structure conversion on the second bank business data through a data warehouse conversion system to obtain third bank business data, and storing the third bank business data to a second database table; comparing different types of summary information, different field information and specified value information containing the field information in the first database table and the second database table to determine whether the first database table and the second database table are the same to obtain a database table comparison result; and determining a test result of the data structure conversion function of the data warehouse conversion system according to the database table comparison result. The method is conducive to improving the accuracy of the data structure conversion function test.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a test method, apparatus, electronic device and medium for data structure conversion function. Background Technology

[0002] During normal operations, banks generate various types of banking business data. This data can be used by the bank's downstream systems. Since these downstream systems were developed in advance, the data structure of the banking business data required by them is usually the old data structure (i.e., the data structure of the banking business data when the downstream system was built).

[0003] When building a new core system, a new data structure will be used, which will differ from the old data structure. The new data structure for banking business data (i.e., the current data structure of banking business data) differs from the old data structure, so downstream systems cannot directly use banking business data with the new data structure. To solve this problem, currently, a data warehouse transformation system is typically used to convert the banking business data with the new data structure into the old data structure for use by downstream systems. Therefore, using a data warehouse transformation system for data structure conversion is a crucial step. However, determining whether the data structure conversion function of the data warehouse transformation system can accurately perform the conversion is a critical issue. Summary of the Invention

[0004] In view of this, the purpose of this application is to provide a testing method, apparatus, electronic device and medium for data structure conversion function, so as to improve the accuracy of testing the data structure conversion function of data warehouse conversion system.

[0005] In a first aspect, embodiments of this application provide a method for testing data structure conversion functionality, including:

[0006] Obtain first banking business data with a first data structure and store it in a first database table;

[0007] The acquired first banking business data is converted into second banking business data with a second data structure;

[0008] The data structure of the second banking business data is transformed by the data warehouse transformation system to obtain the third banking business data with the first data structure, and the third banking business data is stored in the second database table.

[0009] The different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table are compared to determine whether the first database table and the second database table are the same, and the database table comparison result is obtained.

[0010] Based on the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0011] In conjunction with the first aspect, this application provides a first possible implementation of the first aspect, wherein the method is applied to a banking business data processing system; the storage in the first database table includes:

[0012] According to the preset file configuration rules of the downstream system of the banking business data processing system, the first banking business data with the first data structure is stored into multiple first data files that satisfy the preset file configuration rules, so that the first banking business data contained in each first data file is stored in its corresponding first database table.

[0013] The step of transforming the second banking business data through a data warehouse transformation system to obtain third banking business data with the first data structure, and storing the third banking business data in a second database table, includes:

[0014] According to the preset file configuration rules, the second banking business data is stored as a plurality of second data files that satisfy the preset file configuration rules;

[0015] The data warehouse conversion system performs data structure conversion on the second banking business data contained in each of the second data files to obtain the corresponding third data files containing the third banking business data, so as to store the third banking business data contained in each of the third data files into their respective corresponding second database tables.

[0016] The comparison of different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same, and to obtain the database table comparison result, includes:

[0017] For each set of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, and the database table comparison results are obtained.

[0018] In conjunction with the first possible implementation of the first aspect, this application provides a second possible implementation of the first aspect, wherein, before determining the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, the method further includes:

[0019] For each set of first data files and third data files with a mapping relationship, the file attribute information of the first data file and the third data file is compared to determine whether the file attribute information is the same, and the file comparison result is obtained.

[0020] Based on the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined, including:

[0021] Based on the file comparison results and the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0022] In conjunction with the first aspect, this application provides a third possible implementation of the first aspect, wherein different types of summary information, different field information, and specified value information containing field information are compared between the first database table and the second database table to determine whether the first database table and the second database table are the same, and a database table comparison result is obtained, including:

[0023] The summary information of different types in the first database table and the second database table is compared to determine whether the summary information of different types is the same, and the summary information comparison result is obtained.

[0024] For each database table, primary key uniqueness verification is performed on different fields in the database table to obtain the primary key uniqueness verification result for that database table; and information with constraint relationships in the database table is verified to obtain constraint information verification results; the database tables include the first database table and the second database table;

[0025] The different field information in the first database table and the second database table is compared to determine whether the different field information is the same, and the field information comparison result is obtained.

[0026] The data values, default values, and / or default values ​​of specified information containing field information in the first database table and the second database table are compared to determine whether the specified value information is the same, and the comparison result of the specified value information is obtained.

[0027] The database table comparison result is determined based on the summary information comparison result, the primary key uniqueness verification result, the constraint information verification result, the field information comparison result, and the specified value information comparison result.

[0028] In conjunction with the first possible implementation of the first aspect, this application provides a fourth possible implementation of the first aspect, wherein the banking business data processing system includes a script execution tool and a processing server; the comparison of different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same, and to obtain the database table comparison result, includes:

[0029] The processing server responds to the target object's upload operation for the test script and uploads the test script to the script execution tool.

[0030] The script execution tool responds to the target object's trigger operation on the start execution control by executing the test script. The test script compares different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtains the database table comparison result.

[0031] In conjunction with the first aspect, this application provides a fifth possible implementation of the first aspect, wherein, before obtaining the first banking business data having the first data structure, the method further includes:

[0032] Back up the initial banking data with the first data structure to the test database;

[0033] Sensitive data in the initial banking data in the test database is transformed using desensitization rules to obtain the first banking data after data desensitization.

[0034] In conjunction with the fourth possible implementation of the first aspect, this application provides a sixth possible implementation of the first aspect, wherein the method further includes:

[0035] The test list containing the test results is sent to the target user's client for the target user to view;

[0036] When the test result indicates that the data structure conversion function is abnormal, in response to the target object's modification operation on the test rules in the test script or the data conversion rules in the data warehouse conversion system, based on the cause of the abnormal test result, the test rules in the test script or the data conversion rules in the data warehouse conversion system are modified.

[0037] Secondly, embodiments of this application also provide a testing device for data structure conversion functions, comprising:

[0038] The acquisition module is used to acquire first banking business data with a first data structure and store it in a first database table;

[0039] The first conversion module is used to convert the acquired first banking business data into second banking business data with a second data structure;

[0040] The second conversion module is used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and store the third banking business data in the second database table;

[0041] The first comparison module is used to compare different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and to obtain the database table comparison result.

[0042] The determination module is used to determine the test results of the data structure conversion function of the data warehouse conversion system based on the comparison results of the database tables.

[0043] In conjunction with the second aspect, this application provides a first possible implementation of the second aspect, wherein the device resides in a banking business data processing system; the acquisition module, when used for storing in the first database table, is specifically used for:

[0044] According to the preset file configuration rules of the downstream system of the banking business data processing system, the first banking business data with the first data structure is stored into multiple first data files that satisfy the preset file configuration rules, so that the first banking business data contained in each first data file is stored in its corresponding first database table.

[0045] The second conversion module, when used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and to store the third banking business data in the second database table, is specifically used for:

[0046] According to the preset file configuration rules, the second banking business data is stored as a plurality of second data files that satisfy the preset file configuration rules;

[0047] The data warehouse conversion system performs data structure conversion on the second banking business data contained in each of the second data files to obtain the corresponding third data files containing the third banking business data, so as to store the third banking business data contained in each of the third data files into their respective corresponding second database tables.

[0048] The first comparison module, when comparing different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for:

[0049] For each set of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, and the database table comparison results are obtained.

[0050] In conjunction with the first possible implementation of the second aspect, embodiments of this application provide a second possible implementation of the second aspect, wherein the apparatus further includes:

[0051] The second comparison module is used to compare the file attribute information of the first data file and the third data file for each group of first data files and the third data files with a mapping relationship before the determining module determines the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, so as to determine whether the file attribute information is the same and obtain the file comparison result.

[0052] When the determining module determines the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, it is specifically used for:

[0053] Based on the file comparison results and the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0054] In conjunction with the second aspect, this application provides a third possible implementation of the second aspect, wherein the first comparison module, when comparing different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for:

[0055] The summary information of different types in the first database table and the second database table is compared to determine whether the summary information of different types is the same, and the summary information comparison result is obtained.

[0056] For each database table, primary key uniqueness verification is performed on different fields in the database table to obtain the primary key uniqueness verification result for that database table; and information with constraint relationships in the database table is verified to obtain constraint information verification results; the database tables include the first database table and the second database table;

[0057] The different field information in the first database table and the second database table is compared to determine whether the different field information is the same, and the field information comparison result is obtained.

[0058] The data values, default values, and / or default values ​​of specified information containing field information in the first database table and the second database table are compared to determine whether the specified value information is the same, and the comparison result of the specified value information is obtained.

[0059] The database table comparison result is determined based on the summary information comparison result, the primary key uniqueness verification result, the constraint information verification result, the field information comparison result, and the specified value information comparison result.

[0060] In conjunction with the first possible implementation of the second aspect, this application provides a fourth possible implementation of the second aspect, wherein the banking business data processing system includes a script execution tool and a processing server; the first comparison module, when comparing different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for:

[0061] The processing server responds to the target object's upload operation for the test script and uploads the test script to the script execution tool.

[0062] The script execution tool responds to the target object's trigger operation on the start execution control by executing the test script. The test script compares different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtains the database table comparison result.

[0063] In conjunction with the second aspect, this application provides a fifth possible implementation of the second aspect, wherein the apparatus further includes:

[0064] The backup module is used to back up the initial banking business data with the first data structure to the test database before the acquisition module acquires the first banking business data with the first data structure.

[0065] The data anonymization module is used to transform sensitive data in the initial banking business data in the test database according to anonymization rules to obtain the first banking business data after data anonymization.

[0066] In conjunction with the fourth possible implementation of the second aspect, this application provides a sixth possible implementation of the second aspect, wherein the apparatus further includes:

[0067] The sending module is used to send a test list containing the test results to the user terminal of the target object for the target object to view;

[0068] The modification module is used to modify the test rules in the test script or the data conversion rules in the data warehouse conversion system based on the cause of the test result when the test result indicates that the data structure conversion function is abnormal.

[0069] Thirdly, embodiments of this application also provide an electronic device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the memory via the bus, and when the machine-readable instructions are executed by the processor, the steps in any of the possible implementations of the first aspect described above are performed.

[0070] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps in any of the possible implementations of the first aspect described above.

[0071] This application provides a method, apparatus, electronic device, and medium for testing data structure conversion functionality. The method involves acquiring first banking business data with a first data structure and storing it in a first database table; converting the acquired first banking business data into second banking business data with a second data structure; performing data structure conversion on the second banking business data through a data warehouse conversion system to obtain third banking business data with the first data structure, and storing the third banking business data in a second database table; comparing different types of summary information, different field information, and specified value information containing field information in the first and second database tables to determine whether the first and second database tables are the same, obtaining a database table comparison result; and determining the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result.

[0072] Compared to existing sampling comparison methods, the method in this application compares different types of summary information, different field information, and specified value information containing field information in the first and second database tables. This achieves a full-coverage comparison of the first banking business data in the first database table and the third banking business data in the second database table before and after the data structure conversion. This facilitates thorough testing of the first and third banking business data before and after the data structure conversion, thereby improving the accuracy of testing the data structure conversion function of the data warehouse conversion system.

[0073] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0074] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0075] Figure 1 A flowchart of a test method for a data structure conversion function provided in an embodiment of this application is shown;

[0076] Figure 2 A schematic diagram illustrating a test process for a data structure conversion function provided in an embodiment of this application is shown;

[0077] Figure 3 This illustration shows a schematic diagram of a data structure conversion function testing device provided in an embodiment of this application;

[0078] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0079] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0080] To test whether a data warehouse transformation system can accurately perform data structure transformation, existing technologies typically use sampling comparison to determine whether the data before and after the transformation is consistent. However, this sampling comparison method, because it does not perform a full-coverage comparison of all data before and after the transformation, makes it difficult to accurately test whether a data warehouse transformation system can accurately perform data structure transformation.

[0081] Considering the difficulty in accurately testing the data structure conversion capabilities of a data warehouse conversion system using existing sampling comparison methods, this application provides a method, apparatus, electronic device, and medium for testing data structure conversion functionality to improve the accuracy of testing the data structure conversion function of a data warehouse conversion system. The following embodiments illustrate this.

[0082] Example 1:

[0083] To facilitate understanding of this embodiment, a test method for data structure conversion function disclosed in this application embodiment will be described in detail first. This method is applied to a banking business data processing system, wherein the banking business data processing system includes a data processing server. Figure 1 A flowchart illustrating a test method for a data structure conversion function provided in an embodiment of this application is shown, such as... Figure 1 As shown, the process includes the following steps S101-S105:

[0084] S101: Obtain first banking business data with a first data structure and store it in a first database table.

[0085] Figure 2This illustration shows a schematic diagram of a test process for a data structure conversion function provided in an embodiment of this application, such as... Figure 2 As shown, in one possible implementation, before executing step S101 to obtain the first banking business data with the first data structure, the following steps S1011-S1012 may also be executed:

[0086] S1011: Back up the initial banking data with the first data structure to the test database.

[0087] S1012: Sensitive data in the initial banking business data in the test database is transformed using desensitization rules to obtain the first banking business data after data desensitization.

[0088] In this embodiment, sensitive information includes customer privacy information, such as the customer's name, ID number, and mobile phone number, which may be included in the initial banking data. By performing data anonymization processing on the customer's privacy information in the initial banking data—specifically, transforming the sensitive data in the initial banking data according to anonymization rules to hide the sensitive information—it helps protect the security of the customer's personal information. In this embodiment, the first banking data is the data after data anonymization processing. At this time, the test database contains the first banking data after data anonymization processing.

[0089] In this embodiment, when performing step S101 to obtain the first banking business data with the first data structure, the data processing server may specifically obtain the first banking business data with the first data structure from the test database.

[0090] like Figure 2 As shown, in one possible implementation, when performing step S101 of storing to the first database table, the specific steps S1013 can be performed as follows:

[0091] S1013: According to the preset file configuration rules of the downstream system of the banking business data processing system, the first banking business data with the first data structure is stored into multiple first data files that satisfy the preset file configuration rules, so as to store the first banking business data contained in each first data file into their respective first database tables.

[0092] In this embodiment, downstream systems include, for example, credit systems, intermediary business systems, and bill systems. Different downstream systems may require different file formats. Therefore, for each downstream system, according to the preset file configuration rules of that downstream system, the first banking business data with the first data structure is stored as multiple first data files that satisfy the preset file configuration rules of that downstream system.

[0093] For each first data file, the first banking business data in the first data file is stored in the first database table to be populated in the first database, thus obtaining the first database table corresponding to the first data file. In the first database, each first data file corresponds to one first database table.

[0094] S102: Convert the acquired first banking business data into second banking business data with a second data structure.

[0095] The first and second data structures differ, for example, in table names or table structures. For instance, suppose the first set of banking business data specifically includes: customer number, identity information, bank account number, and address information. The first data structure would have: bank account number and customer number in one table, identity information in another, and address information in yet another. The second data structure would have: customer number and identity information in one table, and address information and bank account number in yet another. That is, the first data structure has three tables, and the second data structure has two tables. Alternatively, even if the tables are the same, the first and second data structures might contain different fields or have different field lengths.

[0096] In this embodiment, the first data structure is the old data structure used by the bank in historical time periods, and the second data structure is the new data structure used by the bank in the current time period. The data structure used by the downstream system is the first data structure.

[0097] In this embodiment, when performing step S102, the first banking business data obtained can be migrated to the specified database according to the data storage method in the specified database, so as to convert the first banking business data into second banking business data with a second data structure.

[0098] In this embodiment, the execution order of steps S1013 and S102 can be: first execute step S1013 and then execute step S102; or first execute step S102 and then execute step S1013; or execute steps S1013 and S102 simultaneously. This application does not limit this.

[0099] S103: Through the data warehouse transformation system, the data structure of the second banking business data is transformed to obtain the third banking business data with the first data structure, and the third banking business data is stored in the second database table.

[0100] In one possible implementation, when performing step S103, which involves converting the data structure of the second banking business data through the data warehouse conversion system to obtain third banking business data with a first data structure, and storing the third banking business data in the second database table, the specific steps S1031-S1032 can be performed as follows:

[0101] S1031: According to the preset file configuration rules, the second banking business data is stored as multiple second data files that satisfy the preset file configuration rules.

[0102] In this embodiment, the number of first data files and second data files is the same, and they have a one-to-one mapping relationship. A set of first and second data files with this mapping relationship have identical content. For example, the data files required by the downstream system include: bill files and loan files. Therefore, the first data files include the first bill file and the first loan file; the second data files include the second bill file and the second loan file. There is a mapping relationship between the first and second bill files, and a mapping relationship between the first and second loan files.

[0103] The difference between the first data file and the second data file lies in the different data structures of the stored data.

[0104] S1032: Through the data warehouse conversion system, the data structure of the second banking business data contained in each second data file is converted to obtain the corresponding third data file containing the third banking business data, so as to store the third banking business data contained in each third data file into the corresponding second database table.

[0105] In this embodiment, for each second data file, the second data file is input into a data warehouse conversion system. The data warehouse conversion system performs data structure conversion on the second banking business data contained in the second data file to obtain a third data file containing third banking business data corresponding to the second data file. Each second data file corresponds to one third data file. The mapping relationship between the first data file and the third data file is determined based on the mapping relationship between the first data file and the second data file.

[0106] The data warehouse transformation system is used to convert second banking business data (with a second data structure) in a second data file into third banking business data (with a first data structure) in a third data file. The data content remains unchanged before and after the transformation; only the data structure changes. Therefore, the third banking business data and the second banking business data have the same data content but different data structures.

[0107] For each third data file, the third banking business data in that third data file is stored in the second database table of the second database, thus obtaining the second database table corresponding to that third data file. In the second database, each third data file corresponds to one second database table.

[0108] S104: Compare the different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtain the database table comparison result.

[0109] Specifically, for each pair of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, thus obtaining the database table comparison result. The mapping relationship between the first and second database tables is determined based on the mapping relationship between the first and third data files.

[0110] In one possible implementation, when performing step S104, comparing different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtaining the database table comparison result, the following steps S1041-S1045 can be specifically performed:

[0111] S1041: Compare the different types of summary information in the first database table and the second database table to determine whether the different types of summary information are the same, and obtain the summary information comparison results.

[0112] The types of summary information include any one or more of the following: total number of summary items, total amount of summary items, total number of summary items by dimension, and total amount of summary items by dimension.

[0113] The total number of records refers to the total number of records in both the first and second database tables. Each row in both tables represents one record. The total amount refers to the total amount in both the first and second database tables.

[0114] The total number of records categorized by dimension refers to: the total number of records in the first sub-database table obtained after categorizing the first banking business data in the first database table according to preset dimensions; and the total number of records in the second sub-database table obtained after categorizing the second banking business data in the second database table according to preset dimensions. Preset dimensions include, for example, categorizing by institution or by business code.

[0115] The total amount categorized by dimension refers to: the total amount in the first sub-database table obtained after classifying the first banking business data in the first database table according to preset dimensions; and the total amount in the second sub-database table obtained after classifying the second banking business data in the second database table according to preset dimensions.

[0116] In this embodiment, each summary information item in the first database table and the second database table is compared one by one to determine whether the summary information items in the first database table and the second database table are the same. The summary information comparison results include: summary information is consistent and summary information is inconsistent. Specifically, when all summary information items (i.e., various types of summary information) in the first database table and the second database table are the same, the summary information comparison result of the first database table and the second database table is that the summary information is consistent. When at least one summary information item in the first database table and the second database table is different, the summary information comparison result of the first database table and the second database table is that the summary information is inconsistent.

[0117] S1042: For each database table, perform primary key uniqueness verification on different field information in the database table to obtain the primary key uniqueness verification result corresponding to the database table; and verify the information with constraint relationships in the database table to obtain the constraint information verification result; the database tables include the first database table and the second database table.

[0118] In this embodiment, the field information specifically refers to the primary key information in the database table. The primary key information is the information in the database table that distinguishes different customers, and each customer has a unique primary key. For example, the primary key information could be an ID card number, a customer number, etc. The database table contains primary key information corresponding to multiple customers. In this embodiment, each customer has multiple fields (i.e., primary key information).

[0119] The database table's field information is uniquely validated to determine if at least two identical fields exist, thus obtaining the primary key uniqueness validation result. The primary key uniqueness validation result includes whether the primary key is unique or not. Specifically, if at least two identical fields exist in the database table, the primary key uniqueness validation result is "not unique"; if all fields in the database table are different for each customer, the primary key uniqueness validation result is "satisfactory".

[0120] A constraint relationship refers to, for example, a relationship between an ID card number and gender. One digit of the ID card number can represent the customer's gender. By verifying the constraint-related information for each customer in the database table one by one, the constraint information verification result is obtained. The constraint information verification result includes: the constraint information is correct and the constraint information is incorrect.

[0121] Specifically, if all the constraint information for each customer in the database table is correct (e.g., the constraint information between ID number and gender is correct), then the constraint information verification result for that database table is considered correct. If at least one customer in the database table has incorrect constraint information, then the constraint information verification result is considered incorrect.

[0122] S1043: Compare the different field information in the first database table and the second database table to determine whether the different field information is the same, and obtain the field information comparison result.

[0123] For a set of first and second database tables with a mapping relationship, the different field information in the first and second database tables is compared. For example, each of the first and second database tables contains information on 100 customers, including their ID card number, address, deposit amount, loan amount, name, gender, and customer number. The ID card number and customer number are used as field information.

[0124] The ID card number information in the first database table is compared with the ID card number information in the second database table, and the customer number in the first database table is compared with the customer number in the second database table to determine whether different field information is the same.

[0125] The field information comparison results include identical and different fields. Specifically, if all different fields in the first database table and the second database table are identical, the field information comparison result is identical. If at least one of the different fields in the first database table and the second database table is different, the field information comparison result is different.

[0126] S1044: Compare the data values, default values, and / or default values ​​of specified information containing field information in the first database table and the second database table to determine whether the specified value information is the same and obtain the specified value information comparison result.

[0127] Data values ​​containing specified information, such as: field information + address information, field information + loan amount value.

[0128] The default value is used to fill in missing data in the first and second database tables according to a preset default value. In this embodiment, the default values ​​in the first and second database tables are compared to see if they are the same.

[0129] The default value is used to fill in missing data in both the first and second database tables when such data is missing. In this embodiment, the default values ​​in the first and second database tables are compared to see if they are the same.

[0130] In this embodiment, the comparison result of specified value information includes specified value information being the same and specified value information being different. When the data values, default values, and / or default values ​​of the specified information containing field information in the first database table and the second database table are all the same, the comparison result of specified value information is that the specified value information is the same. When at least one of the data values, default values, and / or default values ​​of the specified information containing field information in the first database table and the second database table is different, the comparison result of specified value information is that the specified value information is different.

[0131] S1045: Determine the database table comparison results based on the summary information comparison results, primary key uniqueness verification results, constraint information verification results, field information comparison results, and specified value information comparison results.

[0132] In this embodiment, when the summary information comparison result is consistent, the primary key uniqueness verification result is consistent with the primary key uniqueness, the constraint information verification result is correct, the field information comparison result is the same, and the specified value information comparison result is the same, the database table comparison result is consistent.

[0133] The database table comparison result is considered inconsistent when at least one or more of the following results exist: summary information comparison result is inconsistent summary information, primary key uniqueness verification result is inconsistent primary key uniqueness, constraint information verification result is whether constraint information exists, field information comparison result is different field information, and specified value information comparison result is different specified value information.

[0134] In one possible implementation, the banking business data processing system includes a script execution tool and a processing server; when performing step S104, comparing different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtaining the database table comparison result, the following steps S1046-S1047 can be specifically executed:

[0135] S1046: By processing the server's response to the target object's upload operation for the test script, the test script is uploaded to the script execution tool.

[0136] S1047: The script execution tool responds to the target object's trigger operation on the start execution control by executing a test script. The test script compares the different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtains the database table comparison result.

[0137] In this embodiment, the target object can be a research and development personnel. The test script is generated by the processing server in response to the target object's editing operation on a blank script. After the test script is written, it is uploaded to the script execution tool for deployment.

[0138] S105: Based on the database table comparison results, determine the test results of the data structure conversion function of the data warehouse conversion system.

[0139] In one possible implementation, if the comparison result of the corresponding database tables of each set of mapped first and second database tables is consistent, the test result of the data structure conversion function of the data warehouse conversion system is that the data structure conversion function is normal. If the comparison result of the corresponding database tables of at least one set of mapped first and second database tables is inconsistent, the test result of the data structure conversion function of the data warehouse conversion system is that the data structure conversion function is abnormal.

[0140] In another possible implementation, before executing step S105 to determine the test results of the data structure conversion function of the data warehouse conversion system based on the database table comparison results, the following steps S1051 can also be performed:

[0141] S1051: For each group of first and third data files with a mapping relationship, compare the file attribute information of the first and third data files to determine whether the file attribute information is the same, and obtain the file comparison result.

[0142] The file attribute information includes any one or more of the following: number of files, file storage path, file name, file format, and file storage size.

[0143] The number of files can be the number of sub-files contained in the first data file and the number of sub-files contained in the third data file; or it can be the total number of the first data files and the total number of the third data files.

[0144] The first and third data files can be stored on different servers, each with a unique ID. The file storage paths can be: the storage path of the first data file on the first server, and the storage path of the third data file on the second server. The file names are the same as the filenames of the first and third data files. The file formats are the same as those of the first and third data files. The file storage sizes are the storage space occupied by the first and third data files, respectively.

[0145] In this embodiment, each file attribute information in the first data file and the third data file is compared one by one to determine whether the file attribute information in the first data file and the third data file is the same. The file comparison result includes: file attribute information is consistent and file attribute information is inconsistent. Specifically, when all file attribute information in the first data file and the third data file is the same, the file comparison result of the first data file and the third data file is that the file attribute information is consistent. When at least one file attribute information in the first data file and the third data file is different, the file comparison result of the first data file and the third data file is that the file attribute information is inconsistent.

[0146] In this embodiment, the execution order of steps S1051 and S104 can be: first execute step S1051 and then execute step S104; or first execute step S104 and then execute step S1051; or execute steps S1051 and S104 simultaneously. This application does not limit this.

[0147] When performing step S105 to determine the test results of the data structure conversion function of the data warehouse conversion system based on the database table comparison results, the following steps can be followed:

[0148] Based on the file comparison results and database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0149] In this embodiment, each pair of first and second database tables with a mapping relationship corresponds to a database table comparison result, and each pair of first and third data files with a mapping relationship corresponds to a file comparison result. Based on all file comparison results and all database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0150] In one possible implementation, the file comparison results include: file attribute information is consistent and file attribute information is inconsistent; the database table comparison results include: database tables are consistent and database tables are inconsistent; the test results include: data structure conversion function is normal and data structure conversion function is abnormal.

[0151] When all file comparison results show that the file attribute information is consistent, and all database table comparison results show that the database tables are consistent, the test result of the data structure conversion function of the data warehouse conversion system is that the data structure conversion function is normal.

[0152] When at least one file comparison result shows inconsistent file attribute information, and / or at least one database table comparison result shows inconsistent database table information, the test result of the data structure conversion function of the data warehouse conversion system is that the data structure conversion function is abnormal.

[0153] In this embodiment, if the data warehouse conversion system performs the data structure conversion correctly (i.e., the data structure conversion function of the data warehouse conversion system is normal), then the first database table and the second database table with a mapping relationship should be completely identical, and the first data file and the third data file with a mapping relationship should also be completely identical. If the first database table and the second database table with a mapping relationship are not completely identical, or if the first data file and the third data file with a mapping relationship are not the same, then the data warehouse conversion system is performing the data structure conversion incorrectly (i.e., the data structure conversion function of the data warehouse conversion system is abnormal).

[0154] In one possible implementation, the following steps may also be performed:

[0155] S1061: Send the test list containing the test results to the target user's client for the target user to view.

[0156] S1062: When the test result indicates that the data structure conversion function is abnormal, based on the cause of the abnormal test result, respond to the target object's modification operation on the test rules in the test script or the data conversion rules in the data warehouse conversion system, so as to modify the test rules in the test script or the data conversion rules in the data warehouse conversion system.

[0157] When the test result indicates an error in the data structure conversion function, the test list can also include the reason for the error. For example, if the file formats of the first data file A1 and the third data file A2 are different, then the file comparison result between the first data file A1 and the third data file A2 is that the file attribute information is inconsistent, and the test result indicates an error in the data structure conversion function. The test list can specifically include the file formats of the first data file A1 and the third data file A2.

[0158] In this embodiment, when the test result indicates an error in the data structure conversion function, there are two possibilities: either the data conversion rules in the data warehouse conversion system are incorrect, or the test rules in the test script are incorrect. In this case, the target object can analyze and determine whether the error is due to incorrect data conversion rules in the data warehouse conversion system or incorrect test rules in the test script, based on the error reasons in the test checklist. When the data conversion rules in the data warehouse conversion system are incorrect, the target object's modification operation on the data warehouse conversion system is invoked to modify the data conversion rules in the data warehouse conversion system. Similarly, when the test rules in the test script are incorrect, the target object's modification operation on the test script is invoked to modify the test rules in the test script.

[0159] Example 2:

[0160] Based on the same technical concept, embodiments of this application also provide a testing device for data structure conversion functions. Figure 3 This application provides a schematic diagram of the structure of a test device for data structure conversion function, as shown in the embodiment of the present application. Figure 3 As shown, the device includes:

[0161] The acquisition module 301 is used to acquire first banking business data with a first data structure and store it in a first database table;

[0162] The first conversion module 302 is used to convert the acquired first banking business data into second banking business data with a second data structure;

[0163] The second conversion module 303 is used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and store the third banking business data in the second database table;

[0164] The first comparison module 304 is used to compare different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and to obtain the database table comparison result.

[0165] The determination module 305 is used to determine the test results of the data structure conversion function of the data warehouse conversion system based on the database table comparison results.

[0166] Optionally, the device resides in a banking business data processing system; when the acquisition module 301 is used to store the data in the first database table, it is specifically used for:

[0167] According to the preset file configuration rules of the downstream system of the banking business data processing system, the first banking business data with the first data structure is stored into multiple first data files that satisfy the preset file configuration rules, so that the first banking business data contained in each first data file is stored in its corresponding first database table.

[0168] The second conversion module 303, when used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and to store the third banking business data in the second database table, is specifically used for:

[0169] According to the preset file configuration rules, the second banking business data is stored as a plurality of second data files that satisfy the preset file configuration rules;

[0170] The data warehouse conversion system performs data structure conversion on the second banking business data contained in each of the second data files to obtain the corresponding third data files containing the third banking business data, so as to store the third banking business data contained in each of the third data files into their respective corresponding second database tables.

[0171] The first comparison module 304, when comparing different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for:

[0172] For each set of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, and the database table comparison results are obtained.

[0173] Optionally, the device further includes:

[0174] The second comparison module is used to compare the file attribute information of each group of the first data file and the third data file with a mapping relationship before the determining module 305 determines the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, so as to determine whether the file attribute information is the same and obtain the file comparison result.

[0175] When the determining module determines the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, it is specifically used for:

[0176] Based on the file comparison results and the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

[0177] Optionally, when the first comparison module 304 compares different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same and obtain the database table comparison result, it is specifically used for:

[0178] The summary information of different types in the first database table and the second database table is compared to determine whether the summary information of different types is the same, and the summary information comparison result is obtained.

[0179] For each database table, primary key uniqueness verification is performed on different fields in the database table to obtain the primary key uniqueness verification result for that database table; and information with constraint relationships in the database table is verified to obtain constraint information verification results; the database tables include the first database table and the second database table;

[0180] The different field information in the first database table and the second database table are compared to determine whether the different field information is the same, and the field information comparison result is obtained.

[0181] The data values, default values, and / or default values ​​of specified information containing field information in the first database table and the second database table are compared to determine whether the specified value information is the same, and the comparison result of the specified value information is obtained.

[0182] The database table comparison result is determined based on the summary information comparison result, the primary key uniqueness verification result, the constraint information verification result, the field information comparison result, and the specified value information comparison result.

[0183] Optionally, the banking business data processing system includes a script execution tool and a processing server; the first comparison module 304, when comparing different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for:

[0184] The processing server responds to the target object's upload operation for the test script and uploads the test script to the script execution tool.

[0185] The script execution tool responds to the target object's trigger operation on the start execution control by executing the test script. The test script compares different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtains the database table comparison result.

[0186] Optionally, the device further includes:

[0187] The backup module is used to back up the initial banking business data with the first data structure to the test database before the acquisition module 301 acquires the first banking business data with the first data structure.

[0188] The data anonymization module is used to transform sensitive data in the initial banking business data in the test database according to anonymization rules to obtain the first banking business data after data anonymization.

[0189] Optionally, the device further includes:

[0190] The sending module is used to send a test list containing the test results to the user terminal of the target object for the target object to view;

[0191] The modification module is used to modify the test rules in the test script or the data conversion rules in the data warehouse conversion system based on the cause of the test result when the test result indicates that the data structure conversion function is abnormal.

[0192] Example 3:

[0193] Based on the same technical concept, embodiments of this application also provide an electronic device. Figure 4 This application provides a schematic diagram of the structure of an electronic device according to an embodiment of the present application. Figure 4 As shown, the electronic device 400 includes a processor 401, a memory 402, and a bus 403. The memory stores machine-readable instructions that can be executed by the processor. When the electronic device is running, the processor 401 communicates with the memory 402 through the bus 403. The processor 401 executes the machine-readable instructions to perform the steps of the method described in Embodiment 1.

[0194] Example 4:

[0195] Based on the same technical concept, Embodiment 4 of this application also provides a computer-readable storage medium storing a computer program, which is executed by a processor to perform the steps of the method described in Embodiment 1.

[0196] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, electronic devices, and computer-readable storage media described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0197] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the coupling or direct coupling or communication connection shown or discussed may be through some communication interface; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0198] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0199] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0200] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0201] Finally, it should be noted that the above-described embodiments are merely specific implementations of this application, used to illustrate the technical solutions of this application, and not to limit them. The scope of protection of this application is not limited thereto. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this application. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of protection of the claims.

Claims

1. A test method for data structure conversion function, characterized in that, include: Obtain first banking business data with a first data structure and store it in a first database table; The acquired first banking business data is converted into second banking business data with a second data structure; The data structure of the second banking business data is transformed by the data warehouse transformation system to obtain the third banking business data with the first data structure, and the third banking business data is stored in the second database table. The different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table are compared to determine whether the first database table and the second database table are the same, and the database table comparison result is obtained. Based on the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined; The storage in the first database table includes: The first banking business data with a first data structure is stored in multiple first data files, so that the first banking business data contained in each of the first data files is stored in their respective first database tables. The step of transforming the second banking business data through a data warehouse transformation system to obtain third banking business data with the first data structure, and storing the third banking business data in a second database table, includes: The second banking business data is stored in multiple second data files; The data warehouse conversion system performs data structure conversion on the second banking business data contained in each of the second data files to obtain the corresponding third data files containing the third banking business data, so as to store the third banking business data contained in each of the third data files into their respective corresponding second database tables. The comparison of different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same, and to obtain the database table comparison result, includes: For each set of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, and the database table comparison results are obtained.

2. The method according to claim 1, characterized in that, The method is applied to a banking business data processing system; The step of storing the first banking business data with a first data structure into multiple first data files includes: According to the preset file configuration rules of the downstream system of the banking business data processing system, the first banking business data with the first data structure is stored into multiple first data files that satisfy the preset file configuration rules; The step of storing the second banking business data into multiple second data files includes: According to the preset file configuration rules, the second banking business data is stored as a plurality of second data files that satisfy the preset file configuration rules.

3. The method according to claim 1, characterized in that, Before determining the test result of the data structure conversion function of the data warehouse conversion system based on the database table comparison result, the method further includes: For each set of first data files and third data files with a mapping relationship, the file attribute information of the first data file and the third data file is compared to determine whether the file attribute information is the same, and the file comparison result is obtained. Based on the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined, including: Based on the file comparison results and the database table comparison results, the test results of the data structure conversion function of the data warehouse conversion system are determined.

4. The method according to claim 1, characterized in that, The first database table and the second database table are compared to determine whether they are identical, based on different types of summary information, different field information, and specified value information containing field information. The comparison results include: The summary information of different types in the first database table and the second database table is compared to determine whether the summary information of different types is the same, and the summary information comparison result is obtained. For each database table, primary key uniqueness verification is performed on different fields in the database table to obtain the primary key uniqueness verification result for that database table; and information with constraint relationships in the database table is verified to obtain constraint information verification results; the database tables include the first database table and the second database table; The different field information in the first database table and the second database table is compared to determine whether the different field information is the same, and the field information comparison result is obtained. The data values, default values, and / or default values ​​of specified information containing field information in the first database table and the second database table are compared to determine whether the specified value information is the same, and the comparison result of the specified value information is obtained. The database table comparison result is determined based on the summary information comparison result, the primary key uniqueness verification result, the constraint information verification result, the field information comparison result, and the specified value information comparison result.

5. The method according to claim 2, characterized in that, The banking data processing system includes a script execution tool and a processing server; the comparison of different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same, and to obtain the database table comparison result, includes: The processing server responds to the target object's upload operation for the test script and uploads the test script to the script execution tool. The script execution tool responds to the target object's trigger operation on the start execution control by executing the test script. The test script compares different types of summary information, different field information, and specified value information containing field information in the first database table and the second database table to determine whether the first database table and the second database table are the same, and obtains the database table comparison result.

6. The method according to claim 1, characterized in that, Before acquiring the first banking business data with the first data structure, the method further includes: Back up the initial banking data with the first data structure to the test database; Sensitive data in the initial banking data in the test database is transformed using desensitization rules to obtain the first banking data after data desensitization.

7. The method according to claim 5, characterized in that, The method further includes: The test list containing the test results is sent to the target user's client for the target user to view; When the test result indicates that the data structure conversion function is abnormal, in response to the target object's modification operation on the test rules in the test script or the data conversion rules in the data warehouse conversion system, based on the cause of the abnormal test result, the test rules in the test script or the data conversion rules in the data warehouse conversion system are modified.

8. A testing device for data structure conversion function, characterized in that, include: The acquisition module is used to acquire first banking business data with a first data structure and store it in a first database table; The first conversion module is used to convert the acquired first banking business data into second banking business data with a second data structure; The second conversion module is used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and store the third banking business data in the second database table; The first comparison module is used to compare different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and to obtain the database table comparison result. The determination module is used to determine the test results of the data structure conversion function of the data warehouse conversion system based on the database table comparison results; When the acquisition module is used to store data in the first database table, it is specifically used for: The first banking business data with a first data structure is stored in multiple first data files, so that the first banking business data contained in each of the first data files is stored in their respective first database tables. The second conversion module, when used to perform data structure conversion on the second banking business data through the data warehouse conversion system to obtain third banking business data with the first data structure, and to store the third banking business data in the second database table, is specifically used for: The second banking business data is stored in multiple second data files; The data warehouse conversion system performs data structure conversion on the second banking business data contained in each of the second data files to obtain the corresponding third data files containing the third banking business data, so as to store the third banking business data contained in each of the third data files into their respective corresponding second database tables. The first comparison module, when comparing different types of summary information, different field information, and specified value information containing field information between the first database table and the second database table to determine whether the first database table and the second database table are the same and obtaining the database table comparison result, is specifically used for: For each set of first and second database tables with a mapping relationship, the different types of summary information, different field information, and specified value information containing field information in the first and second database tables are compared to determine whether the first and second database tables are the same, and the database table comparison results are obtained.

9. An electronic device, characterized in that, include: The device includes a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is in operation, the processor communicates with the memory via the bus, and the machine-readable instructions, when executed by the processor, perform the steps of the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the method as described in any one of claims 1 to 7.

Images