Test method, device, equipment and storage medium

Abstract

The embodiment of the present application provides a test method, apparatus, device and storage medium, the method comprising: obtaining a test record set, the test record set including at least one test record; determining a first test record to be executed in the test record set; determining a target test system from at least two test systems according to the first test record; sending test information to the target test system, the test information including the test time. It is used to shorten the test time of the test system, improve the test efficiency of the test system, and thus improve the test efficiency of the financial data processing system including the two test systems and the operation quality after going online.

Description

Technical Field

[0001] The present application relates to the field of software testing technology, and in particular to a testing method, device, equipment and storage medium. Background Art

[0002] With the development of financial technology, more and more financial businesses rely on data processing and analysis. To this end, many companies have developed financial data processing systems that can process financial data.

[0003] In order to maintain the financial data processing system, meet the ever-changing user and business needs, or repair system vulnerabilities or defects, it is often necessary to update and iterate it. After updating and iterating it, it is necessary to test the updated financial data processing system to ensure that the updated financial data processing system can still operate normally. In the related art, the financial data processing system includes a financial system and a big data system, and the testing method of the financial data processing system includes: the financial system is tested according to the test case corresponding to the financial system to obtain the test result; the tester verifies the test result to determine whether the test data meets the expected result, and if so, the financial system is controlled to send the test result to the big data system; the big data system is tested according to the test result and the test case corresponding to the big data system to obtain the test result, and the tester verifies the test result to determine whether the test result meets the expected result, thereby realizing the test of the financial data processing system.

[0004] In related technologies, there is data interaction between the financial system and the big data system, so testers are required to verify whether the test results meet the expected results, which leads to a longer test time for the financial data processing system and reduces the test efficiency of the financial data processing system. Summary of the invention

[0005] The embodiments of the present application provide a testing method, apparatus, device and storage medium, which are used to avoid data interaction between at least two test systems, thereby avoiding test personnel from verifying the test results generated by the test system, shortening the test time of the test system, improving the test efficiency of the test system, and thereby improving the test efficiency of a financial data processing system including two test systems and the operation quality after going online.

[0006] In a first aspect, an embodiment of the present application provides a testing method, comprising:

[0007] Obtain a test record set, where the test record set includes at least one test record;

[0008] Determining a first test record to be executed in the test record set;

[0009] determining a target test system among at least two test systems according to the first test record;

[0010] Send test information to the target test system, where the test information includes the test time.

[0011] In a second aspect, an embodiment of the present application provides a testing device, including: an acquisition module, a determination module and a sending module, wherein:

[0012] The acquisition module is used to acquire a test record set, where the test record set includes at least one test record;

[0013] The determination module is used to determine a first test record to be executed in the test record set;

[0014] The determination module is further used to determine a target test system from at least two test systems according to the first test record;

[0015] The test module is used to send test information to the target test system, and the test information includes the test time.

[0016] In a third aspect, an embodiment of the present application provides a testing device, including: a memory and a processor;

[0017] Memory stores computer-executable instructions;

[0018] The processor executes the computer-executable instructions stored in the memory, so that the processor executes any method in the first aspect above.

[0019] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, any method of the above-mentioned first aspect is performed.

[0020] The embodiments of the present application provide a test method, apparatus, device and storage medium, the test method comprising: obtaining a test record set, the test record set including at least one test record, each test record including the test time and the identification of the test system; determining the first test record to be executed in the test record set; determining the target test system in at least two test systems according to the first test record; sending test information to the target test system, the test information including the test time. In the above method, the test platform sends the test information to the target test system, which can avoid data interaction between at least two test systems, thereby avoiding the test personnel from verifying the test results generated by the test system, shortening the test time of the test system, improving the test efficiency of the test system, and thereby improving the test efficiency of the financial data processing system including the two test systems and the operation quality after going online. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A schematic diagram of the structure of a financial data processing system provided in an embodiment of the present application;

[0023] Figure 2 A structural diagram of an existing testing method corresponding to a financial data processing system is provided for an embodiment of the present application;

[0024] Figure 3 A schematic diagram of an application scenario of the test method provided in an embodiment of the present application;

[0025] Figure 4 This is a schematic diagram of the test method provided in the embodiment of the present application. Figure 1 ;

[0026] Figure 5 A schematic diagram of a test case provided for an embodiment of the present application;

[0027] Figure 6 Schematic diagram of the test method provided in the embodiment of the present application Figure 2 ;

[0028] Figure 7 A schematic diagram of a flow chart of a financial system performing a test operation provided in an embodiment of the present application;

[0029] Figure 8 A schematic diagram of a process for executing a test operation on a big data system provided in an embodiment of the present application;

[0030] Fig. 9 A schematic diagram of the structure of the test device provided in the embodiment of the present application Figure 1 ;

[0031] Fig.10 A schematic diagram of the structure of the test device provided in the embodiment of the present application Figure 2 ;

[0032] Fig.11 A schematic diagram of the hardware structure of the test equipment provided in the embodiment of the present application. DETAILED DESCRIPTION

[0033] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0034] The terms "including" and "having" and any variations thereof in the specification, claims and drawings of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0035] Figure 1 This is a schematic diagram of the structure of the financial data processing system provided in the embodiment of the present application. Figure 1 As shown, the financial data processing system includes: a financial system and a big data system.

[0036] Among them, the financial system is used to perform batch operations (i.e., batch operations) based on transaction data, obtain batch data results, and then send the batch data results to the big data system through a preset tool (WTSS tool), so that the big data system stores the batch data results in a database (such as Hives or Hbase). The big data system performs batch operations based on the batch data results, and stores the generated data after the batch operations are executed in the database. It should be noted that the batch operations performed by the financial system are different from the batch operations performed by the big data system. For example, batch operations refer to batch data aggregation (such as batch interest calculation for personal accounts) or batch data processing.

[0037] In actual applications, in order to maintain the financial data processing system, meet the ever-changing user and business needs, or fix system vulnerabilities or defects, it is often necessary to update and iterate the financial data processing system. After updating and iterating it, it is necessary to test the updated financial data processing system to ensure that the updated financial data processing system can still operate normally after it goes online (during actual use).

[0038] Figure 2 This is a schematic diagram of the structure of the existing test method corresponding to the financial data processing system provided in the embodiment of the present application. Figure 2 As shown, it includes: the test process corresponding to the financial system and the test process corresponding to the big data system.

[0039] The test process corresponding to the financial system includes: a test process for interface testing of the financial system, and a test process for functional testing after batch operation. Among them, the test process for interface testing of the financial system includes: the financial system tests the preset interface according to the pre-set test message to obtain the interface test result, wherein the preset interface is the interface set in the financial system; and verifies whether the function of the preset interface is normal according to the interface test result. Among them, the test process for functional testing after batch operation includes: executing the interface message number generation operation to obtain test information, wherein the interface message number generation operation refers to generating test information according to the test case corresponding to the financial system; executing batch operation according to the test information to obtain test results; the tester verifies the test result to determine whether the test result meets the expected result. If so, it is determined that the test of the financial system has been achieved, and the financial system is controlled to send the test result to the big data system.

[0040] The test process corresponding to the big data system includes: executing script number-generating operations to obtain test information, wherein the script number-generating operations refer to generating test information according to the test cases corresponding to the big data system; storing the test information in a database (such as Hives or Hbase); performing batch operations according to the test information and the test results sent by the financial system to obtain test results; storing the test results in a database; and the tester verifies the test results to determine whether the test results meet the expected results. If so, it is determined that the test of the big data system has been achieved.

[0041] In the above process, there is data interaction between the financial system and the big data system, so testers are required to verify the test results generated by the financial system and the big data system, which leads to a longer test time for the financial data processing system and reduces the test efficiency of the financial data processing system.

[0042] In actual applications, the financial system and the big data system each have a large number of test cases (usually hundreds of them). The financial system needs to perform batch operations for each test case corresponding to it, and the big data system needs to perform batch operations for each test case corresponding to it. Since the execution time of each batch operation is long (usually between 5 and 30 minutes), the test time of the financial data processing system is long, which reduces the test efficiency of the financial data processing system. Moreover, in the prior art, in order to shorten the test time of the financial data processing system, the financial system is usually tested only through a few test cases corresponding to the financial system, resulting in incomplete testing of the financial data processing system, which in turn leads to great functional risks (i.e. functional errors, such as interest settlement function errors) in the financial data processing system after it goes online, reducing the operating quality of the financial data processing system after it goes online.

[0043] In order to improve the testing efficiency of the financial data processing system, solve the functional risks of the financial data processing system, and improve the operation quality of the financial data processing system after it goes online, the embodiment of the present application provides a testing method to test the financial data processing system through a testing platform. Figure 3 The application scenario of the testing method provided in the embodiment of the present application is described.

[0044] Figure 3 Schematic diagram of application scenario of the test method provided in the embodiment of the present application. Figure 3 As shown, it includes: a test device and at least two test systems, the test device is provided with a test platform, and the at least two test systems may include a financial system and a big data system.

[0045] Among them, the test platform can send test information to the target test system in at least two test systems according to the test record set, so that the target test system performs the test operation according to the test information, thereby realizing the test of the target test system. In the above process, the test platform can send test information to the target test system in at least two test systems, so that the target test system performs the test, thereby avoiding data interaction between at least two test systems, thereby avoiding the test personnel from verifying the test results of the test system, shortening the test time of the test system, improving the test efficiency of the test system, solving the functional hidden dangers of the test system, and improving the operation quality of the test system after going online, thereby improving the test efficiency and operation quality of the financial data processing system including the two test systems.

[0046] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0047] Figure 4 This is a schematic diagram of the test method provided in the embodiment of the present application. Figure 1 .like Figure 4 As shown, the testing method provided in this embodiment includes:

[0048] S101. Acquire a test record set, where the test record set includes at least one test record.

[0049] Each test record includes the test time and the identification of the test system.

[0050] Optionally, the execution subject of the embodiment of the present application may be a test device, or a test platform provided in the test device, the test platform may be implemented by a test device, and the test device may be implemented by a combination of software and / or hardware. For example, the test device may be a laptop computer, a desktop computer, etc.

[0051] Specifically, the test record set is generated based on multiple test cases in the test plan. Optionally, multiple test cases can be set for the test plan before testing. For a detailed description of the test cases, see Figure 5 The embodiments will not be described in detail here.

[0052] Optionally, each test record may also include a use case identifier, a step identifier, a relative time, and an operation identifier. Figure 5 The three test cases shown in the embodiment can obtain the test record set shown in Table 1 below.

[0053] Table 1

[0054] Use case identification Test system identification Step ID Relative time Testing time Operation ID V1 Runbatch S1 0D 20200724 A0 V1 Runbatch S4 1D 20200725 A1 V3 Wtssbatch S2 0D 20200724 B1 V2 Wtssbatch S3 1D 20200725 B2 V1 Wtssbatch S5 1D 20200725 B3

[0055] The use case identifier is the identifier of the test case. The operation identifier is the identifier of the batch operation executed by the test system. The step identifier indicates the execution order of the batch operation executed by the test system. For example, the step identifier S1 indicates that the test system identifier Runbatch executes the batch operation corresponding to the operation identifier A0 in the first step.

[0056] The test time (i.e., absolute time) is the execution time of the batch operation, which is determined based on the relative time and the specific time of the business. For example, if the specific time of the business is 2020723 (i.e., July 23, 2020) and the relative time is 1D (i.e., 1 day), the test time is 2020724 (i.e., July 24, 2020).

[0057] It should be noted that the multiple test times corresponding to the identification of the same test system are arranged from small to large, and optionally, can also be arranged from large to small.

[0058] S102: Determine a first test record to be executed in a test record set.

[0059] In a possible implementation manner, the test record set may further include an identifier of each test record, and the first test record to be executed may be determined by the identifier of the test record.

[0060] For example, when the identifier of the test record is represented by a number, the identifier corresponding to each test record can be arranged from small to large. For example, the identifiers of the five test records shown in Table 1 can be 1, 2, 3, 4, and 5. Further, the test platform can determine the first test record to be executed based on the identifier of the currently executed test record. For example, if the identifier of the currently executed test record is 2, the first test record to be executed is the test record corresponding to identifier 3.

[0061] In another possible implementation, the test platform may also record the row number of the currently executed test record, and determine the test record corresponding to the row number obtained by adding 1 to the above row number as the first test record to be executed.

[0062] S103: Determine a target test system from at least two test systems according to the first test record.

[0063] Specifically, the target test system may be determined from at least two test systems according to an identifier of the test system in the first test record.

[0064] For example, the at least two test systems may include a financial system and a big data system, wherein the identifier of the financial system is Runbatch and the identifier of the big data system is Wtssbatch. If the identifier of the test system in the first test record is Runbatch, the financial system may be determined as the target test system.

[0065] S104: Send test information to the target test system, where the test information includes the test time.

[0066] Further, after receiving the test information, the target test system performs the test operation according to the test time. Specifically, the target test system is a financial system. The method for the financial system to perform the test operation according to the test time can be found in Figure 7 In this embodiment, the target test system is a big data system. The method for the big data system to perform test operations according to the test time can be found in Figure 8 Embodiment: No further description will be given here.

[0067] The test method provided in this embodiment includes: the test platform obtains a test record set, the test record set includes at least one test record, each test record includes the test time and the identification of the test system; the test platform determines the first test record to be executed in the test record set; the test platform determines the target test system from at least two test systems based on the first test record; the test platform sends test information to the target test system, and the test information includes the test time. In the above method, the test platform sends test information to the target test system, which can avoid data interaction between at least two test systems, thereby avoiding the test personnel from verifying the test results generated by the test system, shortening the test time of the test system, and improving the test efficiency of the test system, thereby improving the test efficiency and operation quality of the financial data processing system including the two test systems.

[0068] Combine the following Figure 5 , taking the three test cases corresponding to the test plan as an example, the test cases provided in the embodiment of the present application are described in detail.

[0069] Figure 5Schematic diagram of a test case provided in the embodiment of the present application. Figure 5 As shown, it includes: a test case corresponding to the use case identifier V1, a test case corresponding to the use case identifier V2, and a test case corresponding to the use case identifier V3.

[0070] Each test case includes at least one operation identifier corresponding to each batch operation. For example, the test case corresponding to the test case identifier V1 and the test case corresponding to the test case identifier V2 include operation identifiers corresponding to five batch operations: A0, B1, B2, A1, B3. For example, the test case corresponding to the test case identifier V3 includes operation identifiers corresponding to three batch operations: A0, B1, B2.

[0071] It should be noted that the batch operation includes batch operations corresponding to at least two test systems. For example, the at least two test systems include a financial system and a big data system, and the batch operation performed by the financial system may have an identifier A, and the batch operation performed by the big data system has an identifier B. For example, in the above A0, B1, B2, A1, B3, A0 and A1 indicate the operation identifiers of the batch operation performed by the financial system, and B1, B2, and B3 are the operation identifiers of the batch operation performed by the big data system.

[0072] Each operation identifier corresponds to an operation identifier of Y verification operations, where Y is an integer greater than or equal to 0. For example, in the test case corresponding to the use case identifier V1, A0 has no (Y=0) corresponding operation identifier of a verification operation, and B1 corresponds to an operation identifier C1 of one (Y=1) verification operation (i.e., the first verification operation). For example, in the test case corresponding to the use case identifier V2, B3 corresponds to two (Y=2) verification operations (i.e., the third verification operation and the fourth verification operation) with operation identifiers C3 and C4, respectively.

[0073] For example, in the test case corresponding to the use case identifier V1, the first verification operation corresponding to B1 and the second verification operation corresponding to B2 can be to check whether there are numbers in the result table, the third verification operation corresponding to A1 can be a transaction (buried numbers), and the fourth verification operation corresponding to B3 can be an expected result check.

[0074] It should be noted that Figure 5The test cases in are the test cases corresponding to the test plan V. The test record set is the set corresponding to the above-mentioned test plan. In practical applications, the test platform can respectively execute the above-mentioned S101 to S104 according to the test record sets corresponding to the multiple test plans. Each test plan has a corresponding plan identifier, each test plan corresponds to at least one test case, and each test case has a corresponding use case identifier. For example, the plan identifier of the test plan and the use case identifier of at least one test case corresponding to the test plan can have a corresponding relationship as shown in Table 2 below.

[0075] Table 2

[0076] Program Logo Use case identification V V1 V V2 V V3 W W1 W W2 …… ……

[0077] Based on the above embodiments, Figure 6 For further details on the test method provided in this application, please refer to Figure 6 Example.

[0078] Figure 6 Schematic diagram of the test method provided in the embodiment of the present application Figure 2 .like Figure 6 As shown, the testing method provided in this embodiment includes:

[0079] S201. Obtain a first record set of at least two test cases, where the first record set includes multiple first records, and each first record includes a test time and an identifier of a test system.

[0080] Optionally, the first discipline set may be determined based on at least two test cases.

[0081] Specifically, obtain the use case identifier, test system identifier, step identifier, relative time, business specific time and operation identifier corresponding to each test case; generate a first record set according to the use case identifier, test system identifier, step identifier, relative time, business specific time and operation identifier. Figure 5 The three test cases shown can generate the first record set shown in Table 3 below.

[0082] Table 3

[0083]

[0084]

[0085] It should be noted that before generating the first record set based on the use case identifier, test system identifier, step identifier, relative time, business specific time and operation identifier, it also includes: determining the test time based on the test system identifier, business specific time and relative time; generating the first record set based on the use case identifier, test system identifier, step identifier, relative time, test time and operation identifier.

[0086] For example, the present application exemplarily shows the relative time of the test system corresponding to the identifier Runbatch configured by the test platform, as shown in Table 4 below.

[0087] Table 4

[0088]

[0089] For example, the present application exemplarily shows the relative time of the test system corresponding to the identifier WtssBatch configured by the test platform, as shown in Table 5 below.

[0090] Table 5

[0091]

[0092] It should be noted that the test platform can obtain the specific business time (i.e. tradeDay, such as 20200724) of each test system (such as a financial system). For example, for the test system corresponding to the identifier Runbatch, if the relative time is 0D, the determined test time is 20200724; if the relative time is 1D, the absolute execution time is 20200725. For example, for the test system corresponding to the identifier Wtssbatch, if the relative time is 0D, the determined absolute execution time is 20200726; if the relative time is 2D, the absolute execution time is 20200728.

[0093] Furthermore, for the test system corresponding to the identifier Runbatch, if the relative time is 0D and the specific business time is 20200724, then the string tradeDay=20200724&batchType=1 can be combined; further, for the test system corresponding to the identifier Wtssbatch, if the relative time is 0D and the specific business time is 20200726, then the string tradeDay=20200726&flowName=flow1 can be composed. It should be noted that when the above two strings are exactly the same, the evaluation platform will consider that the test case points being executed by at least two test systems are the same test case, or belong to the same test plan.

[0094] S202: Determine a test record set in the first record set according to the test time and the identifier of the test system.

[0095] In another possible implementation, each first record further includes an operation identifier of a batch operation, and at least one group of second records may be determined in the first record set according to the test time and the identifier of the test system, each group of second records includes N second records, and the test time, the identifier of the test system, and the operation identifier of the batch operation included in the N second records are the same, where N is an integer greater than or equal to 2;

[0096] Deduplication processing is performed on at least one set of second records to obtain a test record set.

[0097] Specifically, the test records of the first record set may be grouped according to the test time, the identification of the test system, and the operation identification of the batch operation to obtain at least one set of second records. For example, based on the above Table 3, at least one set of second records may be determined in the first record set as shown in the following Table 6.

[0098] Table 6

[0099]

[0100]

[0101] In a possible implementation, performing deduplication processing on at least one group of second records to obtain a test record set includes: randomly deleting N-1 second records out of N second records in each group of second records to obtain the test record set.

[0102] It should be noted that each group of second records includes a different number of second records, that is, a different N. For example, one group of second records includes 3 (N=3) second records, and another group of second records includes 2 (N=2) second records.

[0103] Different from the prior art, in the prior art, in the process of testing the financial system according to its corresponding test case and the big data system according to its corresponding test case, batch operation is involved. Since the batch operation usually takes a long time, the test time of the test system (financial system, big data system) is long (usually several days, sometimes even longer), which reduces the test efficiency of the financial data processing system. In the present application, the test platform determines the test record set (Table 1) according to the first record set (Table 3), reduces the operation identifier corresponding to the batch operation, that is, reduces the number of batch operations executed by the test system, shortens the test time of the test system (usually several hours), and further improves the test efficiency of the test system.

[0104] S203: Determine a first test record to be executed in the test record set.

[0105] S204: Determine a target test system from at least two test systems according to the first test record.

[0106] Specifically, the execution method of S203 to S204 is the same as the execution method of S102 to S103. The execution process of S203 to S204 is not repeated here.

[0107] S205. Determine test information according to the first information.

[0108] The first information includes at least one of the following: an identifier of the first test record, an identifier of the first test system, or an identifier of the target test system, and the previous test record of the first test record includes the identifier of the first test system.

[0109] In a possible implementation, determining the test information according to the first information includes: if the identifier of the first test record is a preset value, determining that the test information includes a test start instruction and a test time; or,

[0110] If the identifier of the first test record is greater than the preset value, when the identifier of the first test system is the same as the identifier of the target test system, the test information includes the test time; when the identifier of the first test system is different from the identifier of the target test system, it is determined that the test information includes the test time and the test result of the first test system. The preset value can be 1 or other values.

[0111] It should be noted that when the identifier of the first test system is the same as the identifier of the target test system, the test information may also include the test data corresponding to the use case identifier in the first test record. Figure 5 For the three test cases shown, the test platform can execute the transaction (buried data) (with step identifier R1), transaction (buried data) (with step identifier R2), and assertion (with step identifier R3) of the test case (V1) to obtain the test data corresponding to the use case identifier V1; execute the transaction (buried data) (with step identifier R1), transaction (buried data) (with step identifier R2), and assertion (with step identifier R3) in the test case (V2) to obtain the test data corresponding to the use case identifier V2; execute the transaction (buried data) (with step identifier R1), assertion (with step identifier R2), and transaction (buried data) (with step identifier R3) in the test case (V3) to obtain the test data corresponding to the use case identifier V3.

[0112] The identifier of the first test record is 1, indicating the first test record in Table 1 (ie, the test record in the second row), and the first test system may be a financial system.

[0113] In a possible implementation manner, before determining that the test information includes the test time and the test result of the first test system, the method further includes: receiving the test result sent by the first test system, wherein the test result is a result obtained by the first test system performing a test operation.

[0114] S206: Send test information to the target test system.

[0115] Specifically, when the identifier of the first test record is 1, the target test system is the first test system, and the test information including the test start instruction and the test time is sent to the target test system, wherein the test start instruction instructs the first test system to perform a test operation.

[0116] In a possible implementation manner, when the test information includes a test start instruction and a test time, the test platform sends the test information to the target test system (ie, the first test system) through a preset trigger interface.

[0117] In the test method provided in this embodiment, when the test information includes a test start instruction and a test time, the test platform sends the test information to the target test system through a preset trigger interface, so that the target test system performs the test operation according to the test start instruction and the test time, so that the test system other than the target test system in at least two test systems can automatically perform the test operation according to the test time and the test result of the first test system, so that at least two test systems can share a test start instruction to automatically perform the test operation, reduce the number of triggers on the test system, and make the test of at least two test systems an automated test process, without the participation of wireless testers, shorten the test time of the test system, improve the test efficiency of the test system, and thereby improve the test efficiency of the financial data processing system including the two test systems and the operation quality after going online.

[0118] Unlike the prior art, in the prior art, there is data interaction between the financial system and the big data system, and the tester needs to verify the test results generated by the test system, resulting in a long test time. In order to shorten the test time, the financial system and the big data system are tested only through a few test cases, resulting in incomplete testing of the financial system and the big data system, and the inability to implement full regression testing, which in turn leads to great functional risks in the financial data processing system after going online, reducing the operating quality of the financial data processing system after going online. In the present application, the test record set includes a use case identifier for each test case. Therefore, after determining the target test system according to the test record set, the test information is sent to the target test system, which can avoid data interaction between at least two test systems. There is no need for the tester to verify the test results generated by the test system, shortening the test time, thereby achieving comprehensive testing of the target test system, achieving full regression testing, solving the functional risks of the test system after going online, and improving the operating quality of the test system after going online.

[0119] Based on the above embodiments, Figure 7 , Taking Table 1 as an example, when the target test system is a financial system, the method for the financial system to perform test operations according to the test time is explained.

[0120] Figure 7 A flowchart of a financial system performing a test operation provided in an embodiment of the present application. Figure 7 As shown, the method for the financial system to perform a test operation includes:

[0121] S301, receiving a test start instruction sent by a test platform through a preset trigger interface.

[0122] S302: Receive the test data corresponding to the i-th test time and the use case identifier corresponding to the i-th test time sent by the test platform through a preset trigger interface.

[0123] Optionally, S301 and S302 may be combined as follows: S301, receiving test information sent by the test platform through a preset trigger interface, the test information including a test start instruction, the i-th test time, and test data corresponding to a use case identifier corresponding to the i-th test time.

[0124] It should be noted that due to the need for repeated execution of financial systems Figure 7 The method shown, therefore, in order to save time in performing the test operation on the financial system, performs S301 and S302 separately.

[0125] S303: Execute a batch operation corresponding to the ith test time according to the ith test time and the test data corresponding to the use case identifier corresponding to the ith test time to obtain an operation result.

[0126] Optionally, there is a preset query interface between the evaluation platform and the financial system, and the test platform can query the execution status of the batch operation through the preset query interface, wherein the execution status is a successfully completed status or an executing status.

[0127] It should be noted that, in the process of repeatedly executing S301 to S303, the financial system can obtain the test results of the first test system (i.e., the financial system) (for example, intermediate variable data: generated account number, transaction amount, etc.), and store the intermediate variable data in the database of the financial system, so that the test platform can obtain the test results of the first test system and store the test results in the database (Redis).

[0128] It should be noted that the test results of the first test system include the test results corresponding to each test case. The test results corresponding to each test case are stored in the database (Redis), and the test results corresponding to each test case can be marked by the plan identifier and the case identifier. For example, the test results of the three test cases corresponding to the test plan V are identified in the database as: planVtestCase1, planVtestCase2, planVtestCase3.

[0129] S304. According to the operation result, determine whether the batch operation corresponding to the i-th test time executed by the financial system is correct.

[0130] If yes, execute S305-307.

[0131] If not, execute S308.

[0132] Specifically, after the execution status of the batch operation is found to be successfully completed in the pre-query, S304 may be executed. Further, after the execution status of the batch operation is found to be being executed in the pre-query, S304 may be executed after waiting for a preset time. For example, the preset time may be 5 seconds, 10 seconds, etc.

[0133] S305: Execute a verification operation corresponding to the batch operation to obtain a verification result corresponding to the verification operation.

[0134] It should be noted that before executing S305, the test results corresponding to the test case can be loaded into the memory corresponding to the test platform, so that the test platform can execute S305 according to the test results.

[0135] Optionally, before executing S305, it may also include determining whether there is a corresponding verification operation for the batch operation, if yes, then executing S305, if no, then executing S307. For example, in the test case corresponding to the use case identifier V1, the batch operation corresponding to the operation identifier A0 has no corresponding verification operation, and S307 may be directly executed.

[0136] S306: Determine whether the verification result is correct.

[0137] If yes, execute S307.

[0138] If not, execute S308.

[0139] Optionally, the verification result may include a result identifier, which is used to indicate whether the verification result is correct or wrong. For example, if the verification result is correct according to the result identifier, the verification result is determined to be correct; if the verification result is wrong according to the result identifier, the verification result is determined to be wrong.

[0140] S307, update i, i=i+1, repeat S302-S306, and obtain the test result of the first test system (ie, the financial system).

[0141] S308, end. Specifically, the financial system stops working and sends first failure information to the test platform, where the first failure information indicates that the financial system fails to perform the test operation.

[0142] For example, after the test platform executes a transaction (for example, opening a Class A account, corresponding to step identifier R1), another transaction (for example, depositing 100 yuan, corresponding to step identifier R2), and an assertion (for example, the account balance is 100 yuan), it sequentially executes the batch operation corresponding to A0 (the corresponding test time is 20200724)) and the batch operation corresponding to A1 (the corresponding test time is 20200725) to verify whether there is 101 yuan in the account (assuming the daily interest is 1%).

[0143] For example, an embodiment of the present application provides an execution status table as shown in Table 7 below.

[0144] Table 7

[0145] Operation Type Operation ID state runBatch A0 Successful completion runBatch A1 Executing wtssBatch B1 Executing wtssBatch B2 Executing wtssBatch B3 Executing

[0146] Table 7 is an execution status table obtained after S301 to S308 are executed for the first time. Based on Table 7, after S301 to S308 are executed again, an execution status table as shown in Table 8 can be obtained.

[0147] Table 8

[0148] Operation Type Operation ID state runBatch A0 Successful completion runBatch A1 Successful completion wtssBatch B1 Executing wtssBatch B2 Executing wtssBatch B3 Executing

[0149] Based on the above embodiments, Figure 8 ,Taking Table 1 as an example, when the target test system is a big data system, the method for the big data system to perform test operations according to the test time is explained.

[0150] In the above embodiment, during the process of the financial system obtaining the test results, the financial system verifies the operation results of each batch operation and the verification results of the verification operations corresponding to the batch operations, without the need for testers to perform verification, thereby saving the testing time of the financial system and improving the testing efficiency of the financial system.

[0151] Figure 8 A schematic diagram of a process for executing a test operation in a big data system provided in an embodiment of the present application. Figure 8 As shown, the method for executing the test operation in the big data system includes:

[0152] S401: Receive a test result of a first test system sent by a test platform.

[0153] S402: Receive the i-th test time sent by the test platform.

[0154] Optionally, S401 and S402 may be combined as follows: S401, receiving test information sent by a test platform, wherein the test information includes a test result of a first test system and an i-th test time.

[0155] Specifically, since the big data system needs to repeatedly execute S401 to S408, in order to improve test efficiency, the test result of the first test system in the test information can be received in S401, and the i-th test time can be received in S402, thereby avoiding repeated execution of S401.

[0156] S403: According to the i-th test time and the test result corresponding to the use case identifier corresponding to the i-th test time, execute the batch operation corresponding to the i-th test time to obtain the operation result.

[0157] Optionally, the execution status of the batch operation can be queried through a preset query interface between the test platform and the big data system, where the execution status is a successfully completed status or an executing status.

[0158] S404: According to the operation result, determine whether the batch operation corresponding to the i-th test time executed by the big data system is correct.

[0159] If yes, execute S405.

[0160] If not, execute S406.

[0161] Specifically, after determining that the execution status of the batch operation is successfully completed, S404 is executed. Optionally, after determining that the execution status of the batch operation is being executed, S404 may be executed after a preset time. For example, the preset time may be 5 seconds, 10 seconds, etc.

[0162] S405: Execute a verification operation corresponding to the batch operation to obtain a verification result corresponding to the verification operation.

[0163] S406: Determine whether the verification result is correct.

[0164] If yes, execute S407.

[0165] If not, execute S408.

[0166] S407, update i, i=i+1, repeat S402 to S406, and obtain the test result corresponding to the big data system.

[0167] S408, end. Specifically, the big data system stops working and sends second failure information to the test platform, where the second failure information indicates that the big data system fails to perform the test operation.

[0168] For example, based on Table 8, after S401 to S408 are executed for the first time, an execution status table as shown in Table 9 below can be obtained.

[0169] Table 9

[0170]

[0171]

[0172] In the above embodiment, during the process of the big data system obtaining the test results, the big data system verifies the operation results of each batch operation and the verification results of the verification operations corresponding to the batch operations, without the need for testers to perform verification, thereby saving the testing time of the big data system and improving the testing efficiency of the big data system.

[0173] It should be noted that the above Figure 7 and Figure 8 The test method shown is a method for serially testing a financial system and a big data system according to a plurality of test cases, in which a plurality of test cases are executed serially. Optionally, a plurality of test cases can also be executed in parallel, thereby realizing serial testing of the first subsystem and the second subsystem.

[0174] Fig. 9 A schematic diagram of the structure of the test device provided in the embodiment of the present application Figure 1 .like Fig. 9As shown, the testing device 10 includes: an acquisition module 101, a determination module 102 and a sending module 103, wherein:

[0175] The acquisition module 101 is used to acquire a test record set, where the test record set includes at least one test record;

[0176] The determination module 102 is used to determine a first test record to be executed in the test record set;

[0177] The determination module 102 is further configured to determine a target test system from among at least two test systems according to the first test record;

[0178] The sending module 103 is used to send test information to the target test system, where the test information includes the test time.

[0179] The testing device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0180] Fig.10 A schematic diagram of the structure of the test device provided in the embodiment of the present application Figure 2 .exist Fig. 9 On the basis of Fig.10 As shown, the testing device 10 further includes: a receiving module 104, wherein:

[0181] The receiving module 104 is used to receive the test result sent by the first test system before determining that the test information includes the test time and the test result of the first test system.

[0182] The testing device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0183] In a possible implementation manner, each test record includes the test time and the identification of the test system; the sending module 103 is specifically configured to:

[0184] Determine the test information according to the first information, the first information including at least one of the following: an identifier of the first test record, an identifier of the first test system, or an identifier of the target test system, the identifier of the first test system being included in a test record preceding the first test record;

[0185] Send test information to the target test system.

[0186] In a possible implementation manner, the sending module 103 is specifically configured to:

[0187] If the identifier of the first test record is a preset value, determining that the test information includes a test start instruction and a test time; or,

[0188] If the identifier of the first test record is greater than a preset value, when the identifier of the first test system is the same as the identifier of the target test system, the test information includes the test time; when the identifier of the first test system is different from the identifier of the target test system, it is determined that the test information includes the test time and the test result of the first test system.

[0189] In a possible implementation manner, the test information includes a test start instruction and a test time; the sending module 103 is specifically configured to send the test information to a target test system via a preset trigger interface.

[0190] In a possible implementation, the acquisition module 101 is specifically used for:

[0191] Obtaining a first record set of at least two test cases, wherein the first record set includes a plurality of first records, and each first record includes a test time and an identifier of a test system;

[0192] A test record set is determined in the first record set according to the test time and the identifier of the test system.

[0193] In a possible implementation manner, each first record further includes an operation identifier of a batch operation; and the acquisition module 101 is specifically configured to:

[0194] Determine at least one group of second records in the first record set according to the test time and the identifier of the test system, each group of second records includes N second records, and the test time, the identifier of the test system, and the operation identifier of the batch operation included in the N second records are the same, where N is an integer greater than or equal to 2;

[0195] Deduplication processing is performed on at least one set of second records to obtain a test record set.

[0196] In a possible implementation, the acquisition module 101 is specifically used for:

[0197] Randomly delete N-1 second records among the N second records in each group of second records to obtain a test record set.

[0198] The testing device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0199] Fig.11 Schematic diagram of the hardware structure of the test equipment provided in the embodiment of the present application. Fig.11 As shown, the test device 20 of this embodiment includes: a processor 201 and a memory 202;

[0200] Memory 202 stores computer executable instructions;

[0201] The processor 201 executes the computer-executable instructions stored in the memory 202, so that the processor 201 executes each step in the above method embodiment. For details, please refer to the relevant description in the above method embodiment.

[0202] Optionally, the memory 202 may be independent or integrated with the processor 201 .

[0203] When the memory 202 is independently provided, the test device 20 further includes a bus 203 for connecting the memory 202 and the processor 201 .

[0204] An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, each step in the above method embodiment is implemented.

[0205] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0206] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, or a network device, etc.) or a processor to perform some steps of the methods of various embodiments of the present application.

[0207] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in the invention may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0208] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.

[0209] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0210] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0211] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0212] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A testing method, characterized in that: include: Obtaining a first record set of at least two test cases, wherein the first record set includes a plurality of first records, each of which includes a test time and an identifier of a test system; the test time is determined according to the identifier of the test system, a business specific time, and a relative time; Determine a test record set in the first record set according to the test time and the identification of the test system, wherein the test record set includes at least one test record, and each test record includes at least the test time and the test system identification of the test case; Determining a first test record to be executed in the test record set; Determine a test system corresponding to the test system identifier of the first test record among the at least two test systems as a target test system; The two test systems include: a financial system and a big data system; If the identifier of the first test record is a preset value, it is determined that the test information includes the test start instruction and the test time; or, if the identifier of the first test record is greater than the preset value, when the identifier of the first test system is the same as the identifier of the target test system, it is determined that the test information includes the test time; when the identifier of the first test system is different from the identifier of the target test system, it is determined that the test information includes the test time and the test result of the first test system, and the previous test record of the first test record includes the identifier of the first test system; Sending test information to the target test system, wherein the test information includes a test time.

2. The method according to claim 1, characterized in that The test information includes a test start instruction and a test time. The sending of the test information to the target test system includes: The test information is sent to the target test system through a preset trigger interface.

3. The method according to claim 1, characterized in that Before determining that the test information includes the test time and the test result of the first test system, the method further includes: Receive the test result sent by the first test system.

4. The method according to claim 1, characterized in that: Each of the first records also includes a batch operation identifier; and determining the test record set in the first record set according to the test time and the identifier of the test system includes: Determine, in the first record set, at least one group of second records according to the test time and the identifier of the test system, each group of second records includes N second records, and the test time, the identifier of the test system, and the batch operation identifier included in the N second records are the same, wherein N is an integer greater than or equal to 2; Deduplication processing is performed on the at least one group of second records to obtain the test record set.

5. The method according to claim 4, characterized in that The performing deduplication processing on the at least one set of second records to obtain the test record set includes: Randomly delete N-1 second records among the N second records in each group of second records to obtain the test record set.

6. A testing device, characterized in that: include: Acquisition module, determination module and sending module, wherein, The acquisition module is used to acquire a first record set of at least two test cases, wherein the first record set includes a plurality of first records, each of which includes a test time and an identifier of a test system; the test time is determined according to an identifier of the test system, a business specific time, and a relative time; according to the test time and the identifier of the test system, a test record set is determined in the first record set, wherein the test record set includes at least one test record, and each test record includes at least a test time of the test case and an identifier of the test system; The determination module is used to determine a first test record to be executed in the test record set; The determination module is further used to determine a test system corresponding to the test system identifier of the first test record among at least two test systems as a target test system; the two test systems include: a financial system and a big data system; The sending module is used to, if the identifier of the first test record is a preset value, determine that the test information includes the test start instruction and the test time; or, if the identifier of the first test record is greater than the preset value, when the identifier of the first test system is the same as the identifier of the target test system, determine that the test information includes the test time; when the identifier of the first test system is different from the identifier of the target test system, determine that the test information includes the test time and the test result of the first test system, and the previous test record of the first test record includes the identifier of the first test system; send test information to the target test system, the test information including the test time.

7. A testing device, characterized in that: include: Memory and processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images