A test data generation platform based on banking business

Abstract

The invention discloses a test data generation platform based on banking business, including a core processing layer, a service layer and an interaction layer; the core processing layer includes a number generation engine, a cloud data management module, a rule engine and a job scheduling management module, the number generation engine completes the number generation service by calling an API, the cloud data management module is used to store the metadata of the created test data, the rule engine is used to cooperate with batch data generation and simulation message generation, as well as field rule customization and association customization between fields, and the job scheduling management module is used for execution management of number generation scripts; the service layer includes a basic data generation module, a composite data generation module, an automated test data generation module, a message data generation module and a large batch data generation module; the interaction layer includes a unified interface and an interactive interface. Through standardized definitions, componentized APIs and unified service processing, seamless integration between APIs is performed to timely meet number generation services in different business scenarios.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a test data generation platform based on banking services. Background Art

[0002] Test data preparation is a difficult problem that is difficult to avoid during the testing process. For banks, preparing test data is even more difficult. According to an internal survey of the testing team of a financial institution, test data preparation accounts for about 25% of the total testing workload. The test data required by banks must have two characteristics: 1. End-to-end. Since the banking industry has many application systems and complex businesses, ensuring the correlation of data between systems is the most basic requirement; 2. High reliability. The data must be authentic and fully simulate real business scenarios.

[0003] Large Internet companies (Ali, Tencent) have similar platforms for preparing test data, and the implementation methods are consistent. Such tools mainly generate test data through API calls, database operations, or a combination of the two. For example, the data bank of Alibaba Cloud Effect Platform and Tencent's wetest test tool have similar functions, but the usage scenarios of Internet companies and banks are different. Internet businesses are relatively simple, and the platforms for preparing test data focus on solving data problems in a single system. In addition to solving data problems in this system, this number-making tool focuses on solving cross-system and long-link transaction data preparation. However, banks have complex businesses and many related systems, and it is difficult to develop end-to-end number-making scenarios: most number-making scenarios need to span multiple systems and connect multiple interfaces in series. It is difficult for test developers to sort out the complex link relationships. In addition, even if the scenario is sorted out and added, subsequent maintenance and updates are also a problem. Summary of the invention

[0004] The present invention aims to provide a test data generation platform based on banking business to solve the problem of low data preparation efficiency in the banking industry testing process.

[0005] To achieve the above-mentioned purpose, an embodiment of the present invention provides a test data generation platform based on banking services, including a core processing layer, a service layer and an interaction layer;

[0006] The core processing layer includes a number-making engine, a cloud data management module, a rule engine, and a job scheduling management module. The number-making engine completes the number-making service by calling an API. The cloud data management module is used to store the metadata of the created test data. The rule engine is used to coordinate batch data generation and simulation message generation, as well as field rule customization and field association customization. The job scheduling management module is used for execution management of number-making scripts.

[0007] The service layer includes a basic data generation module, a composite data generation module, an automated test data generation module, a message data generation module and a bulk data generation module, and the service layer is used to provide generation services for basic data, composite data, automated test data, message data and bulk data;

[0008] The interaction layer includes a unified interface and an interaction interface, and the interaction layer is used for external interaction.

[0009] Preferably, the number-generating engine includes a request table entry unit, a log collection unit, a state tracking unit, a scenario assembly unit and an abnormality diagnosis unit.

[0010] Preferably, the rule engine includes a rule template unit, a regular expression unit, a field association unit, a rule combination unit, an enumeration management unit and a file generation unit.

[0011] Preferably, the job scheduling management module includes a breakpoint rerun unit, a shutdown restart unit, a batch concurrency unit, a business serial unit, an asynchronous response unit and a thread pool.

[0012] Preferably, the request entry unit is used to register the number creation request.

[0013] Preferably, the scenario assembly unit is used to assemble different number-making scenarios according to business.

[0014] Preferably, the breakpoint rerun unit is used to restart execution from the erroneous node when an error occurs in an intermediate link.

[0015] Preferably, the service serialization unit is used to execute dependent service scenarios in a serial manner.

[0016] In the test data generation platform based on banking business of the embodiment of the present invention, a unified result processing module is used to process the return of the result. The final number generation platform provides a flexible combination configuration page at the front end through this series of standardized processing, so that users can configure different composite number generation scenarios according to different scenarios. It solves the data preparation problem in the banking test process, meets the requirements of "end-to-end", authenticity, high availability, high success rate, and high efficiency, reduces the workload of test personnel in test data preparation during test execution, and avoids the risk of "dirty data" and environmental availability to the tested system and the entire test environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solution of the present invention, the drawings required for use in the implementation mode will be briefly introduced below. Obviously, the drawings described below are only some implementation modes of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is a structural diagram of a test data generation platform based on banking business provided by a certain embodiment of the present invention;

[0019] Figure 2 It is a structural schematic diagram of a number-generating engine of a test data generating platform based on banking business provided by the present invention;

[0020] Figure 3 It is a structural diagram of a rule engine of a test data generation platform based on banking business provided by the present invention;

[0021] Figure 4 It is a structural schematic diagram of a job scheduling management unit of a test data generation platform based on banking business provided by the present invention. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] It should be understood that the step numbers used in this article are only for the convenience of description and are not intended to limit the order in which the steps are executed.

[0024] It should be understood that the terms used in the present specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0025] The terms “include” and “comprising” indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0026] The term "and / or" means and includes any and all possible combinations of one or more of the associated listed items.

[0027] See also Figure 1 ,The embodiment of the present invention provides a test data generation platform based on banking services, including a core processing layer, a service layer and an interaction layer;

[0028] The core processing layer includes a number-making engine, a cloud data management module, a rule engine, and a job scheduling management module. The number-making engine completes the number-making service by calling an API. The cloud data management module is used to store the metadata of the created test data. The rule engine is used to coordinate batch data generation and simulation message generation, as well as field rule customization and field association customization. The job scheduling management module is used for execution management of number-making scripts.

[0029] The service layer includes a basic data generation module, a composite data generation module, an automated test data generation module, a message data generation module and a bulk data generation module, and the service layer is used to provide generation services for basic data, composite data, automated test data, message data and bulk data;

[0030] The interaction layer includes a unified interface and an interaction interface, and the interaction layer is used for external interaction.

[0031] In this embodiment, the most important parts of the entire architecture are introduced as follows: the platform is divided into three layers from top to bottom: the interaction layer, the service layer, and the core processing layer. The interaction layer includes a unified interface and an interaction interface. The interaction layer is used for external interaction. Since all number-making functions are encapsulated into number-making interfaces, the interaction layer provides a front-end interface for these number-making interfaces, which facilitates users to directly generate data through the platform. All number-making interfaces are open to the outside world and can be called by other test frameworks. The service layer is a platform that provides five major types of number-making services, including basic data, composite data, automated test data, message data, and large-volume data generation services. The core processing layer includes a number-making engine, a metadata management module, a rule engine, and a job scheduling management module. As the core part of the number-making platform, the number-making engine completes the number-making service by calling various number-making APIs. The number-making engine contains 5 sub-units, namely: request table drop unit, status tracking unit, scenario assembly unit, log collection unit, and abnormal diagnosis unit. After the scenario assembly unit receives the new scenario assembly application submitted by the user at the front end and it is approved by the administrator, it automatically connects the existing number-making interface to complete the new number-making scene and put it online; the metadata management unit is used to store the metadata of the created test data; the rule engine cooperates with batch data generation and simulation message generation functions, supports field rule customization and association customization between fields, and ensures that the generated "fake" data is close to real. The job scheduling management is used for the execution management of the number-making script.

[0032] After receiving the request for test data application, the interaction layer verifies the content of the request, the legitimacy of the parameters, the permissions and other operations, and then generates a channel information object (channelCtx) and passes it to the service layer. The service layer matches the corresponding number-making service based on the channel information, calls different components, and forms the processing link information of this request, the logical flow object (lgCtx). For example, if the debit card request passes in the ID of opening online banking, an additional component for calling online banking will be added. The core processing layer processes the business logic based on lgCtx, executes the corresponding components, and finally generates data, such as the rule processing and encryption algorithm involved in the debit card scenario.

[0033] Scenario-based API combination number generation: according to the business scenario, analyze and refine the number generation function points, encapsulate the API as a component, manage the number generation API through componentization, and then flexibly combine different number generation components according to different business scenarios and transaction links to generate composite number generation scenarios to meet different business scenarios.

[0034] See also Figure 2 In one embodiment, the number generation engine includes a request table entry unit, a log collection unit, a state tracking unit, a scenario assembly unit and an abnormality diagnosis unit.

[0035] See also Figure 3 In one embodiment, the rule engine includes a rule template unit, a regular expression unit, a field association unit, a rule combination unit, an enumeration management unit and a file generation unit.

[0036] See also Figure 4 In one embodiment, the job scheduling management module includes a breakpoint rerun unit, a shutdown restart unit, a batch concurrency unit, a business serial unit, an asynchronous response unit and a thread pool.

[0037] In one embodiment, the request entry unit is used to register the number generation request.

[0038] In this embodiment, the request table entry unit is used to register the number-generating request and write it into the table for use in task initiation, as well as subsequent task tracking and data statistics.

[0039] In a certain embodiment, the scenario assembly unit is used to assemble different number-making scenarios according to business.

[0040] In this embodiment, the scenario assembly unit is used to assemble different number-making scenarios according to business in a composite scenario to form a composite scenario, so as to make number-making more flexible.

[0041] In a certain embodiment, the breakpoint rerun unit is used to restart execution from the erroneous node when an error occurs in an intermediate link.

[0042] In this embodiment, the breakpoint rerun unit is used in a business scenario with many execution nodes. When an error occurs in an intermediate link, execution can be restarted from the error node.

[0043] In one embodiment, the service serialization unit is used to execute dependent service scenarios in a serial manner.

[0044] In this embodiment, the service serial unit is used to support serial execution of dependent service scenarios.

[0045] In the test data generation platform based on banking business of the embodiment of the present invention, a unified result processing module is used to process the return of the result. The final number generation platform provides a flexible combination configuration page at the front end through this series of standardized processing, so that users can configure different composite number generation scenarios according to different scenarios. It solves the data preparation problem in the banking test process, meets the requirements of "end-to-end", authenticity, high availability, high success rate, and high efficiency, reduces the workload of test personnel in test data preparation during test execution, and avoids the risk of "dirty data" and environmental availability to the tested system and the entire test environment.

[0046] The above is a preferred embodiment of the present invention. It should be pointed out that a person skilled in the art can make several improvements and modifications without departing from the principle of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A test data generation platform based on banking business, characterized in that: Includes core processing layer, service layer and interaction layer; The core processing layer includes a number-making engine, a cloud data management module, a rule engine, and a job scheduling management module. The number-making engine completes the number-making service by calling an API. The cloud data management module is used to store the metadata of the created test data. The rule engine is used to coordinate batch data generation and simulation message generation, as well as field rule customization and field association customization. The job scheduling management module is used for execution management of number-making scripts. The service layer includes a basic data generation module, a composite data generation module, an automated test data generation module, a message data generation module and a bulk data generation module, and the service layer is used to provide generation services for basic data, composite data, automated test data, message data and bulk data; The interaction layer includes a unified interface and an interaction interface, and the interaction layer is used for external interaction; The number generation engine includes a request table entry unit, a log collection unit, a state tracking unit, a scene assembly unit and an abnormality diagnosis unit; The scenario assembly unit is used to assemble different number-making scenarios according to business.

2. The test data generation platform based on banking business according to claim 1, characterized in that: The rule engine includes a rule template unit, a regular expression unit, a field association unit, a rule combination unit, an enumeration management unit and a file generation unit.

3. The test data generation platform based on banking business according to claim 1, characterized in that: The job scheduling management module includes a breakpoint rerun unit, a shutdown restart unit, a batch concurrency unit, a business serial unit, an asynchronous response unit and a thread pool.

4. The test data generation platform based on banking business according to claim 1, characterized in that: The request registering unit is used to register the number generation request.

5. The test data generation platform based on banking business according to claim 1, characterized in that: The scenario assembly unit is used to assemble different number-making scenarios according to business.

6. The test data generation platform based on banking business according to claim 3, characterized in that: The breakpoint rerun unit is used to restart execution from the erroneous node when an error occurs in an intermediate link.

7. The test data generation platform based on banking business according to claim 3, characterized in that: The business serialization unit is used to execute dependent business scenarios in a serial manner.

Images