A business data construction platform and data construction method thereof

Abstract

The present invention discloses a business data construction platform and a data construction method thereof, belonging to the field of supporting software technology. The present invention is an intelligent data management platform based on the data management characteristics of securities companies and multi-level requirements, applies advanced data governance concepts to the data management of enterprises, and provides multi-dimensional, cross-departmental, and full-process data governance capabilities. Through configurable rapid deployment, data including data standards, data quality, rule models, etc. are implemented in the governance platform, assisting enterprises to fully control the data status, improve data quality, achieve data interconnection and interoperability, improve data acquisition efficiency, ensure data security and compliance, and continuously release and mine data value.

Description

Technical Field

[0001] The present invention belongs to the technical field of supporting software, and in particular relates to a business data construction platform and a data construction method thereof. Background Art

[0002] As the scope of system testing expands, more and more types of test data are required, resulting in higher costs for data construction and search during the testing process, and higher business requirements and system familiarity for testers. Summary of the invention

[0003] The technical problem to be solved by the present invention is to provide an intelligent data management platform based on the data management characteristics of securities companies and multi-level needs in response to the shortcomings of the background technology, apply advanced data governance concepts to the data management of enterprises, provide multi-dimensional, cross-departmental, and full-process data governance capabilities, and through configurable rapid deployment, implement data including data standards, data quality, rule models, etc. in the governance platform, assisting enterprises to fully control the data status, improve data quality, achieve data interconnection, improve data acquisition efficiency, ensure data security and compliance, and continuously release and mine data value.

[0004] The present invention adopts the following technical solutions to solve the above technical problems:

[0005] A business data construction platform, including a construction condition atomization module, an editable and associated input parameter module, a business assembly logic abstraction module, a construction method diversification module, an external call parameterization module and a flexible multi-environment switching module;

[0006] Among them, the conditional atomization module is constructed to set the support controller and counter for condition judgment to ensure the script

[0007] Robustness, all fields can be parameterized for both incoming and outgoing;

[0008] Editable and associated input parameter modules for environment configuration and data import, supporting parameterization of input parameter fields and

[0009] References between downstream interfaces;

[0010] The business assembly logic abstraction module is used to better describe the business and complete specific operations through business encapsulation;

[0011] Diversified construction module, used for both interface and SQL, and supports mixed mode construction;

[0012] External call parameterization module is used to support use case binding and automatically generate construction data;

[0013] Flexible multi-environment switching module for scenario script assembly to meet the needs of different business and production scenarios.

[0014] A data construction method based on a data construction platform specifically comprises the following steps;

[0015] Step 1: Business data construction platform to configure environment and import data;

[0016] Step 2: Submit requirements to the business data construction platform;

[0017] Step 3: The business data construction platform designs a script based on the requirements submitted in step 1. The script contains configurable

[0018] Configurable parameterized scripts and assembleable atomic scripts;

[0019] Step 4, script debugging: execute step by step and return interface response information and SQL return results;

[0020] Step 5: Scene construction, complete scene script assembly;

[0021] Step 6, generating a data identifier, specifically includes the following steps:

[0022] Step 6.1, select the environment and bind the data identifier to the scene;

[0023] Step 6.2, write SQL, which obtains data from the reconciliation file and database according to business needs. All data is stored in MongoDB, which is a non-relational database;

[0024] Step 6.3, write SQL according to business rules, mainly query customer number, code, and market;

[0025] Step 6.4: Use the queried data as input parameters to construct the scenario;

[0026] Step 6.5, consider giving the securities code that matches the business rule if no data is found, and the account can set a fixed value;

[0027] Step 7: Query results and logs based on data identifiers.

[0028] As a further preferred solution of the data construction method based on the data construction platform of the present invention, in step 3, the script design supports the modes of SQL, interface and SQL+interface.

[0029] As a further preferred solution of the data construction method based on the data construction platform of the present invention, the atomic script includes input parameter settings, step settings, and input and output parameter areas; it is used to set support controllers and counters for conditional judgment to ensure the robustness of the script, and all fields can be parameterized for input and output.

[0030] Compared with the prior art, the present invention adopts the above technical solution and has the following technical effects:

[0031] 1. The present invention is a full-service, multi-dimensional data governance platform. It is an intelligent data management platform based on the data management characteristics and multi-level requirements of securities companies. It applies advanced data governance concepts to the data management of enterprises, provides multi-dimensional, cross-departmental, and full-process data governance capabilities, and implements data standards, data quality, rule models, etc. in the governance platform through configurable rapid deployment, assisting enterprises to fully control the data status, improve data quality, achieve data interconnection, improve data acquisition efficiency, ensure data security and compliance, and continuously release and mine data value;

[0032] 2. The business data construction platform of the present invention realizes seamless connection with production data and batch data generation through configurable parameterized scripts and assembleable atomic scripts, thereby improving test efficiency. At the same time, it standardizes and platformizes the test data structure and lowers the threshold for users. General testers do not need to be familiar with the business, counters and databases to complete the task of business data generation. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a functional principle diagram of the data-based construction platform of the present invention;

[0034] Figure 2 It is a flow chart of the data construction method based on the data construction platform of the present invention;

[0035] Figure 3 It is a system architecture diagram of the data construction platform based on the present invention. DETAILED DESCRIPTION

[0036] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings:

[0037] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] like Figures 1 to 3 As shown, a business data construction platform, such as Figure 1 As shown, it includes a construction condition atomization module, an editable and associated parameter input module, a business assembly logic abstraction module, a construction method diversification module, an external call parameterization module and a flexible multi-environment switching module;

[0039] Among them, the conditional atomization module is constructed to set the support controller and counter for condition judgment to ensure the script

[0040] Robustness, all fields can be parameterized for both incoming and outgoing;

[0041] Can edit and associate input parameter modules for environment configuration and data import; supports parameterization of input parameter fields and

[0042] References between downstream interfaces;

[0043] The business assembly logic abstraction module is used to better describe the business and complete specific operations through business encapsulation;

[0044] Diversified construction module, used for both interface and SQL, and supports mixed mode construction;

[0045] External call parameterization module is used to support use case binding and automatically generate construction data;

[0046] Flexible multi-environment switching module for scenario script assembly to meet the needs of different business and production scenarios.

[0047] A data construction method based on a data construction platform, such as Figure 1 As shown, the data construction example of Everbright Securities project includes the following steps:

[0048] Step 1: Business data construction platform to configure environment and import data;

[0049] Step 2: Submit requirements to the business data construction platform;

[0050] Step 3: The business data construction platform designs a script based on the requirements submitted in step 1. The script contains configurable

[0051] Configurable parameterized scripts and assembleable atomic scripts;

[0052] Step 4, script debugging: execute step by step and return interface response information and SQL return results;

[0053] Step 5: Scene construction, complete scene script assembly;

[0054] Step 6, generating a data identifier, specifically includes the following steps:

[0055] Step 6.1, select the environment and bind the data identifier to the scene;

[0056] Step 6.2, write SQL, which obtains data from the reconciliation file and database according to business needs. All data is stored in MongoDB, which is a non-relational database;

[0057] Step 6.3, write SQL according to business rules, mainly query customer number, code, and market;

[0058] Step 6.4: Use the queried data as input parameters to construct the scenario;

[0059] Step 6.5, consider giving the securities code that matches the business rule if no data is found, and the account can set a fixed value;

[0060] Step 7: Query results and logs based on data identifiers.

[0061] In step 3, the script is designed to support SQL, interface, and SQL+interface modes.

[0062] The atomic script includes input parameter settings, step settings, and input and output parameter areas; it is used to set support controllers and counters for conditional judgment to ensure the robustness of the script. All fields can be parameterized for input and output.

[0063] like Figure 3 As shown, the present invention is a full-business, multi-dimensional data governance platform. It is an intelligent data management platform based on the data management characteristics and multi-level needs of securities companies. It applies advanced data governance concepts to the data management of enterprises, and provides multi-dimensional, cross-departmental, and full-process data governance capabilities. Through configurable rapid deployment, data including data standards, data quality, rule models, etc. are implemented in the governance platform, assisting enterprises to fully control the data status, improve data quality, achieve data interconnection, improve data acquisition efficiency, ensure data security and compliance, and continuously release and mine data value.

[0064] The business data construction platform of the present invention realizes seamless connection with production data and batch data generation through configurable parameterized scripts and assembleable atomic scripts, thereby improving test efficiency. At the same time, it standardizes and platformizes the test data structure and lowers the threshold for users. General testers do not need to be familiar with the business, counters and databases to complete the task of business data generation.

[0065] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as generally understood by those skilled in the art in the art to which the present invention belongs. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless defined as herein.

[0066] The above embodiments are only for explaining the technical idea of ​​the present invention, and cannot be used to limit the protection scope of the present invention. Any changes made on the basis of the technical solution according to the technical idea proposed by the present invention shall fall within the protection scope of the present invention. The above embodiments of the present invention are described in detail, but the present invention is not limited to the above embodiments. Various changes can be made within the knowledge scope of ordinary technicians in this field without departing from the purpose of the present invention.

[0067] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A business data construction platform, characterized by: Contains construction condition atomization module, editable and associated input parameters Modules, business assembly logic abstraction modules, diversified construction modules, external call parameterization modules and flexible multi-environment switching modules; Among them, the conditional atomization module is constructed to set the support controller and counter for condition judgment to ensure the script Robustness, all fields are parameterized for both incoming and outgoing; Editable and associated input parameter modules for environment configuration and data import, supporting parameterization of input parameter fields and References between downstream interfaces; The business assembly logic abstraction module is used to better describe the business and complete specific operations through business encapsulation; Diversified construction module, used for both interface and SQL, and supports mixed mode construction; External call parameterization module is used to support use case binding and automatically generate construction data; Flexible multi-environment switching module for scenario script assembly to meet the needs of different business and production scenarios; The specific steps include: Step 1: Business data construction platform to configure environment and import data; Step 2: Submit requirements to the business data construction platform; Step 3: The business data construction platform designs a script based on the requirements submitted in step 1. The script contains configurable Configurable parameterized scripts and assembleable atomic scripts; Step 4, script debugging: execute step by step and return interface response information and SQL return results; Step 5: Scene construction, complete scene script assembly; Step 6, generating a data identifier, specifically includes the following steps: Step 6.1, select the environment and bind the data identifier to the scene; Step 6.2, write SQL, which obtains data from the reconciliation file and database according to business needs. All data is stored in MongoDB, which is a non-relational database; Step 6.3, write SQL according to business rules, mainly query customer number, code, and market; Step 6.4: Use the queried data as input parameters to construct the scenario; Step 6.5, consider setting a fixed value for the account for the securities code that matches the business rule if no data is found; Step 7: Query results and logs based on data identifiers.

2. A business data construction platform according to claim 1, characterized in that: In step 3, the script is designed to support SQL, interface, and SQL+interface modes.

3. A business data construction platform according to claim 2, characterized in that: The atomic script includes input parameter settings, step settings, and input and output parameter areas; it is used to set support controllers and counters for conditional judgment to ensure the robustness of the script. All fields are parameterized for input and output.

Images