Low-code-based data quality rapid configuration method and device
The data quality configuration module is built through a low-code platform, and the user configuration mode is obtained and configured based on data quality verification rules is solved. The problem of complex construction of data middle platform and the configuration in the existing technology cannot meet actual needs, and flexible and efficient data quality configuration is achieved.
Patent Information
- Application Number
- CN202510172833.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-17
- Publication Date
- 2025-06-20
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the prior art, the construction of the data middle platform is complex and cumbersome, and data quality configuration cannot be performed according to the actual needs of users, and data detection needs in actual business scenarios cannot be met.
The data quality configuration module is built through a low-code platform, the configuration mode selected by the user is obtained, and the data quality is configured based on the data quality verification rules.
It realizes the rapid construction of data quality configuration modules, improves the flexibility and speed of data quality configuration, and can be configured according to the actual needs of users to meet the data detection needs of actual business scenarios.
Smart Images

Figure CN120179284A_ABST
Abstract
Description
Technical Field
[0001] This document relates to the field of computer technology, and particularly to a method and device for quickly configuring data quality based on low-code. Background Art
[0002] With the rapid development of big data technology, the amount of stored data and the online workload are becoming increasingly large, and data control and data governance are becoming more and more important.
[0003] In the prior art, data quality configuration is usually performed on data through a data middle platform. However, the construction of the data middle platform is relatively complex and cumbersome, and requires professional technical personnel to build it. Moreover, the data quality rules stored in the data middle platform are usually generated according to system functions or uploaded custom functions. The configuration form is relatively simple, and the semantics of the generated data quality rules are relatively simple, and it is impossible to configure according to the actual needs of users, nor can it well meet the data detection needs of actual business scenarios. Summary of the Invention
[0004] The purpose of the present invention is to provide a method and device for quickly configuring data quality based on low-code, aiming to solve the above problems in the prior art.
[0005] The present invention provides a method for quickly configuring data quality based on low-code, including:
[0006] Constructing a data quality configuration module through a low-code platform;
[0007] Obtaining a configured mode selected by a user through a configuration interface of the data quality configuration module;
[0008] Obtaining data quality verification rules through the data quality configuration module, and configuring data quality according to the data quality verification rules based on the configured mode.
[0009] The present invention provides a device for quickly configuring data quality based on low-code, including:
[0010] A construction module, configured to construct a data quality configuration module through a low-code platform;
[0011] A configuration model determination module, configured to obtain a configured mode selected by a user through a configuration interface of the data quality configuration module;
[0012] A data quality configuration module, configured to obtain data quality verification rules through the data quality configuration module, and configure data quality according to the data quality verification rules based on the configured mode.
[0013] An embodiment of the present invention further provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, the steps of the above-mentioned data quality rapid configuration method based on low-code are implemented.
[0014] An embodiment of the present invention further provides a computer-readable storage medium, on which an implementation program for information transmission is stored. When the program is executed by a processor, the steps of the above-mentioned data quality rapid configuration method based on low-code are implemented.
[0015] By adopting the embodiment of the present invention, a data quality configuration module can be quickly built, and the flexibility and rapidity of data quality configuration are improved. It can be configured according to the actual needs of users and can well meet the data detection needs of actual business scenarios. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in one or more embodiments of this specification or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in this specification. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0017] Figure 1 is a flowchart of the data quality rapid configuration method based on low-code according to an embodiment of the present invention;
[0018] Figure 2 is a schematic diagram of the data quality rapid configuration device based on low-code according to an embodiment of the present invention;
[0019] Figure 3 is a schematic diagram of the electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0020] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the following will clearly and completely describe the technical solutions in one or more embodiments of this specification with reference to the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only some embodiments of this specification, rather than all embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this document.
[0021] Method Embodiment
[0022] According to an embodiment of the present invention, a data quality rapid configuration method based on low-code is provided.Figure 1 is a flowchart of the data quality rapid configuration method based on low-code according to an embodiment of the present invention. As Figure 1 shown, the data quality rapid configuration method based on low-code according to an embodiment of the present invention specifically includes:
[0023] Step S101, constructing a data quality configuration module through a low-code platform; specifically including: on the low-code platform, in response to a node addition operation, adding a node to the logic orchestration interface; based on each node and the connection relationship between each node in the logic orchestration interface, determining a logic orchestration result; based on the logic orchestration result, constructing a data quality configuration module.
[0024] Specifically, business logic orchestration is a function provided by the low-code platform. Business logic orchestration is to help business requirements form a logical / data process through visual orchestration to form a model defined for business requirements, thereby meeting complex business requirements. It can be understood that the business logic orchestration interface is the visual interface on the low-code platform for business logic orchestration.
[0025] During the process of business logic orchestration, the user can perform a large model node addition operation through the low-code platform. The large model node addition operation here can specifically be that the user clicks the addition button of the large model node on the low-code platform interface, or the user performs a drag-and-drop operation on the low-code platform interface to drag the icon of the large model node to the business logic orchestration interface. The embodiments of the present invention do not make specific limitations on this.
[0026] Specifically, after the user operations on the business logic orchestration interface are completed, the low-code platform can perform business logic orchestration based on each node and the connection relationship between each node in the business logic orchestration interface, so as to obtain a business logic orchestration result.
[0027] Among them, the completion of the user operations on the business logic orchestration interface can be that after the user completes the addition, deletion, configuration of each visual node on the business logic orchestration interface and the addition, deletion, modification of the connection relationship between each node, clicks the save operation, or clicks the publish operation, etc. The embodiments of the present invention do not make specific limitations on this.
[0028] The connection relationships among the nodes in the business logic orchestration interface are used to represent the execution paths of the business processes formed by the business logic orchestration. It can be understood that the execution paths may include multiple nodes, and the multiple nodes determine their sequence in the execution path based on the connection relationships among the nodes. It should be noted that the connection relationships among the nodes in the business logic orchestration interface can be formed by the user's operations such as adding, deleting, and modifying the connection relationships for the low-code platform, or can be automatically generated by the low-code platform based on the positions of the nodes in the business logic orchestration interface or the sequence of adding the nodes. The embodiments of the present invention do not make specific limitations in this regard. In addition, for the case where there are multiple large model nodes among the nodes in the business logic coding interface, the multiple large model nodes can be consecutive in the execution path or separated from other types of nodes. The embodiments of the present invention do not make specific limitations in this regard.
[0029] After obtaining the business logic orchestration result, the development and construction of the application program can be carried out based on the business logic orchestration result. The business logic orchestration result here can be used as the functional implementation method in the application program development to construct the application program corresponding to the business corresponding to the business logic orchestration result.
[0030] Step S102, obtain the configured mode selected by the user through the configuration interface of the data quality configuration module; in the embodiments of the present invention, the configured mode specifically includes: function configuration mode and result configuration mode. Among them, the function configuration mode is used to configure the functions affecting the data quality, and the result configuration mode includes parameter configuration according to the required data quality result.
[0031] Step S103, obtain the data quality verification rules through the data quality configuration module, and configure the data quality based on the configured mode according to the data quality verification rules. Specifically, it includes:
[0032] Based on the configured mode, obtain the corresponding data quality configuration information in the data quality verification rules, and quickly configure the data quality based on the data quality configuration information.
[0033] Adopting the embodiments of the present invention can quickly build a data quality configuration module, improving the flexibility and rapidity of data quality configuration. It can be configured according to the actual needs of users and can well meet the data detection needs of actual business scenarios.
[0034] Device Embodiment 1
[0035] According to the embodiments of the present invention, a low-code-based data quality quick configuration device is provided. Figure 2 It is a schematic diagram of the low-code-based data quality quick configuration device according to the embodiments of the present invention, as Figure 2As shown in the figure, the low-code-based data quality rapid configuration device according to the embodiment of the present invention specifically includes:
[0036] A construction module 20, configured to construct a data quality configuration module through a low-code platform; specifically for:
[0037] On the low-code platform, in response to a node addition operation, add a node to the logic orchestration interface; based on each node and the connection relationship between nodes in the logic orchestration interface, determine the logic orchestration result; based on the logic orchestration result, construct a data quality configuration module.
[0038] A configuration model determination module 22, configured to obtain a configured mode selected by a user through a configuration interface of the data quality configuration module; the configured mode specifically includes: a function configuration mode and a result configuration mode, wherein the function configuration mode is used to configure functions affecting data quality, and the result configuration mode includes parameter configuration according to a required data quality result.
[0039] A data quality configuration module 24, configured to obtain a data quality verification rule through the data quality configuration module, and configure the data quality based on the configured mode according to the data quality verification rule. Specifically for:
[0040] Based on the configured mode, obtain corresponding data quality configuration information in the data quality verification rule, and perform rapid configuration of the data quality based on the data quality configuration information.
[0041] The embodiment of the present invention is a device embodiment corresponding to the above method embodiment. The specific operations of each module can be understood with reference to the description of the method embodiment, and will not be elaborated here.
[0042] Device Embodiment Two
[0043] The embodiment of the present invention provides an electronic device, as Figure 3 shown, including: a memory 30, a processor 32, and a computer program stored on the memory 30 and executable on the processor 32. When the computer program is executed by the processor 32, the steps described in the method embodiment are implemented.
[0044] Device Embodiment Three
[0045] The embodiment of the present invention provides a computer-readable storage medium, on which an implementation program for information transmission is stored. When the program is executed by a processor 32, the steps described in the method embodiment are implemented.
[0046] The computer-readable storage medium described in this embodiment includes, but is not limited to: ROM, RAM, a magnetic disk, or an optical disc, etc.
[0047] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the various embodiments of the present invention.
Claims
1. A low-code-based data quality rapid configuration method, characterized in that: include: Build data quality configuration modules through low-code platforms; Obtaining the configuration mode selected by the user through the configuration interface of the data quality configuration module; The data quality checking rules are acquired through the data quality configuration module, and based on the configuration mode, the data quality is configured according to the data quality checking rules.
2. The method according to claim 1, characterized in that The configuration mode specifically includes: a function configuration mode and a result configuration mode, wherein the function configuration mode is used to configure functions that affect data quality, and the result configuration mode includes parameter configuration according to the required data quality results.
3. The method according to claim 1, characterized in that Building a data quality configuration module through a low-code platform specifically includes: On the low-code platform, in response to a node addition operation, a node is added to a logical orchestration interface; based on the nodes in the logical orchestration interface and the connection relationship between the nodes, a logical orchestration result is determined; based on the logical orchestration result, a data quality configuration module is constructed.
4. The method according to claim 1, characterized in that: Based on the configuration mode, configuring the data quality according to the data quality check rule specifically includes: Based on the configuration mode, corresponding data quality configuration information in the data quality check rule is obtained, and data quality is quickly configured based on the data quality configuration information.
5. A low-code-based data quality rapid configuration device, characterized in that: include: Building modules for building data quality configuration modules through low-code platforms; A configuration model determination module, used to obtain a configuration mode selected by a user through a configuration interface of the data quality configuration module; The data quality configuration module is used to obtain data quality checking rules through the data quality configuration module, and configure the data quality according to the data quality checking rules based on the configuration mode.
6. The device according to claim 5, characterized in that The configuration mode specifically includes: a function configuration mode and a result configuration mode, wherein the function configuration mode is used to configure functions that affect data quality, and the result configuration mode includes parameter configuration according to the required data quality results.
7. The device according to claim 5, characterized in that The building blocks are specifically used for: On the low-code platform, in response to a node adding operation, adding a node to a logical orchestration interface; determining a logical orchestration result based on each node in the logical orchestration interface and a connection relationship between each node; Based on the logic arrangement result, a data quality configuration module is constructed.
8. The device according to claim 5, characterized in that The data quality configuration module is specifically used for: Based on the configuration mode, corresponding data quality configuration information in the data quality check rule is obtained, and data quality is quickly configured based on the data quality configuration information.
9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the low-code-based data quality rapid configuration method as described in any one of claims 1 to 4.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an implementation program for information transmission, and when the program is executed by the processor, the steps of the low-code-based data quality rapid configuration method as described in any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Data quality rule configuration method, data quality detection method and related device
CN116166648A
Application program construction method based on low-code platform and low-code platform
CN118444900A
Mobile communication network featuring coordinated optimization
WO2024132422A1