System data quality state detection method and device, equipment and storage medium

Abstract

The application relates to the technical field of data processing, and specifically discloses a system data quality state detection method and device, equipment and a storage medium. The method comprises the following steps: when a data query instruction is received, querying metadata of a system database to obtain data information; when the data information meets a preset data processing condition, processing the data information based on the data processing condition to obtain target data; and comparing a preset data quality index with the target data to generate a data quality report. The method can automatically query data information of the system database, process the metadata according to a user preset data processing condition, obtain data of a target type, enable the user to obtain required accurate data, query the state of the target data according to the data quality index, further obtain a data quality report, and prompt the user, thereby reducing the data query task amount and improving the efficiency and accuracy of the data quality state query.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and particularly relates to a system data quality state detection method and device, equipment and a storage medium. BACKGROUND

[0002] Under the trend of digital transformation, the application scenarios of software are more and more, and the industry subdivision IT (Information Technology) systems also emerge in an endless stream, such as electronic transaction systems and financial payment systems used by banks and other financial institutions, and various systems realize complex functions. Whether it is system initialization or interaction between users and systems, system data quality is particularly important, and the data health state of the system needs to be grasped at all times. However, a large amount of data will increase the labor cost and the efficiency and accuracy of data monitoring are low, which will cause the system to fail to be discovered and solved in time. Therefore, how to improve the efficiency and accuracy of system data quality monitoring has become a problem to be solved. SUMMARY

[0003] The present application provides a system data quality state detection method, device, equipment and storage medium to improve the efficiency and accuracy of system data quality monitoring.

[0004] In a first aspect, the present application provides a system data quality state detection method, which comprises the following steps:

[0005] When the data query instruction is received, the metadata of the system database is queried to obtain data information;

[0006] When the data information contains data processing conditions that meet the preset conditions, the data information is processed based on the data processing conditions to obtain target data;

[0007] The preset data quality index is compared with the target data to generate a data quality report.

[0008] In a second aspect, the present application further provides a system data quality state detection device, which comprises the following modules:

[0009] A data information obtaining module is configured to query the metadata of the system database to obtain data information when the data query instruction is received;

[0010] A target data obtaining module is configured to process the data information based on the data processing conditions to obtain target data when the data information contains data processing conditions that meet the preset conditions;

[0011] The health status generation module is used to compare the preset data quality indicators with the target data and generate a data quality report.

[0012] Thirdly, this application also provides a computer device, the computer device including a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and, when executing the computer program, implement the system data quality status detection method as described above.

[0013] Fourthly, this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the system data quality status detection method described above.

[0014] This application discloses a method, apparatus, device, and storage medium for detecting the status of system data quality. Upon receiving a data query instruction, the method queries the metadata of the system database to obtain data information. When the data information meets preset data processing conditions, it processes the data information based on the data processing conditions to obtain target data. The method then compares the target data with preset data quality indicators to generate a data quality report. This method can automatically query data information in the system database and process the metadata according to the user's preset data processing conditions to obtain data of the target type, enabling users to obtain the accurate data they need. It also allows querying the status of the target data based on data quality indicators to obtain a data quality report and provide prompts to the user, reducing the workload of data querying and improving the efficiency and accuracy of data quality status query. Attached Figure Description

[0015] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 This is a schematic flowchart of a first embodiment of a system data quality status detection method provided by the embodiments of this application;

[0017] Figure 2 This is an example user interface diagram of a system data quality status detection method provided in an embodiment of this application;

[0018] Figure 3 This is a schematic flowchart of a second embodiment of a system data quality status detection method provided in this application;

[0019] Figure 4 FIG. 3 is a third embodiment of a schematic flowchart of a system data quality state detection method provided by an embodiment of the present application;

[0020] Figure 5 FIG. 4 is a schematic block diagram of a system data quality state detection device provided by an embodiment of the present application;

[0021] Figure 6 FIG. 5 is a structural schematic block diagram of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0022] The technical solutions in the embodiments of the present application will be clearly and completely described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0023] The flowchart shown in the drawings is only an example and does not necessarily include all the contents and operations / steps, nor does it necessarily execute in the order described. For example, some operations / steps can be further divided, combined or partially merged, so the actual execution order may be changed according to the actual situation.

[0024] It should be understood that the terms used in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and the appended claims of the present application, unless otherwise clear from the context, the singular forms "a", "an" and "the" are intended to include the plural forms.

[0025] It should also be understood that the term "and / or" used in the specification and the appended claims of the present application means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0026] Embodiments of the present application provide a system data quality state detection method, device, equipment and storage medium. The system data quality state detection method can be applied to a server, the system data is processed, the target data after processing is compared with the data quality index set by the user, and a data quality report is obtained, thereby improving the efficiency and accuracy of data quality state query. The server can be an independent server or a server cluster.

[0027] Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The following embodiments and features in the embodiments can be combined with each other without conflict.

[0028] Referring to Figure 1 , Figure 1 is a schematic flowchart of a system data quality state detection method provided by an embodiment of the present application. The system data quality state detection method can be applied to a server to process system data, compare the processed target data with a data quality index set by a user, obtain a data quality report, and improve the efficiency and accuracy of data quality state query.

[0029] As Figure 1 shown, the system data quality state detection method specifically includes steps S101 to S103.

[0030] S101, upon receiving a data query instruction, querying metadata of a system database to obtain data information.

[0031] In an embodiment, an electronic transaction system, a financial payment system, etc. used by a bank or other financial institution, regardless of system initialization or interaction between a user and the system, system data quality is particularly important, and the data health state of the system needs to be grasped at all times. However, a large amount of data leads to high labor costs, and manual judgment of data state is low in efficiency and accuracy. Therefore, the system itself needs to query to generate a data quality state, improve efficiency and accuracy, and ensure that the system can operate normally.

[0032] In an embodiment, a user can set a query instruction, such as a “one-key query” trigger instruction, to trigger the query instruction when data needs to be queried.

[0033] In an embodiment, after the system receives a data query instruction, it starts to query data in the system database to obtain all data information in the system.

[0034] In an embodiment, metadata information query of the system database and table is implemented, common database (such as MySQL database, PostgreSQL database, etc.) protocol matching and syntax support are implemented, and zero-intrusion of application software is implemented.

[0035] S102, when the data information contains a preset data processing condition, processing the data information based on the data processing condition to obtain target data.

[0036] Before the data information containing a preset data processing condition is processed based on the data processing condition to obtain target data, it further includes: based on a data display interface, displaying the data information to a user and receiving a first operation of the user to obtain the data processing condition.

[0037] In one embodiment, the display of data information is realized, and user interaction on the page is supported.

[0038] In specific embodiments, after the data information of the system is queried, the data is displayed to the user through a data display interface, and optional fields are displayed in the display interface to receive the first operation of the user.

[0039] In one embodiment, the sum of numbers, the number of records, and the selection of whether to exist are added, and multiple types of data are supported.

[0040] In specific embodiments, the selection of "data operation", "data filtering", "data sorting" and the like is added, and the user is given conditions through the optional fields to process the data, and the data required by the user is obtained from the numerous data. As shown in the figure, the user can input the name of the data file, the data type, the data number and the like in the interactive interface, and the target data is extracted from all data information of the system. Figure 2

[0041] In one embodiment, before the data information is processed according to the data processing condition, it is also necessary to judge whether the data processing condition is reasonable, that is, whether there is target data in the current data information that meets the data processing condition, if there is, the related data is extracted as the target data, if there is not, the user is prompted to reset.

[0042] In specific embodiments, the user sets the data processing condition according to the interactive interface, after receiving the data processing condition, it is judged whether there is data in the queried data information that meets the data processing condition, if there is, the corresponding data is extracted as the target data, if there is not, the user is prompted that there is data in the current data information that meets the filtering condition. For example, the user sets the data filtering condition as the number of 001 and 002, and extracts all data with the number of 001 and 002, if there is data with the number of 001 and 002 in the data information, it is all filtered out as the target data; if there is not, an abnormal prompt is fed back to the user.

[0043] In one embodiment, the user can set the data processing condition according to the need, extract the target data from all data information, or not set the data processing condition, and take all data information as the target data.

[0044] S103, compare the preset data quality index with the target data to generate a data quality report.

[0045] Before comparing the preset data quality index with the target data to generate a data quality report, it further includes: receiving the second operation of the user based on the optional fields in the index setting interface to obtain the data quality index.

[0046] ​After the preset data quality index is compared with the target data to generate a data quality report, the method further includes: based on the data quality report, determining problem data and analyzing the problem data to generate a data problem prompt; and sending the data problem prompt to a preset data management personnel to remind the data management personnel.

[0047] In one embodiment, the user's expected result value or condition for each item of data is increased to complete the setting of the data quality index.

[0048] In one embodiment, similar to a human health examination report, there are various check items, each check item has a normal result value or range, the health examination result reflects the value of the current health examination and is compared with the normal result value or range to prompt the normal / abnormal condition of the check item.

[0049] In specific embodiments, a second operation of the user is received through an interactive interface to obtain the data quality index set by the user, i.e., the result value or condition expected by the user for each item of data.

[0050] In one embodiment, after the setting of the data quality index and the data processing condition is completed, a built-in task execution module is called to perform according to the set condition to obtain the comparison result of each index, and a data quality report of the system data is generated according to the comparison result of all indexes.

[0051] In one embodiment, the data quality report includes current data information, the normal result value or range set by the user, and the normal / abnormal condition of the data.

[0052] In one embodiment, when there is data abnormality, the abnormal item is extracted, the abnormal item can be analyzed to obtain the reason for the abnormality, the solution to the abnormality, etc., a data problem prompt is generated to prompt the user of the data problem.

[0053] In specific embodiments, the notification of the data quality report and the data problem prompt and the notified person can be customized and set. That is, the data management personnel can specify in advance to fully support the appeal of data refinement management of different companies and different businesses to provide a prophetic guarantee capability for stable operation of the system.

[0054] In one embodiment, the data information of the system database is automatically queried, the metadata is processed according to the data processing condition preset by the user, the target type data is obtained, the user obtains the required accurate data, the state of the target data is queried according to the data quality index, and then the data quality report is obtained, and the user is prompted, thereby reducing the data query task quantity, improving the efficiency and accuracy of the data quality state query, and enabling the user to quickly query and timely master the data security state of the electronic transaction, financial payment and other financial systems. For example, a bank technician needs to monitor the data state of an electronic transaction system, and only needs to trigger a system query data information instruction, obtain the data information of the system, and input the processing condition of the data information. The system processes the data according to the processing condition, and then obtains the target data. By inputting the index expected by the user, the target data and the index can be compared, and a data state report is generated. The efficiency and accuracy of the data state query are greatly improved.

[0055] The embodiment provides a system data quality state detection method, device, equipment and storage medium. When a data query instruction is received, the metadata of a system database is queried to obtain data information. When the data information meets a preset data processing condition, the data information is processed based on the data processing condition to obtain target data. A preset data quality index is compared with the target data to generate a data quality report. The method can automatically query the data information of the system database, process the metadata according to the data processing condition preset by the user, obtain the target type data, enable the user to obtain the required accurate data, query the state of the target data according to the data quality index, and then obtain the data quality report. The user is prompted, the data query task quantity is reduced, the efficiency and accuracy of the data quality state query are improved, and the user can quickly query and timely master the data security state of the electronic transaction, financial payment and other financial systems.

[0056] Please refer to Figure 3 , Figure 3 The system data quality state detection method provided by the embodiment of the present application is a schematic flowchart of a system data quality state detection method. The system data quality state detection method can be applied to a server, used for processing system data, comparing the processed target data with a data quality index set by a user, obtaining a data quality report, and improving the efficiency and accuracy of the data quality state query.

[0057] As Figure 3 shown, before the step S102 of the system data quality state detection method, the steps S201 to S202 are further included.

[0058] S201. Determine whether there is data in the data information that meets the data processing condition;

[0059] S202. When there is no data in the data information that meets the data processing condition, an abnormal prompt is generated to remind the user to change the data processing condition again.

[0060] In one embodiment, the data processing condition can be set through optional fields in the setting interface as needed. The optional fields are the fields in the interactive interface that can be selected by the user through clicking or other operations.

[0061] In one embodiment, the user sets the data processing condition according to the interactive interface. After receiving the data processing condition, it is determined whether there is data in the queried data information that meets the data processing condition. If there is, the corresponding data is extracted as the target data. If there is not, the user is prompted that there is data in the current data information that meets the filtering condition. For example, the user sets the data filtering condition as extracting all data with numbers 001 and 002. If there is data with numbers 001 and 002 in the data information, all of them are filtered out as target data. If there is not, an abnormal prompt is fed back to the user.

[0062] In one embodiment, if the data processing condition set by the current user cannot extract related data from the data information and process it, an abnormal prompt is issued to remind the user to set it again. For example, if there is only a number in the data information of the current system data, and the user sets the data processing condition as data summation, an abnormal prompt is issued to remind the user that the current data information cannot perform summation operation. By prompting the user of the abnormal situation, the user is confirmed whether the data processing condition is input correctly, thereby ensuring the accuracy of the data processing condition and obtaining accurate target data.

[0063] In one embodiment, the user can set the data processing condition as needed to extract the target data from all data information, or can not set the data processing condition and take all data information as the target data.

[0064] The embodiment provides a system data quality state detection method, device and equipment and a storage medium. When a data query instruction is received, metadata of a system database is queried to obtain data information. It is judged whether data meeting a data processing condition exists in the data information. When no data meeting the data processing condition exists in the data information, an abnormal prompt is generated to remind a user to change the data processing condition again. When data meeting a preset data processing condition exists in the data information, the data information is processed based on the data processing condition to obtain target data. A preset data quality index is compared with the target data to generate a data quality report. The method can automatically query data information of a system database, process the metadata according to a data processing condition preset by a user, extract target data from the metadata information, make the user obtain required accurate data, query the state of the target data according to a data quality index, further obtain a data quality report, and prompt the user, thereby reducing the data query task amount and improving the efficiency and accuracy of data quality state query.

[0065] Please refer to Figure 4 , Figure 4 is a schematic flowchart of a system data quality state detection method provided by the embodiment. The system data quality state detection method can be applied to a server, used for processing system data, comparing the processed target data with a data quality index set by a user, obtaining a data quality report, and improving the efficiency and accuracy of data quality state query.

[0066] As shown in Figure 4 , the step S102 of the system data quality state detection method specifically includes steps S301-S302.

[0067] S301, when the data processing condition is a data filtering condition and a data operation condition, a task execution module is called, the data information is filtered according to the data filtering condition, and to-be-operated data is obtained.

[0068] S302, the to-be-operated data is operated based on the data operation condition, and the target data is obtained.

[0069] The data processing condition further includes a data sorting condition, the data information is processed based on the data processing condition to obtain the target data, and the processing further includes: when the data processing condition is a data operation condition and a data sorting condition, a task execution module is called, the data information is operated according to the data operation condition, and an operation result is obtained; the operation result is sorted based on the data sorting condition, and the target data is obtained.

[0070] In one embodiment, the data processing process is performed on the data information of the system according to the data processing condition set by the user.

[0071] In one embodiment, the data processing condition includes "data filtering", "data operation", "data sorting", etc. The data filtering can be filtering according to data number, data type, data corresponding value size, etc. The data operation can be data addition or subtraction. The data sorting can be ascending or descending arrangement.

[0072] In specific embodiments, multiple data processing conditions can be set at the same time. For example, after performing addition or subtraction operation on the data information of the system according to the data operation condition, the operation result is sorted to obtain the target data. According to the data filtering condition, the data information of the system is filtered, and then the filtered data is operated according to the operation condition to obtain the target data.

[0073] In one embodiment, the data information is processed by the data processing condition, and various types of data can be obtained, supporting multiple types of data judgment, making the data detection more comprehensive.

[0074] In one embodiment, the data processing condition is set by the user according to the need. If the user does not need to further extract the data information queried by the system, the user can choose to skip this step and take the data information as the target data.

[0075] The embodiment provides a system data quality state detection method, device, equipment and storage medium. When a data query instruction is received, metadata of a system database is queried to obtain data information. When the data information contains data processing conditions that meet preset conditions, the data information is processed based on the data processing conditions to obtain target data. A preset data quality index is compared with the target data to generate a data quality report. When the data information contains data processing conditions that meet preset conditions, the data information is processed based on the data processing conditions to obtain target data, including: when the data processing conditions are data filtering conditions and data operation conditions, a task execution module is called, the data information is filtered according to the data filtering conditions to obtain to-be-operated data, and the to-be-operated data is operated based on the data operation conditions to obtain the target data. The method can automatically query data information of a system database, receive data processing conditions and data quality indexes set by a user through an interactive interface, process metadata information according to the data processing conditions set by the user, obtain data of a target type, enable the user to obtain required accurate data, query a state of the target data according to the data quality index, further obtain a data quality report, and prompt the user, thereby reducing a data query task amount and improving an efficiency and accuracy of data quality state query.

[0076] Please refer to Figure 5 , Figure 5 The embodiment provides a system data quality state detection device for executing the system data quality state detection method.

[0077] As shown in Figure 5 , the system data quality state detection device 400 comprises:

[0078] A data information obtaining module 401 is configured to query metadata of a system database to obtain data information when a data query instruction is received.

[0079] A target data obtaining module 402 is configured to process the data information based on data processing conditions when the data information contains data processing conditions that meet preset conditions to obtain target data.

[0080] A health state generating module 403 is configured to compare a preset data quality index with the target data to generate a data quality report.

[0081] In one embodiment, the system data quality state detection device 400 further comprises:

[0082] The data processing condition obtaining module is configured to display the data information to a user based on a data display interface, and obtain a first operation of the user to obtain the data processing condition.

[0083] In one embodiment, the system data quality state detection apparatus 400 further comprises:

[0084] The data quality index obtaining module is configured to receive a second operation of the user based on selectable fields in an index setting interface to obtain the data quality index.

[0085] In one embodiment, the system data quality state detection apparatus 400 further comprises:

[0086] The data judging unit is configured to judge whether there is data in the data information that meets the data processing condition.

[0087] The exception prompt generating unit is configured to generate an exception prompt to remind the user to re-change the data processing condition when there is no data in the data information that meets the data processing condition.

[0088] In one embodiment, the target data obtaining module 402 comprises:

[0089] The to-be-operated data obtaining unit is configured to, when the data processing condition is a data filtering condition and a data operation condition, call a task execution module, filter the data information according to the data filtering condition, and obtain to-be-operated data.

[0090] The target data obtaining unit is configured to perform operation on the to-be-operated data based on the data operation condition to obtain the target data.

[0091] In one embodiment, the target data obtaining module 402 further comprises:

[0092] The operation result obtaining unit is configured to, when the data processing condition is a data operation condition and a data sorting condition, call a task execution module, perform relevant operation on the data information according to the data operation condition, and obtain an operation result.

[0093] The target data obtaining unit is configured to sort the operation result based on the data sorting condition to obtain the target data.

[0094] In one embodiment, the system data quality state detection apparatus 400 further comprises:

[0095] The problem prompt generating unit is configured to determine problem data based on the data quality report, analyze the problem data, and generate a data problem prompt.

[0096] The problem prompt sending unit is configured to send the data problem prompt to a preset data management personnel to remind the data management personnel.

[0097] It should be noted that, for the convenience and brevity of description, the specific working processes of the above-described device and each module can refer to the corresponding processes in the foregoing method embodiments, and will not be described here.

[0098] The above-described device can be implemented in the form of a computer program, which can run on a computer device as shown in the specification. Figure 6

[0099] Please refer to Figure 6 , Figure 6 is a structural schematic block diagram of a computer device provided by an embodiment of the present application. The computer device can be a server.

[0100] Refer to Figure 6 , the computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory can include a non-volatile storage medium and an internal memory.

[0101] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions which, when executed, can cause the processor to execute any one of the system data quality state detection methods.

[0102] The processor is configured to provide computing and control capabilities to support the operation of the entire computer device.

[0103] The internal memory provides an environment for the running of the computer program in the non-volatile storage medium, and the computer program, when executed by the processor, can cause the processor to execute any one of the system data quality state detection methods.

[0104] The network interface is configured to perform network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 6 The structure shown in the specification is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0105] ​It should be appreciated that the processor can be a central processing unit (CPU), the processor can also be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and the like. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor and the like.

[0106] In one embodiment, the processor is configured to execute a computer program stored in the memory to implement the following steps:

[0107] Upon receiving the data query instruction, querying metadata of a system database to obtain data information;

[0108] When the data information contains a preset data processing condition, processing the data information based on the data processing condition to obtain target data;

[0109] Comparing a preset data quality indicator with the target data to generate a data quality report.

[0110] In one embodiment, before the processor implements the step of processing the data information based on the data processing condition to obtain target data when the data information contains a preset data processing condition, the processor is further configured to implement the following steps:

[0111] Based on a data display interface, displaying the data information to a user and receiving a first operation of the user to obtain the data processing condition.

[0112] In one embodiment, before the processor implements the step of comparing a preset data quality indicator with the target data to generate a data quality report, the processor is further configured to implement the following steps:

[0113] Based on a selectable field in an indicator setting interface, receiving a second operation of the user to obtain the data quality indicator.

[0114] In one embodiment, before the processor implements the step of processing the data information based on the data processing condition to obtain target data when the data information contains a preset data processing condition, the processor is further configured to implement the following steps:

[0115] determining whether data meeting the data processing condition exists in the data information;

[0116] generating an exception prompt to remind a user to change the data processing condition again when the data meeting the data processing condition does not exist in the data information.

[0117] In an embodiment, the processor implements the data processing condition including a data filtering condition and a data operation condition, and when the data information is processed based on the data processing condition to obtain the target data, the processor is further configured to:

[0118] when the data processing condition is the data filtering condition and the data operation condition, calling a task execution module, filtering the data information according to the data filtering condition to obtain to-be-operated data;

[0119] performing operation on the to-be-operated data based on the data operation condition to obtain the target data.

[0120] In an embodiment, the processor implements the data processing condition further including a data sorting condition, and when the data information is processed based on the data processing condition to obtain the target data, the processor is further configured to:

[0121] when the data processing condition is the data operation condition and the data sorting condition, calling a task execution module, performing relevant operation on the data information according to the data operation condition to obtain an operation result;

[0122] sorting the operation result based on the data sorting condition to obtain the target data.

[0123] In an embodiment, after the processor implements comparing the preset data quality index with the target data to generate a data quality report, the processor is further configured to:

[0124] determining problem data based on the data quality report, analyzing the problem data to generate a data problem prompt;

[0125] sending the data problem prompt to a preset data management personnel to remind the data management personnel.

[0126] In an embodiment of the application, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program including program instructions. The processor executes the program instructions to implement any one of the system data quality state detection methods provided in the embodiments of the application.

[0127] The computer readable storage medium can be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. The computer readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, and the like.

[0128] The above merely provides the specific implementation of the present application, but the protection scope of the present application is not limited to this. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical range disclosed by the present application, and these modifications or replacements shall be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for detecting the data quality status of a system, characterized in that, include: Upon receiving a data query command, the system queries the metadata of the database to obtain the data information. When the data information contains data that meets preset data processing conditions, the data information is processed based on the data processing conditions to obtain target data; The preset data quality indicators are compared with the target data to generate a data quality report; The data processing conditions include data filtering conditions and data operation conditions. The step of processing the data information based on these conditions to obtain the target data includes: When the data processing conditions are data filtering conditions and data operation conditions, the task execution module is invoked to filter the data information according to the data filtering conditions to obtain the data to be operated. Based on the data processing conditions, the data to be processed is processed to obtain the target data; Upon receiving a data query command, the system queries the metadata of the database to obtain the data information, and then includes: When the data processing conditions do not exist, the data information is used as the target data.

2. The method for detecting system data quality status according to claim 1, characterized in that, Before processing the data information to obtain the target data based on the data processing conditions, when the data information meets the preset data processing conditions, the method further includes: Based on the data display interface, the data information is shown to the user, and the user's first operation is received to obtain the data processing conditions.

3. The method for detecting system data quality status according to claim 1, characterized in that, Before comparing the preset data quality indicators with the target data to generate a data quality report, the process also includes: Based on the optional fields in the indicator settings interface, the system receives the user's second operation and obtains the data quality indicators.

4. The method for detecting system data quality status according to claim 1, characterized in that, Before processing the data information to obtain the target data based on the data processing conditions, when the data information meets the preset data processing conditions, the method further includes: Determine whether the data information contains data that meets the data processing conditions; If no data that meets the data processing conditions is found in the data information, an error message is generated to remind the user to change the data processing conditions.

5. The method for detecting system data quality status according to claim 1, characterized in that, The data processing conditions also include data sorting conditions, and the step of processing the data information based on the data processing conditions to obtain the target data further includes: When the data processing conditions are data operation conditions and data sorting conditions, the task execution module is invoked to perform relevant operations on the data information according to the data operation conditions and obtain the operation results. Based on the data sorting conditions, the calculation results are sorted to obtain the target data.

6. The method for detecting the system data quality status according to any one of claims 1-5, characterized in that, After comparing the preset data quality indicators with the target data and generating a data quality report, the process further includes: Based on the data quality report, problematic data is identified, and the problematic data is analyzed to generate data problem prompts; The data issue notification will be sent to the designated data administrator to alert them.

7. A device for detecting the status of system data quality, characterized in that, include: The data information acquisition module is used to query the metadata of the system database to obtain data information when a data query instruction is received; The target data acquisition module is used to process the data information based on the preset data processing conditions when the data information contains data that meets the preset data processing conditions, so as to obtain target data. The health status generation module is used to compare the preset data quality indicators with the target data and generate a data quality report; The target data acquisition module includes: The data to be processed unit is used to call the task execution module to filter the data information according to the data filtering conditions and obtain the data to be processed when the data processing conditions are data filtering conditions and data processing conditions. The target data acquisition unit is used to perform operations on the data to be processed based on the data processing conditions to obtain the target data; The target data acquisition module is further configured to use the data information as the target data when the data processing conditions do not exist.

8. A computer device, characterized in that, The computer device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and, when executing the computer program, implement the method for detecting the system data quality status as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement a method for detecting the system data quality status as described in any one of claims 1 to 6.

Images