Data quality supervision method, device and equipment for data submission task

Abstract

The embodiment of the invention provides a data quality supervision method, device and equipment for a data submission task. According to the specific implementation scheme, the method comprises the steps of obtaining a target verification result of each core index of a target data submission task reported by a task processing platform; carrying out transaction index positioning on each core index; in response to the obtained at least one transaction index, displaying each determined transaction index on a first interface; determining each specified index corresponding to the transaction index and acquiring a verification result of each specified index; generating a link diagram corresponding to the abnormal index based on an association relationship between the abnormal index and each specified index and a verification result of each specified index; and displaying the link diagram on a second interface to determine the transaction source index of the transaction index. Therefore, according to the scheme, positioning and traceability of the core index with the transaction condition can be realized, so that an implementation basis is provided for quality management of the submission task.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method, device and equipment for monitoring data quality for data reporting tasks. Background Art

[0002] As the regulatory system becomes more and more sophisticated, securities companies will have many data reporting tasks to report regulatory data to regulatory agencies. Securities companies need to organize and report data for data reporting tasks. If the reporting result returns failure, it means that some indicators in the regulatory data reported by the data reporting task have errors. In the process of implementing this application, the applicant found that there are usually some core indicators in the data reporting task, which affect whether the regulatory reporting task is successfully submitted. Therefore, if the core indicators with abnormal changes can be analyzed in time and the core indicators with abnormal changes can be traced, it is very important for the data quality management of the data reporting task during the reporting process.

[0003] Therefore, there is an urgent need for a data supervision method for data reporting tasks to locate and trace the core indicators with abnormal changes, thereby providing a basis for the quality management of reporting tasks. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a data quality supervision method, device and equipment for data reporting tasks, so as to locate and trace the core indicators with abnormal conditions, thereby providing a basis for implementing the data quality supervision method for data reporting tasks. The specific technical solution is as follows:

[0005] In a first aspect, the present application provides a data quality supervision method for a data reporting task, the method being applied to an integrated platform for data reporting task management and control, the integrated platform communicating with a task processing platform for processing data reporting tasks; the method comprising:

[0006] In response to a user's instruction to view the abnormal indicators of the target data reporting task, the target verification results of each core indicator of the target data reporting task reported by the task processing platform are obtained; wherein the target verification result of each core indicator is the verification result obtained by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task;

[0007] Based on the target verification results of each core indicator, locate the abnormal indicators of each core indicator; wherein the abnormal indicators are core indicators whose target verification results indicate that they have failed the verification;

[0008] In response to obtaining at least one abnormal indicator, displaying each determined abnormal indicator on a first interface;

[0009] In response to a tracking instruction issued by the user through the first interface for any abnormal indicator, each designated indicator corresponding to the abnormal indicator is determined and a verification result of each designated indicator is obtained; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using the verification rule corresponding to the designated indicator in the verification rule set;

[0010] Based on the association between the abnormal indicator and each designated indicator, and the verification results of each designated indicator, a link graph corresponding to the abnormal indicator is generated; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has the verification result of the indicator represented by the node;

[0011] The link diagram is displayed on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

[0012] Optionally, the task processing platform verifies each core indicator using a predetermined verification rule corresponding to the core indicator, including:

[0013] For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period;

[0014] If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

[0015] Optionally, there are multiple verification rule sets, and each verification rule set is set for at least one task processing stage among multiple task processing stages of the target data reporting task;

[0016] The process of determining the verification results of each analysis indicator in the target data reporting task includes:

[0017] In each task processing stage of the target data reporting task, the verification rule set for the task processing stage is used to verify the objects to be verified in the task processing stage, and the verification results corresponding to the task processing stage are obtained. From the verification results corresponding to the task processing stage, the verification results of the analysis indicators existing in the task processing stage are determined; wherein the objects to be verified include the analysis indicators existing in the task processing stage.

[0018] Optionally, there are multiple task processing platforms, and the multiple task processing platforms include a target development platform and a report submission platform; the multiple task processing stages include: a source data acquisition stage, a source data processing stage, and a report data submission stage;

[0019] In each task processing stage of the target data reporting task, the verification rule set set for the task processing stage is used to verify the object to be verified in the task processing stage, and the verification result corresponding to the task processing stage is obtained, including:

[0020] In the source data acquisition phase of the target data reporting task, the target development platform performs verification on the first type of objects existing in the source data acquisition phase using the verification rule set for the source data acquisition phase to obtain verification results of the first type of objects; the first type of objects belong to the objects to be verified in the source data;

[0021] In the source data processing stage of the target data reporting task, the target development platform verifies the second type of objects existing in the source data processing stage using the verification rule set for the source data processing stage to obtain the verification result of the second type of objects; the second type of objects belong to the objects to be verified in the target processing data; the target processing data is the data obtained after processing the source data;

[0022] During the report data reporting stage of the target data reporting task, the report reporting platform performs verification on the third category objects existing in the report data reporting stage using the verification rule set for the report data reporting stage to obtain verification results for the third category objects; the third category objects belong to the objects to be verified in the report generated based on the target processing data.

[0023] Optionally, each verification rule in the verification rule set has a corresponding verification level; the verification level represents the importance of the verification rule;

[0024] The method further comprises:

[0025] In response to a verification rule running result viewing instruction issued by a user, the running result of each target verification rule is determined from a plurality of candidate verification rules; wherein the candidate verification rule is a verification rule in the verification rule set that has been run to completion during the processing of the target data reporting task; and the target verification rule is a verification rule whose verification level is greater than a predetermined level threshold;

[0026] The third interface displays the running results of each target verification rule.

[0027] Optionally, the method further includes:

[0028] In response to a user's instruction to view the task execution status of the target data reporting task, based on the task execution status of each data processing stage of the target data reporting task obtained from the task processing platform, the task execution status of the target data reporting task is displayed in the form of a flowchart on the fourth interface; wherein each node of the flowchart of the target reporting task represents a task processing stage of the target reporting task, and each node has a mark representing the execution status of the task processing stage;

[0029] In response to a user's instruction to generate a quality evaluation report for a specified object, a quality evaluation report for the specified object is generated based on a change indicator related to the specified object; wherein the specified object includes: a specified data submission task, a specified submission deadline, or a specified report;

[0030] In response to a user's instruction to view the reporting execution status of a specified report for a target data reporting task, the reporting execution status of the specified report is displayed in the form of a flowchart on the fifth interface based on the reporting execution status of the specified report obtained from the task processing platform; wherein each node of the flowchart of the specified report represents a reporting stage of the specified report, and each node has a mark representing the reporting execution status.

[0031] In a second aspect, the present application provides a data quality supervision method device for a data reporting task, the device is applied to an integrated platform for data reporting task management and control, the integrated platform communicates with a task processing platform for processing data reporting tasks; the device includes:

[0032] An acquisition module is used to respond to a user's instruction to view the abnormal indicators of the target data reporting task, and to obtain the target verification results of each core indicator of the target data reporting task reported by the task processing platform; wherein the target verification result of each core indicator is the verification result obtained by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task;

[0033] A positioning module, used to locate the abnormal indicators of each core indicator based on the target verification results of each core indicator; wherein the abnormal indicator is a core indicator whose target verification result indicates that the verification has failed;

[0034] A first display module, configured to display each determined abnormal indicator on a first interface in response to obtaining at least one abnormal indicator;

[0035] A first determination module is used to respond to a tracking instruction issued by a user through the first interface for any abnormal indicator, determine each designated indicator corresponding to the abnormal indicator and obtain a verification result of each designated indicator; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using a verification rule corresponding to the designated indicator in the verification rule set;

[0036] A generation module is used to generate a link graph corresponding to the abnormal indicator based on the association relationship between the abnormal indicator and each specified indicator, and the verification results of each specified indicator; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has a verification result of the indicator represented by the node;

[0037] The second display module is used to display the link diagram on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

[0038] Optionally, the task processing platform verifies each core indicator using a predetermined verification rule corresponding to the core indicator, including:

[0039] For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period;

[0040] If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

[0041] In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0042] Memory, used to store computer programs;

[0043] The processor is used to implement any of the above-mentioned data quality supervision methods when executing the program stored in the memory.

[0044] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements any of the above-mentioned data quality supervision methods.

[0045] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the above-described methods for data quality supervision for data reporting tasks.

[0046] Beneficial effects of the embodiments of the present application:

[0047] In the scheme of the embodiment of the present application, the integrated platform can obtain the target verification results of each core indicator of the data reporting task, determine that the core indicator that fails the target verification result is an abnormal indicator, so as to realize the positioning of each core indicator with respect to the abnormal indicator, and display each abnormal indicator on the first interface of the integrated platform. In addition, after the user issues a tracking instruction for any abnormal indicator on the first interface, the association relationship between the abnormal indicator and each designated indicator of the abnormal indicator, as well as the verification results of each designated indicator, can be used to generate the corresponding link diagram of the abnormal indicator, and display it to determine the abnormal source indicator of the abnormal indicator. It can be seen that the scheme of the present application can realize the positioning and tracing of the core indicators with abnormal conditions, thereby providing a basis for the quality management of the reporting task.

[0048] Of course, implementing any product or method of the present application does not necessarily require achieving all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0050] Figure 1 A flowchart of a data quality supervision method for a data reporting task provided in an embodiment of the present application;

[0051] Figure 2 A schematic diagram of a link of an abnormal indicator provided in an embodiment of the present application;

[0052] Figure 3 A schematic diagram of the structure of an integrated platform device provided in an embodiment of the present application;

[0053] Figure 4 A schematic diagram of the structure of a data quality monitoring device for a data reporting task provided in an embodiment of the present application;

[0054] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field based on the present application belong to the scope of protection of the present application.

[0056] In order to locate and trace the core indicators with abnormal changes, the embodiments of the present application provide a data quality supervision method, device and equipment for data reporting tasks.

[0057] First, the following is an introduction to a data quality supervision method for data reporting tasks provided in an embodiment of the present application. The data quality supervision method for data reporting tasks provided in this embodiment can be applied to an integrated platform for data reporting task management and control; the integrated platform communicates with a task processing platform for processing data reporting tasks; the integrated platform can be deployed on a terminal device or on a server. Exemplarily, the terminal device can be a tablet computer, a desktop computer, etc.; this application does not limit this.

[0058] Among them, a data quality supervision method for a data reporting task provided in an embodiment of the present application may include:

[0059] In response to a user's instruction to view the abnormal indicators of the target data reporting task, the target verification results of each core indicator of the target data reporting task reported by the task processing platform are obtained; wherein the target verification result of each core indicator is the verification result obtained by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task;

[0060] Based on the target verification results of each core indicator, locate the abnormal indicators of each core indicator; wherein the abnormal indicators are core indicators whose target verification results indicate that they have failed the verification;

[0061] In response to obtaining at least one abnormal indicator, displaying each determined abnormal indicator on a first interface;

[0062] In response to a tracking instruction issued by the user through the first interface for any abnormal indicator, each designated indicator corresponding to the abnormal indicator is determined and a verification result of each designated indicator is obtained; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using the verification rule corresponding to the designated indicator in the verification rule set;

[0063] Based on the association between the abnormal indicator and each designated indicator, and the verification results of each designated indicator, a link graph corresponding to the abnormal indicator is generated; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has the verification result of the indicator represented by the node;

[0064] The link diagram is displayed on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

[0065] In the scheme of the embodiment of the present application, the integrated platform can obtain the target verification results of each core indicator of the data reporting task, determine that the core indicator that fails the target verification result is an abnormal indicator, so as to realize the positioning of each core indicator with respect to the abnormal indicator, and display each abnormal indicator on the first interface of the integrated platform. In addition, after the user issues a tracking instruction for any abnormal indicator on the first interface, the association relationship between the abnormal indicator and each designated indicator of the abnormal indicator, as well as the verification results of each designated indicator, can be used to generate the corresponding link diagram of the abnormal indicator, and display it to determine the abnormal source indicator of the abnormal indicator. It can be seen that the scheme of the present application can realize the positioning and tracing of the core indicators with abnormal conditions, thereby providing a basis for the quality management of the reporting task.

[0066] like Figure 1 As shown, a data quality supervision method for a data reporting task provided by an embodiment of the present application may include the following steps:

[0067] S101, in response to the user's instruction to view abnormal indicators of the target data reporting task, obtain the target verification results of each core indicator of the target data reporting task reported by the task processing platform; wherein, the target verification result of each core indicator is the verification result determined by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task.

[0068] The specific application scenario of the scheme of the present application may be: the scenario in which various securities companies and banks and other objects with regulatory reporting requirements make regulatory reports to the regulatory authorities. The data reporting tasks described in the present application may refer to the various regulatory reporting tasks stipulated by the regulatory authorities. Exemplarily, for the CSI quotation income certificate reporting task, the issuer, product type, knock-in and knock-out design, investor holdings and other relevant statistical data of the income certificates may be reported to the regulatory authorities one by one. It is understandable that the user can issue an abnormal indicator viewing instruction for the target data reporting task during the execution process of the target data reporting task and at any time point after the task is executed. Therefore, the integrated platform can obtain the target verification results of each core indicator of the target data reporting task that has been reported by the task processing platform at the current time point based on the abnormal indicator viewing instruction for the target data reporting task received at the current time point.

[0069] The data quality supervision method for data reporting tasks of the present application is applied to an integrated platform for data reporting task management and control, and the integrated platform communicates with a task processing platform for processing data reporting tasks. The task processing platform is used to complete data reporting tasks, for example, it can complete functions such as source data acquisition, source data processing, report generation, and report submission. The integrated platform of the present application can communicate with the task processing platform to obtain various data of the target data reporting task during its operation, thereby realizing real-time monitoring of the target data reporting task.

[0070] The indicators involved in the data reporting task are all known in advance, so this application can select the indicators with high importance as core indicators according to their importance. This application can select core indicators for different scenarios and different data reporting tasks according to the needs of the current scenario, and this application does not limit the selection of core indicators.

[0071] The present application sets a corresponding verification rule set for the target data reporting task. Each verification rule in the verification rule set can be used to determine the indicator status of the indicator applicable to the verification rule in the target data reporting task. For each indicator, after verifying the indicator using the verification rule corresponding to the indicator, if the verification result is passed, it means that the indicator status of the indicator is normal, otherwise it is abnormal. The predetermined verification rules corresponding to the core indicators belong to the verification rules in the verification rule set. And it can be understood that there is a corresponding relationship between the indicators and the verification rules. Any indicator can be verified using the verification rule corresponding to the indicator. For example, rule 1 and indicator A have a corresponding relationship, then rule 1 can only be used to verify indicator A.

[0072] Optionally, the task processing platform verifies each core indicator using a predetermined verification rule corresponding to the core indicator, including:

[0073] For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period;

[0074] If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

[0075] It is understandable that data reporting tasks are usually executed periodically, for example, in units of weeks, months or years, and this application does not limit the period. Therefore, when data reporting tasks are executed in different reporting periods, the index value of the same indicator of the data reporting task is usually stable. If the index value of a certain indicator differs too much in different reporting periods, then the indicator may be abnormal in a certain reporting period.

[0076] The historical reporting period may be the previous reporting period of the current reporting period, or may be any selected historical reporting period.

[0077] This application sets a corresponding threshold for each core indicator. If the difference between the value of the core indicator in the current reporting period and the value of the core indicator in the historical reporting period is greater than the threshold of the core indicator, it means that the indicator has changed. Moreover, the threshold of each core indicator is set for the core indicator, and the thresholds of different core indicators may be different.

[0078] The above embodiment is only one of the predetermined verification rules corresponding to the core indicator. It can be understood that there may be multiple predetermined verification rules for the core indicator. For example, for core indicator A, the verification rule is that the value of core indicator A is greater than 0. For core indicator B, the verification rule is that the index value of core indicator B is the index value of indicator C minus the index value of indicator D. Since the indicators involved in different data reporting tasks may be different, the core indicators in different data reporting tasks and the predetermined verification rules corresponding to each core indicator may be different, and this application is not limited here.

[0079] After the task processing platform verifies each core indicator of the target data reporting task using the predetermined verification rules corresponding to the core indicator and obtains the verification result, it can send the verification result of the core indicator to the integrated platform. That is, the integrated platform can obtain the verification result of the core indicator of the task processing platform in real time.

[0080] S102, based on the target verification results of each core indicator, locate the abnormal indicator of each core indicator; wherein the abnormal indicator is a core indicator whose target verification result indicates that the verification has failed;

[0081] The method for the squadron in this application to locate abnormal indicators for each core indicator can be: based on the target verification results of each core indicator of the target data reporting task, the core indicator with a failed target verification result can be used as an abnormal indicator.

[0082] S103, in response to obtaining at least one abnormal indicator, displaying each determined abnormal indicator on the first interface;

[0083] Based on the contents of the above embodiments, it can be known that after the user issues an instruction to view the abnormal indicators of the target data reporting task at different time points in the execution process of the target data reporting task, the target verification results of the core indicators of the target data reporting task reported by the task processing platform are different, resulting in differences in the abnormal indicators determined at different time points. Therefore, even for the same data reporting task, the determined abnormal indicators displayed on the first interface may be different at different time points.

[0084] Of course, if the user issues a command to view the abnormal indicators of the target data reporting task after the target data reporting task is completed, all abnormal indicators determined in the target data reporting task can be displayed on the first interface.

[0085] S104, in response to a tracking instruction issued by the user through the first interface for any abnormal indicator, determining each designated indicator corresponding to the abnormal indicator and obtaining verification results of each designated indicator; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using the verification rule corresponding to the designated indicator in the verification rule set;

[0086] In the first interface, each abnormal indicator has a corresponding tracking button. If the user clicks the tracking button of any abnormal indicator, the tracking instruction for the abnormal indicator can be triggered.

[0087] The index associated with the abnormal index may refer to the upstream index of the abnormal index and the index associated with the upstream index; and the index associated with any index includes: the upstream index of the index and the index associated with the upstream index of the index. That is, the index associated with the abnormal index is an index that has an impact on the generation of the index value of the abnormal index. Exemplarily, using index A to calculate index B, using index B to calculate index C, and using index C to calculate index D, then index A, index B and index C are all indicators associated with index D.

[0088] In the present application, there are multiple ways to determine the designated indicators corresponding to each abnormal indicator. In one implementation, since the indicators in the target task are known in advance, the designated indicators corresponding to each abnormal indicator can be determined in advance.

[0089] In another implementation, for each upstream indicator and the downstream indicator corresponding to the upstream indicator, a target tag representing the upstream and downstream relationship between the two can be marked, so that the target tags can be used to determine the designated indicators corresponding to the abnormal indicators. For example, the target tag of indicator A is 1, the target tag of indicator B is 2, the target tag of indicator C is 3, and the target tag of indicator D is 4. The relationship between the target tags is: 1 and 2 are upstream and downstream, 2 and 3 are upstream and downstream, and 3 and 4 are upstream and downstream. Therefore, when indicator D is an abnormal indicator, the designated indicators corresponding to indicator D can be determined as indicator A, indicator B and indicator C. In addition, in this implementation, an indicator can have multiple tags. For example, indicator X can be the upstream indicator of two indicators, indicator Y and indicator Z. Then indicator X can have tags a and c, indicator Y can have tag b, and indicator z can have tag d, where tags a and b can represent the upstream and downstream relationship, and tags c and d can represent the upstream and downstream relationship. In addition, the tags representing the upstream and downstream relationship are unique and will not be repeated.

[0090] It is understandable that, usually, each designated indicator corresponding to the abnormal indicator already exists before the abnormal indicator is determined, so the verification results of each designated indicator corresponding to the abnormal indicator also already exist, and since the verification results of the verified indicators by the task processing platform can be uploaded to the integrated platform in real time, that is, whether it is a core indicator or a non-core indicator, after being verified, the verification results can be uploaded to the integrated platform in real time. Therefore, the verification results of each designated indicator corresponding to the abnormal indicator can be determined from the verification results of each indicator uploaded by the task processing platform.

[0091] In the present application, each indicator can be verified using the verification rules in the verification rule set.

[0092] Optionally, there are multiple verification rule sets, and each verification rule set is set for at least one task processing stage among multiple task processing stages of the target data reporting task;

[0093] There are multiple task processing platforms, including a target development platform and a report submission platform; the multiple task processing stages include: a source data acquisition stage, a source data processing stage and a report data submission stage.

[0094] In the present application, each data reporting task can be divided into multiple task processing stages, among which the source data acquisition stage, the source data processing stage and the report data reporting stage can be the stages in the multiple task processing stages that can be used for verification.

[0095] The processing of the entire data reporting task can be completed by the joint collaboration of multiple task processing platforms, which include a target development platform and a report reporting platform. The target development platform is used to obtain source data from various data sources corresponding to the data reporting task, and process the obtained source data, and send the processed source data to the report reporting platform; the report reporting platform generates a report corresponding to the data reporting task based on the processed source data obtained from the target development platform, and submits the generated report to the reporting target, such as the regulatory department.

[0096] The process of determining the verification results of each analysis indicator in the target data reporting task includes:

[0097] In each task processing stage of the target data reporting task, the verification rule set for the task processing stage is used to verify the objects to be verified in the task processing stage, and the verification results corresponding to the task processing stage are obtained. From the verification results corresponding to the task processing stage, the verification results of the analysis indicators existing in the task processing stage are determined; wherein the objects to be verified include the analysis indicators existing in the task processing stage.

[0098] In this application, the verification objects targeted by the verification rules may include objects such as indicators, fields and / or regions. For example, "UPD_date has current period data" is a verification rule for a field, and "the value of area A in Table 1 is greater than 0" is a verification rule for a region. The specific contents of the verification rules and verification objects of this application can be set according to specific tasks, and different tasks may vary, which is not limited in this application.

[0099] Wherein, in each task processing stage of the target data reporting task, using the verification rule set for the task processing stage, verifying the to-be-verified object existing in the task processing stage, and obtaining the verification result corresponding to the task processing stage, including: steps A1-A3;

[0100] Step A1, in the source data acquisition stage of the target data reporting task, the target development platform verifies the first type of indicators existing in the source data acquisition stage using the verification rule set for the source data acquisition stage to obtain the verification results of the first type of indicators; the first type of indicators belong to the analysis indicators in the source data;

[0101] Step A2, in the source data processing stage of the target data reporting task, the target development platform verifies the second type of objects existing in the source data processing stage using the verification rule set for the source data processing stage to obtain the verification result of the second type of objects; the second type of objects belong to the objects to be verified in the target processing data; the target processing data is the data obtained after processing the source data;

[0102] Step A3, during the report data reporting stage of the target data reporting task, the report reporting platform performs verification on the third category objects existing in the report data reporting stage using the verification rule set for the report data reporting stage to obtain verification results for the third category objects; the third category objects belong to the objects to be verified in the report generated based on the target processing data.

[0103] It can be understood that the target processing data is the data obtained after processing the source data, and the objects to be verified in the report are generated based on the target processing data, that is, the objects to be verified in the report can also be obtained after processing based on the target processing data. It can be seen that the objects to be verified involved in different task processing stages are different. Therefore, in different task processing stages, the present application sets a set of verification rules that matches the current task processing stage, which is used to verify each object to be verified in different task processing stages. Each task processing platform can upload the verification results of the verified objects to the integrated platform in real time.

[0104] The solution of this embodiment can advance the cross-checking by completing the corresponding verifications at different stages in multiple running stages of the target data reporting task, and no longer concentrate the verification of the reported data at the last stage of the reporting task, thereby realizing early detection and early resolution of problems.

[0105] In the present application, each target core indicator can be an indicator among the analysis indicators of any task processing stage in multiple task processing stages. For example, core indicator A can be an indicator among the analysis indicators of the first category of objects involved in the source data acquisition stage, core indicator B can be an indicator among the analysis indicators of the second category of objects involved in the source data processing stage, and core indicator C can be an indicator among the analysis indicators of the third category of objects involved in the report data reporting stage.

[0106] Among them, the first category of objects belongs to the objects to be verified in the source data, the second category of objects belongs to the objects to be verified in the target processing data, and the third category of objects belongs to the objects to be verified in the report generated based on the target processing data. Specifically, in one implementation, all objects to be verified in the source data can be regarded as the first category of objects, all objects to be verified in the target processing data can be regarded as the second category of objects, and all objects to be verified in the report generated based on the target processing data can be regarded as the third category of objects.

[0107] Of course, in another implementation, verifying all indicators may waste resources and be inefficient. Therefore, indicators with verification requirements in the source data can be pre-set as analysis indicators, indicators with verification requirements in the target processing data can be pre-set as analysis indicators, and indicators with verification requirements in the report generated based on the target processing data can be pre-set as analysis indicators. Some indicators can be selected for verification. Specifically, the indicators with verification requirements in the source data can include each core indicator in the source data, and each designated indicator corresponding to each core indicator in the source data, the indicators with verification requirements in the target processing data can include each core indicator in the target processing data, and each designated indicator corresponding to each core indicator in the target processing data, and the indicators with verification requirements in the report generated based on the target processing data can include each core indicator in the report generated based on the target processing data, and each designated indicator corresponding to each core indicator in the report generated based on the target processing data. It can be understood that indicators with verification requirements may include indicators that have no correlation with core indicators in each task processing stage. The selection of indicators with verification requirements that have no correlation with core indicators can be determined based on specific data reporting tasks and application scenarios, and this application does not limit this.

[0108] S105, based on the association between the abnormal indicator and each designated indicator, and the verification results of each designated indicator, a link graph corresponding to the abnormal indicator is generated; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has a verification result of the indicator represented by the node;

[0109] The above-mentioned embodiments specifically introduce the correlation relationship between the abnormal indicator and each designated indicator. It can be understood that, for any abnormal indicator, after the designated indicators corresponding to the abnormal indicator have been determined, the corresponding link diagram of the abnormal indicator can be generated directly based on the correlation relationship between the abnormal indicator and each designated indicator, as well as the verification results of each designated indicator.

[0110] Exemplarily, the specified indicators corresponding to indicator D are indicator A, indicator B and indicator C, and based on the association between the indicators, it can be determined that the link in the link diagram is ABCD, D is the end node, characterized as an abnormal indicator, and the verification result of the determined indicator A is passed, the verification result of indicator B is failed, and the verification result of indicator C is failed. Therefore, in the link diagram, the node of indicator A can display information indicating that the verification result is passed, and the node of indicator B and the node of indicator C can display information that the verification result is failed.

[0111] In addition, in the link diagram, each node may also have specific information of the indicator corresponding to the node, such as indicator data and other information, so as to facilitate user viewing.

[0112] S106, displaying the link diagram on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

[0113] After the link diagram is generated, the link diagram can be displayed on the second interface, and the link diagram can be used to determine the abnormal source indicator of the abnormal indicator. It can be understood that, usually, some indicators can have multiple upstream indicators, so that the link diagram of each abnormal indicator can include multiple links, and the abnormal indicator fails to pass the corresponding verification, which may be caused by the abnormality of multiple indicators in each specified indicator of the abnormal indicator. Therefore, for each link in the link diagram of each abnormal indicator, the indicator in the link that contains a failed result in the verification result and is the farthest from the abnormal indicator can be used as the abnormal source indicator. The determined abnormal source indicator can display a mark representing the abnormal source indicator at the node corresponding to the abnormal source indicator in the link diagram.

[0114] For example, Figure 2As shown, it is a link diagram of a determined abnormal indicator. Among them, the square frame represents the indicator whose verification result is not passed, and the arc frame represents the indicator whose verification result is passed. It can be understood that in this embodiment, using the shape of the frame to distinguish whether the indicator has passed the verification is only one implementation method. There may be other implementation methods, such as setting the font mark to red to represent failure, and the font to black to represent passing. This application does not limit the mark in the link diagram that represents whether the verification has passed. The total underwriting amount of the stock project is an abnormal indicator, and the total underwriting amount of the initial public offering, the total underwriting amount of the rights issue and the total underwriting amount of the additional issue are the upstream indicators of the total underwriting amount of the stock project, the total underwriting amount of the initial public offering_A shares, the total underwriting amount of the initial public offering_foreign capital and the total underwriting amount of the initial public offering_other securities are the upstream indicators of the total underwriting amount of the initial public offering, and the total underwriting amount of the main board, the total underwriting amount of the Growth Enterprise Market and the total underwriting amount of the Science and Technology Innovation Board are the upstream indicators of the total underwriting amount of the initial public offering_A shares. It can be determined that the total underwriting amount of stock projects-total underwriting amount of initial public offerings-initial public offerings_total underwriting amount of A shares-total underwriting amount of the main board is one of the links in the link diagram, and the total underwriting amount of stock projects-total underwriting amount of initial public offerings-initial public offerings_total underwriting amount of foreign capital is one of the links. Other links are not listed here one by one. Based on the above method of determining the mobile source indicators, it can be determined that Figure 2 China Mobile's source indicators include the total underwriting amount of the main board, the total underwriting amount of the Growth Enterprise Market, the total underwriting amount of the Science and Technology Innovation Board, and the total underwriting amount of additional issuance of A shares.

[0115] According to the scheme of the embodiment of the present application, the integrated platform can obtain the target verification results of each core indicator of the data reporting task, determine that the core indicator that fails the target verification result is an abnormal indicator, so as to realize the positioning of each core indicator with respect to the abnormal indicator, and display each abnormal indicator on the first interface of the integrated platform. In addition, after the user issues a tracking instruction for any abnormal indicator on the first interface, the corresponding link diagram of the abnormal indicator can be generated and displayed by using the correlation between the abnormal indicator and each designated indicator of the abnormal indicator, as well as the verification results of each designated indicator, and based on the link diagram, the abnormal source indicator of the abnormal indicator can be determined. It can be seen that the scheme of the present application can realize the positioning and tracing of the core indicators with abnormal conditions, thereby providing a basis for the quality management of the reporting task.

[0116] In addition, this application can achieve quality control and data quality tracking of report data in target data reporting tasks, and because it can locate and trace the core indicators with abnormal changes, it can effectively solve the pain points of repeated re-running of reported data, high operational pressure and high labor costs caused by manual tracing when abnormal indicators appear.

[0117] Optionally, each verification rule in the verification rule set has a corresponding verification level; the verification level represents the importance of the verification rule;

[0118] The method further comprises:

[0119] In response to a verification rule running result viewing instruction issued by a user, the running result of each target verification rule is determined from a plurality of candidate verification rules; wherein the candidate verification rule is a verification rule in the verification rule set that has been run to completion during the processing of the target data reporting task; and the target verification rule is a verification rule whose verification level is greater than a predetermined level threshold;

[0120] The running results of each target verification rule are displayed on the third interface. In this embodiment, the method for determining the running results of the verification rules corresponds to the above steps A1-A3. In each task processing stage of the target data reporting task, the verification rules in the verification rule set set in the task processing stage are run, so that the running results of the verification rules corresponding to the task processing stage can be obtained.

[0121] The present application can display the running status of each verification rule. Specifically, in response to a verification rule running result viewing instruction issued by a user, all the verification running rules that have completed the verification can be displayed on the third interface. However, since the number of verification rules in each verification rule set of the target data reporting task may be too large, if the running status of all verification rules is displayed, it may cause the user to spend a lot of time analyzing the running status of the more important verification rules. Therefore, the present application sets the verification rules with corresponding verification levels. The higher the verification level, the higher the importance of the verification rule. Therefore, the running status of the verification rules with a verification level greater than the predetermined level threshold can be displayed on the third interface.

[0122] It can be seen from the above embodiments that the target data reporting task described in the present application is divided into three processing stages, and each processing stage has a corresponding set of verification rules. Therefore, the integrated platform of the present application can correspond to three rule operation status display interfaces, which are used to display the operation status of the rules corresponding to the three processing stages.

[0123] Specifically, the first rule operation status display interface can display the operation status of the verification rule corresponding to the source data acquisition stage, the second rule operation status display interface can display the operation status of the verification rule corresponding to the source data processing stage, and the third rule operation status display interface can display the operation status of the verification rule corresponding to the report data reporting stage. Moreover, the first rule operation status display interface, the second rule operation status display interface, and the third rule operation status display interface can simultaneously display the operation status of the verification rules corresponding to different data reporting tasks. Exemplarily, the operation status of a verification rule displayed by any rule operation status display interface may include: task ID, verification rule ID, verification rule content, verification rule level, report name, operation status, verification time and other information.

[0124] It can be seen that this application can display the running status of the verification rules in multiple rule running status display interfaces of the integrated platform, thereby providing a basis for the quality management of the reporting tasks.

[0125] Optionally, the method further includes:

[0126] S107, in response to a user's instruction to view the task execution status of the target data reporting task, based on the task execution status of each data processing stage of the target data reporting task obtained from the task processing platform, the task execution status of the target data reporting task is displayed in the form of a flowchart on the fourth interface; wherein each node of the flowchart of the target reporting task represents a task processing stage of the target reporting task, and each node has a mark representing the execution status of the task processing stage;

[0127] According to the above embodiments, it can be known that the data reporting task of the present application is divided into multiple task processing stages. For each task processing stage, the processing status of the task processing stage can be obtained from the task processing platform, thereby displaying the task execution status of the target data reporting task in the form of a flowchart on the fourth interface.

[0128] Furthermore, the fourth interface can obtain task operation data and task report information data and perform correlation matching, and use a flowchart to intuitively display the task status. Specifically, the task operation data refers to the current task processing stage and the processing status of the task processing stage, and the task report information data refers to the task ID, task name, task reporting period and task type, etc., wherein the task type refers to whether the task is a daily report, monthly report or annual report.

[0129] S108, in response to a user's instruction to generate a quality evaluation report for a specified object, generate a quality evaluation report for the specified object based on change indicators related to the specified object; wherein the specified object includes: a specified data reporting task, a specified reporting deadline or a specified report.

[0130] The integrated platform of the present application can generate a quality report, which can be a quality report for a specified data reporting task, a specified reporting deadline, or a specified report. Exemplarily, for a specified reporting deadline, the quality assessment result of the specified reporting deadline can be determined by using the number of abnormal indicators determined in all reporting tasks involved in the deadline. It can be understood that the fewer the number of abnormal indicators, the higher the quality of the quality assessment result.

[0131] Furthermore, the integrated platform can support querying and exporting of historically generated reports.

[0132] S109, in response to the user's instruction to view the reporting execution status of the specified report of the target data reporting task, based on the reporting execution status of the specified report obtained from the task processing platform, the reporting execution status of the specified report is displayed in the form of a flowchart on the fifth interface; wherein each node of the flowchart of the specified report represents a reporting stage of the specified report, and each node has a mark representing the reporting execution status.

[0133] This application can sort out and divide the reporting process of the specified report, and can obtain the reporting execution status of the specified report in each reporting process from the task processing platform, so that the integrated platform can achieve full-process coverage of the monitoring of the specified report from source system collection to final data reporting. The source system collection refers to the collection of source data from the source system, so as to achieve a detailed display of the report operation process. In addition, in this application, each node in the reporting process of the specified report can be clicked, and the user clicks on any node to indicate the issuance of a drill-down tracking instruction for the node, so that the specific operation data of the node can be displayed. If a node is abnormal, the user can determine the cause of the abnormal operation of the node based on the operation data of the node, wherein the operation data of each node can be obtained by the integrated platform from the task processing platform.

[0134] It can be seen that the solution of this embodiment can realize the process monitoring of the target data reporting task and the monitoring of the report reporting process. It can also obtain a visual quality evaluation report for the specified object, so as to better evaluate and analyze the data quality of the reporting task, provide a basis for the quality management of the reporting task, and help improve the company's data governance level.

[0135] Optional, such as Figure 3As shown, it is a structural diagram of a regulatory reporting, R&D and operation integrated platform device provided in this application. The regulatory reporting, R&D and operation integrated platform corresponds to the above-mentioned integrated platform. The integrated platform can include four functional modules: report operation, indicator management, quality control and assessment management.

[0136] The report operation module may include a task overview unit, a reporting process unit and an operation monitoring unit; the function implemented by the task overview unit corresponds to the above S107 and will not be elaborated here.

[0137] The reporting process unit is used to respond to the user's viewing instruction for the report data of the target reporting task, and display the reporting status of each department in the report reporting process on the fifth interface. Specifically, the task data, report data and report reporting process data can be obtained from the task processing platform, and the corresponding relationship between the task data, report data and report reporting process data can be determined, so that the task data, report data and report reporting process data with corresponding relationship are displayed on the fifth interface. Among them, the task data can include the task name and the reporting period, the report data can include the report name, the group name of the report, and the node corresponding to the report. The report reporting process data includes the reporting process and the node status, wherein the reporting process includes the process type, the department to which it belongs, and the name of the person in charge of the department. Exemplarily, report A is initially reviewed in department 1, and report B is second reviewed in department 2, both of which can belong to the content of the reporting process.

[0138] The functions implemented by the operation monitoring module correspond to the above S109 and will not be elaborated here.

[0139] The indicator management module includes an indicator list unit, an abnormality monitoring unit and an indicator drill-down unit. The indicator list unit can display the core indicators and important attributes of the target data reporting task in the form of a list. The important attributes include: indicator number, business subject corresponding to the indicator, statistical granularity corresponding to the indicator, department information corresponding to the indicator, reporting frequency, measurement unit, abnormality threshold, business update time and other attribute information.

[0140] In addition, the indicator management unit also supports important attribute query and core indicator detail display, wherein the important attribute query may include querying core indicators related to specified important attributes.

[0141] The abnormality monitoring unit can display all abnormality indicators that exceed the threshold in the form of a list, and support the query of important attributes and the jump to the details page. The details page can thus realize the monitoring and analysis of abnormal data. The functions realized by the abnormality monitoring unit correspond to the above S102-S103, and will not be elaborated here.

[0142] The indicator drill-down unit can sort out the relationship between the current indicator and its upstream indicator, and can use a tree structure to intuitively display the relationship between indicators, thereby realizing drill-down analysis of abnormal indicators and rapid location of abnormal causes. The tree structure corresponds to the above-mentioned link diagram, and the functions realized by the indicator drill-down unit correspond to the above-mentioned S103-S106, which will not be elaborated here.

[0143] The quality control module may include: a verification rule unit, a source data verification unit, a storage process verification unit, and a reporting platform verification unit.

[0144] The verification rule unit can display all data verification rules and their important attributes in the supervision and reporting process in the form of a list, and support important attribute query, verification rule details display and historical verification situation analysis, so that users can understand the detailed information and historical operation of the verification rules. The important attributes can include: cross-check ID, cross-check type, cross-check level, task name, task ID, reporting frequency and report name.

[0145] The function of the source data verification unit corresponds to the above-mentioned step A1, and can display the rule running status of the source data acquisition stage on the corresponding interface, that is, it can display the verification results of the corresponding objects to be verified by using rule verification in the source data acquisition stage. The function of the storage process verification unit corresponds to the above-mentioned step A2, and displays the rule running status of the process verification stage of the source data processing stage, that is, it can display the verification results of the corresponding objects to be verified by using rule verification in the source data processing stage. The function of the reporting platform verification unit corresponds to the above-mentioned step A3, and displays the rule running status of the report data reporting stage, that is, it can display the verification results of the corresponding objects to be verified by using rule verification in the report data reporting stage. And when displaying the rule running status, the above three units can display the rule running status involved in different data reporting tasks on the same interface.

[0146] The assessment management module includes a report generation unit and a report query unit. The report generation unit can support customized report generation, realize the generation of data quality reports for specified tasks, reports, and reporting periods, and the functions realized by the report generation unit correspond to the above S108; the report query unit supports the query and export of historically generated reports.

[0147] It can be seen that the solution of this embodiment integrates various modules into one platform, which greatly facilitates various regulatory reporting tasks, and generates an integrated data quality report based on the results of each module, which facilitates internal communication and data sharing, reduces communication costs, and can also promote the company's overall data governance level.

[0148] Based on the above-mentioned embodiment of the method for data quality supervision for data reporting tasks, the embodiment of the present disclosure also provides a device for data quality supervision for data reporting tasks. Figure 4 A schematic diagram of a data quality monitoring device for a data reporting task provided by an embodiment of the present disclosure is shown in FIG. Figure 4 As shown, the data quality supervision device for data reporting tasks is applied to an integrated platform for data reporting task management and control, and the integrated platform communicates with a task processing platform for processing data reporting tasks; the device includes:

[0149] The acquisition module 401 is used to respond to the user's instruction to view the abnormal indicators of the target data reporting task, and to obtain the target verification results of each core indicator of the target data reporting task reported by the task processing platform; wherein the target verification result of each core indicator is the verification result determined by the task processing platform after verifying the core indicator using the predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task;

[0150] A positioning module 402 is used to locate the abnormal indicator of each core indicator based on the target verification result of each core indicator; wherein the abnormal indicator is a core indicator whose target verification result indicates that the verification has failed;

[0151] A first display module 403, for displaying each determined abnormal indicator on a first interface in response to obtaining at least one abnormal indicator;

[0152] The first determination module 404 is used to respond to the tracking instruction for any abnormal indicator issued by the user through the first interface, determine each designated indicator corresponding to the abnormal indicator and obtain the verification result of each designated indicator; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is the verification result obtained by the task processing platform after verification using the verification rule corresponding to the designated indicator in the verification rule set;

[0153] The generating module 405 is used to generate a link graph corresponding to the abnormal indicator based on the association relationship between the abnormal indicator and each designated indicator, and the verification result of each designated indicator; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has the verification result of the indicator represented by the node;

[0154] The second display module 406 is used to display the link diagram on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

[0155] In the scheme of the embodiment of the present application, the integrated platform can obtain the target verification results of each core indicator of the data reporting task, determine that the core indicator that fails the target verification result is an abnormal indicator, so as to realize the positioning of each core indicator with respect to the abnormal indicator, and display each abnormal indicator on the first interface of the integrated platform. In addition, after the user issues a tracking instruction for any abnormal indicator on the first interface, the association relationship between the abnormal indicator and each designated indicator of the abnormal indicator, as well as the verification results of each designated indicator, can be used to generate the corresponding link diagram of the abnormal indicator, and display it to determine the abnormal source indicator of the abnormal indicator. It can be seen that the scheme of the present application can realize the positioning and tracing of the core indicators with abnormal conditions, thereby providing a basis for the quality management of the reporting task.

[0156] Optionally, the task processing platform verifies each core indicator using a predetermined verification rule corresponding to the core indicator, including:

[0157] For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period;

[0158] If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

[0159] Optionally, there are multiple verification rule sets, and each verification rule set is set for at least one task processing stage among multiple task processing stages of the target data reporting task;

[0160] The process of determining the verification results of each analysis indicator in the target data reporting task includes:

[0161] In each task processing stage of the target data reporting task, the verification rule set for the task processing stage is used to verify the objects to be verified in the task processing stage, and the verification results corresponding to the task processing stage are obtained. From the verification results corresponding to the task processing stage, the verification results of the analysis indicators existing in the task processing stage are determined; wherein the objects to be verified include the analysis indicators existing in the task processing stage.

[0162] Optionally, there are multiple task processing platforms, and the multiple task processing platforms include a target development platform and a report submission platform; the multiple task processing stages include: a source data acquisition stage, a source data processing stage, and a report data submission stage;

[0163] In each task processing stage of the target data reporting task, the verification rule set set for the task processing stage is used to verify the object to be verified in the task processing stage, and the verification result corresponding to the task processing stage is obtained, including:

[0164] In the source data acquisition phase of the target data reporting task, the target development platform performs verification on the first type of objects existing in the source data acquisition phase using the verification rule set for the source data acquisition phase to obtain verification results of the first type of objects; the first type of objects belong to the objects to be verified in the source data;

[0165] In the source data processing stage of the target data reporting task, the target development platform verifies the second type of objects existing in the source data processing stage using the verification rule set for the source data processing stage to obtain the verification result of the second type of objects; the second type of objects belong to the objects to be verified in the target processing data; the target processing data is the data obtained after processing the source data;

[0166] During the report data reporting stage of the target data reporting task, the report reporting platform performs verification on the third category objects existing in the report data reporting stage using the verification rule set for the report data reporting stage to obtain verification results for the third category objects; the third category objects belong to the objects to be verified in the report generated based on the target processing data.

[0167] Optionally, each verification rule in the verification rule set has a corresponding verification level; the verification level represents the importance of the verification rule;

[0168] The method further comprises:

[0169] The second determination module is used to determine the operation results of each target verification rule from multiple candidate verification rules in response to the verification rule operation result viewing instruction issued by the user; wherein the candidate verification rule is the verification rule in the verification rule set that has been completed in the processing of the target data reporting task; the target verification rule is the verification rule whose verification level is greater than a predetermined level threshold;

[0170] The third display module is used to display the running results of each target verification rule on the third interface.

[0171] Optionally, the device further comprises:

[0172] The fourth display module is used to respond to the user's instruction to view the task execution status of the target data reporting task, based on the task execution status of each data processing stage of the target data reporting task obtained from the task processing platform, and to display the task execution status of the target data reporting task in the form of a flowchart on the fourth interface; wherein each node of the flowchart of the target reporting task represents a task processing stage of the target reporting task, and each node has a mark representing the execution status of the task processing stage;

[0173] A fifth display module is used to generate a quality evaluation report for a specified object based on a change indicator related to the specified object in response to a user's instruction to generate a quality evaluation report for the specified object; wherein the specified object includes: a specified data submission task, a specified submission deadline, or a specified report;

[0174] The sixth display module is used to respond to the user's instruction to view the reporting execution status of the specified report for the target data reporting task, and based on the reporting execution status of the specified report obtained from the task processing platform, display the reporting execution status of the specified report in the form of a flowchart on the fifth interface; wherein each node of the flowchart of the specified report represents a reporting stage of the specified report, and each node has a mark representing the reporting execution status.

[0175] The present application also provides an electronic device, such as Figure 5 As shown, the electronic device includes a processor 501 , a communication interface 502 , a memory 503 and a communication bus 504 , wherein the processor 501 , the communication interface 502 , and the memory 503 communicate with each other via the communication bus 504 .

[0176] Memory 503, used for storing computer programs;

[0177] The processor 501 is used to implement any of the above-mentioned data quality supervision methods for data reporting tasks when executing the program stored in the memory 503.

[0178] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0179] The communication interface is used for communication between the above electronic device and other devices.

[0180] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0181] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0182] In another embodiment provided in the present application, a computer-readable storage medium is also provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned data quality supervision methods for data reporting tasks are implemented.

[0183] In another embodiment provided in the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute any of the data quality supervision methods for data reporting tasks in the above embodiments.

[0184] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0185] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0186] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0187] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A data quality supervision method for data reporting tasks, characterized in that: The method is applied to an integrated platform for data reporting task management and control, and the integrated platform communicates with a task processing platform for processing data reporting tasks; the method includes: In response to a user's instruction to view the abnormal indicators of the target data reporting task, the target verification results of each core indicator of the target data reporting task reported by the task processing platform are obtained; wherein the target verification result of each core indicator is the verification result obtained by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task; Based on the target verification results of each core indicator, locate the abnormal indicators of each core indicator; wherein the abnormal indicators are core indicators whose target verification results indicate that they have failed the verification; In response to obtaining at least one abnormal indicator, displaying each determined abnormal indicator on a first interface; In response to a tracking instruction issued by the user through the first interface for any abnormal indicator, each designated indicator corresponding to the abnormal indicator is determined and a verification result of each designated indicator is obtained; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using the verification rule corresponding to the designated indicator in the verification rule set; Based on the association between the abnormal indicator and each designated indicator, and the verification results of each designated indicator, a link graph corresponding to the abnormal indicator is generated; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has the verification result of the indicator represented by the node; The link diagram is displayed on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

2. The method according to claim 1, characterized in that The process of the task processing platform verifying each core indicator using a predetermined verification rule corresponding to the core indicator includes: For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period; If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

3. The method according to claim 1, characterized in that There are multiple verification rule sets, each of which is set for at least one task processing stage among multiple task processing stages of the target data reporting task; The process of determining the verification results of each analysis indicator in the target data reporting task includes: In each task processing stage of the target data reporting task, the verification rule set for the task processing stage is used to verify the objects to be verified in the task processing stage, and the verification results corresponding to the task processing stage are obtained. From the verification results corresponding to the task processing stage, the verification results of the analysis indicators existing in the task processing stage are determined; wherein the objects to be verified include the analysis indicators existing in the task processing stage.

4. The method according to claim 3, characterized in that There are multiple task processing platforms, and the multiple task processing platforms include a target development platform and a report submission platform; The multiple task processing stages include: source data acquisition stage, source data processing stage and report data reporting stage; In each task processing stage of the target data reporting task, the verification rule set set for the task processing stage is used to verify the object to be verified in the task processing stage, and the verification result corresponding to the task processing stage is obtained, including: In the source data acquisition phase of the target data reporting task, the target development platform performs verification on the first type of objects existing in the source data acquisition phase using the verification rule set for the source data acquisition phase to obtain verification results of the first type of objects; the first type of objects belong to the objects to be verified in the source data; In the source data processing stage of the target data reporting task, the target development platform verifies the second type of objects existing in the source data processing stage using the verification rule set for the source data processing stage to obtain the verification result of the second type of objects; the second type of objects belong to the objects to be verified in the target processing data; the target processing data is the data obtained after processing the source data; During the report data reporting stage of the target data reporting task, the report reporting platform performs verification on the third category objects existing in the report data reporting stage using the verification rule set for the report data reporting stage to obtain verification results for the third category objects; the third category objects belong to the objects to be verified in the report generated based on the target processing data.

5. The method according to claim 4, characterized in that The verification rules in each verification rule set have corresponding verification levels; The verification level represents the importance of the verification rule; The method further comprises: In response to a verification rule running result viewing instruction issued by a user, the running result of each target verification rule is determined from a plurality of candidate verification rules; wherein the candidate verification rule is a verification rule in the verification rule set that has been run to completion during the processing of the target data reporting task; and the target verification rule is a verification rule whose verification level is greater than a predetermined level threshold; The third interface displays the running results of each target verification rule.

6. The method according to claim 1, characterized in that The method further comprises: In response to a user's instruction to view the task execution status of the target data reporting task, based on the task execution status of each data processing stage of the target data reporting task obtained from the task processing platform, the task execution status of the target data reporting task is displayed in the form of a flowchart on the fourth interface; wherein each node of the flowchart of the target reporting task represents a task processing stage of the target reporting task, and each node has a mark representing the execution status of the task processing stage; In response to a user's instruction to generate a quality evaluation report for a specified object, a quality evaluation report for the specified object is generated based on a change indicator related to the specified object; wherein the specified object includes: a specified data submission task, a specified submission deadline, or a specified report; In response to a user's instruction to view the reporting execution status of a specified report for a target data reporting task, the reporting execution status of the specified report is displayed in the form of a flowchart on the fifth interface based on the reporting execution status of the specified report obtained from the task processing platform; wherein each node of the flowchart of the specified report represents a reporting stage of the specified report, and each node has a mark representing the reporting execution status.

7. A data quality supervision method and device for data reporting tasks, characterized in that: The device is applied to an integrated platform for data reporting task management and control, and the integrated platform communicates with a task processing platform for processing data reporting tasks; the device includes: An acquisition module is used to respond to a user's instruction to view the abnormal indicators of the target data reporting task, and to obtain the target verification results of each core indicator of the target data reporting task reported by the task processing platform; wherein the target verification result of each core indicator is the verification result obtained by the task processing platform after verifying the core indicator using a predetermined verification rule corresponding to the core indicator during the processing of the target data reporting task; the predetermined verification rule is a rule in the verification rule set of the target data reporting task; A positioning module, used to locate the abnormal indicators of each core indicator based on the target verification results of each core indicator; wherein the abnormal indicator is a core indicator whose target verification result indicates that the verification has failed; A first display module, configured to display each determined abnormal indicator on a first interface in response to obtaining at least one abnormal indicator; A first determination module is used to respond to a tracking instruction issued by a user through the first interface for any abnormal indicator, determine each designated indicator corresponding to the abnormal indicator and obtain a verification result of each designated indicator; wherein each designated indicator is an indicator associated with the abnormal indicator among various analysis indicators of the target data reporting task currently reported by the task processing platform; the verification result of each designated indicator is a verification result obtained by the task processing platform after verification using a verification rule corresponding to the designated indicator in the verification rule set; A generation module is used to generate a link graph corresponding to the abnormal indicator based on the association relationship between the abnormal indicator and each specified indicator, and the verification results of each specified indicator; wherein, in the link graph corresponding to the abnormal indicator, the terminal node represents the abnormal indicator, and other nodes other than the terminal node represent indicators having an association relationship with the abnormal indicator, and each node has a verification result of the indicator represented by the node; The second display module is used to display the link diagram on the second interface to determine the abnormal source indicator of the abnormal indicator; wherein the abnormal source indicator is, in each link of the link diagram, the indicator that contains a failed result in the verification result and is farthest from the abnormal indicator.

8. The device according to claim 7, characterized in that The process of the task processing platform verifying each core indicator using a predetermined verification rule corresponding to the core indicator includes: For each core indicator, calculate the difference between the indicator value of the core indicator in the current reporting period of the target data reporting task and the indicator value of the core indicator in the historical reporting period; If the difference value is greater than the threshold value corresponding to the core indicator, the target verification result of the core indicator is determined to be: the core indicator fails to pass the verification; otherwise, the target verification result of the core indicator is determined to be: passed the verification.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing any of the methods described in claims 1-6 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images