Security industry-oriented data quality verification method and device

Through data quality verification methods and devices for the securities industry, the problem of lack of scenario orientation and complex operations in data quality verification of securities companies is solved, and the independent execution and intuitive report generation of business personnel is realized, which improves the efficiency and security of data quality verification. .

CN119026594APending Publication Date: 2024-11-26XIANGCAI SECURITIES CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411194509.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-29
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Securities companies lack scenario-oriented approach in data quality verification, and their business operations are complex, and the results are inconvenient to view, which makes it difficult to discover and resolve data quality problems in a timely manner, affecting investment transactions and regulatory compliance.

Method used

Design a data quality verification method and device for the securities industry. Through verification task configuration module, permission configuration module, execution module, report generation module and report push module, business personnel can independently perform data quality verification based on business scenarios and generate intuitive , easy-to-understand verification report.

Benefits of technology

Scenario-based data quality verification is realized, reducing the operation difficulty of business personnel, improving the efficiency and security of data quality verification, and ensuring rapid understanding and monitoring of data quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119026594A_ABST
    Figure CN119026594A_ABST
Patent Text Reader

Abstract

The invention discloses a security industry-oriented data quality verification method and device. The device comprises a verification task configuration module, a verification task permission configuration module, a verification task execution module, a verification report generation module and a verification report pushing module. Based on the business scene as the core, the method directly serves the data quality monitoring requirement of the specific business, the operability is high, the data quality verification efficiency is high, the data quality verification task permission is configured, the access control requirement of a security company can be effectively met, and the data security is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of securities industry data processing, and specifically relates to a data quality verification method and device for the securities industry. Background Art

[0002] Securities companies provide a wide range of financial products and services to individuals and organizations. As data-intensive companies, they have huge data volumes and complex data application scenarios. High-quality data is the cornerstone for securities companies to provide financial services and ensure stable operations. If data quality issues cannot be discovered and resolved in a timely manner, they will lead to problems in investment transactions, risk control and compliance, and thus cause economic losses and regulatory penalties.

[0003] Currently, securities companies verify data quality by executing data quality verification rules and checking the results of data quality rule execution. The following shortcomings exist when business personnel operate:

[0004] 1) Lack of scenario orientation: Due to the lack of comprehensive consideration of business scenarios, the current data quality verification is divided into independent data quality verification rules in actual business scenarios. When data quality problems are found, manual intervention is usually required to analyze the execution results of these scattered data quality verification rules in combination with specific business scenarios.

[0005] 2) Business operation barriers: The existing data quality verification rules focus on the technical perspective and are complex and difficult to understand, which limits business personnel from independently performing data quality verification.

[0006] 3) Inconvenient results viewing: After the data quality verification rules are executed, users need to view the execution results of each data quality verification rule with abnormal data, and cannot quickly understand the overall picture of data quality.

[0007] In view of this, the present invention proposes a data quality verification method and device based on business scenarios for the securities industry to solve the above problems. Summary of the invention

[0008] The purpose of the present invention is to provide a data quality verification method and device for the securities industry, through which business personnel can independently perform data quality verification based on business scenarios and issue an intuitive, easy-to-understand and secure data quality verification report.

[0009] In order to achieve the above-mentioned purpose, the technical solution adopted by the present invention is: a data quality verification device for the securities industry, including a verification task configuration module, which is used to configure the data quality verification rules according to the business scenario to form a data quality verification task suitable for the scenario;

[0010] The verification task permission configuration module is used to assign data quality verification tasks to designated personnel, so that they have the authority to view and execute data quality verification tasks, as well as view, download, and receive data quality verification reports corresponding to data quality verification tasks;

[0011] Verification task execution module, used to actively or passively trigger the execution of data quality verification tasks;

[0012] The verification report generation module is used to generate a data quality verification report according to the specified format based on the execution results of the data quality verification rules in the data quality verification task;

[0013] The verification report push module is used to push the data quality verification report to designated personnel.

[0014] In a feasible implementation, the verification task execution module includes:

[0015] The manual execution module is used to actively trigger the execution of data quality verification tasks. When the verification task does not have a clear execution cycle, the manual execution module is used;

[0016] In a feasible implementation, the verification task execution module further includes:

[0017] The scheduling execution module is used to passively allocate the specified execution cycle, frequency, and time for data quality verification tasks. When the verification task has a clear execution cycle, the scheduling execution module is used.

[0018] In a feasible implementation, the verification report generation module includes:

[0019] Aggregation module, used to aggregate the execution results of data quality rules in data quality verification tasks;

[0020] Output module, used to aggregate execution results to form a data quality verification report and output it in a specified format;

[0021] In a feasible implementation, the verification report push module includes:

[0022] The judgment module is used to judge whether to push the data quality verification report according to the content of the data quality verification report. If the result of any quality rule in the data quality verification report is abnormal, the report needs to be pushed; on the contrary, if the results of all quality rules in the data quality verification report are normal, the report does not need to be pushed;

[0023] The push module is used to send the data quality verification report to the designated person according to the permission configuration information if it is determined that the data quality verification report is to be pushed.

[0024] The log module is used to record the operation records and execution records of data quality verification tasks, as well as the viewing, downloading, and pushing records of data quality verification reports.

[0025] Based on the above-mentioned data quality verification device for the securities industry, the present invention also provides a data quality verification method for the securities industry, comprising the following steps:

[0026] S1, configure the data quality verification rules into data quality verification tasks according to the business scenarios;

[0027] S2, assigning data quality verification tasks to designated personnel, so that they have the authority to view and execute data quality verification tasks, as well as view, download, and receive data quality verification reports generated by data quality verification tasks;

[0028] S3, execute the data quality verification task, execute the data quality verification task by manually triggering the execution or configuring the specified execution time, and generate a data quality verification report;

[0029] S4, will determine whether to send the data quality verification report based on the content of the data quality verification report.

[0030] In a feasible implementation, the data quality verification rules adopt custom data quality verification rules. The association relationship between the verification task and the verification rule is a one-to-many relationship. When the verification task is executed, all verification rules associated with the task will be executed to comprehensively check the data quality of the task scenario.

[0031] In a feasible implementation, the verification task is authorized to designated personnel, thereby establishing a many-to-many correspondence between the verification task and the designated personnel.

[0032] Beneficial effects of the present invention:

[0033] 1. Scenario-based construction of verification tasks: With business scenarios as the core, by configuring data quality verification tasks, data quality verification task permissions and scheduling, business personnel can configure data quality verification tasks that meet specific monitoring scenarios based on custom rules, directly serving the data quality monitoring needs of specific businesses.

[0034] 2. Reduce the difficulty of use for business personnel: Business personnel can perform data quality verification tasks on their own without having to deeply understand technical details, thereby enhancing their independent operation capabilities.

[0035] 3. Automated report generation: After executing the data quality verification task, the system automatically summarizes and generates a comprehensive data quality verification report, eliminating the need for manual collation and analysis, thereby improving efficiency and convenience.

[0036] 4. Effective authority control mechanism: The authority configuration of data quality verification tasks can effectively implement the access control requirements of securities companies and ensure data security. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 The figure is a flow chart of the method of the present invention.

[0038] Figure 2 It is a structural diagram of the device of the present invention. DETAILED DESCRIPTION

[0039] Example 1

[0040] The present application embodiment provides a data quality verification method for a securities company based on business scenarios, such as Figure 1 As shown, the specific steps include:

[0041] S101. Create a new data quality verification task. Taking external reporting as an example, configure the task name and description, and retrieve and associate existing data quality verification rules.

[0042] The essence of the association between quality verification tasks and quality verification rules is to build a one-to-many (1:N) relationship between verification tasks and verification rules to form a unified execution unit. When a verification task is executed, all verification rules associated with the task will be executed to comprehensively check the data quality of the task scenario. At the same time, data quality verification tasks may send changes, such as adding or reducing associated data quality verification rules in the task. Changes to data quality verification rules do not require changes to data quality verification tasks.

[0043] For example: the customized quality rule 0000001 is that the amount of securities transactions is greater than 0; the quality rule 0000002 is that the company's listing time must not be earlier than December 1992; the quality rule 0000003 trading volume indicator, the value of the headquarters should be equal to the sum of the trading volumes of all branches; the quality rule 0000004 handling fee indicator, the value of the headquarters should be equal to the sum of the trading volumes of all branches. Construct verification task 1: Serving Department A, including the above customized quality rules 0000002 and 0000003, verification task 2: Serving Department B, including rules 0000001, 0000002, 0000004, a total of 3 quality rules. According to the verification scenario of your own needs, when you package the rules together and execute a verification task, all the rules under the task will be executed; the change of the verification task means modifying the name of the task, adding or reducing the quality rules contained in the task. In quality rule 0000001, the securities trading amount must be greater than 0, which is changed to securities trading amount must be greater than 100. At this time, the rule content changes because rule 0000001 has changed, but it is still rule 0000001, not a new rule, so Task 2 is not affected.

[0044] S102. Configure data quality verification task permissions. When authorizing, you can perform case-insensitive fuzzy searches based on user names and real names in the system, and reset, add, and remove authorized users.

[0045] Among them, the verification task builds a many-to-many (N:N) correspondence between tasks and personnel by authorizing designated personnel. At the same time, the authorized object may change due to personnel changes and other situations. You can remove all authorized users by resetting; you can add designated authorized users by adding; you can delete designated authorized users by removing.

[0046] S103, data quality verification task execution, which can be manually triggered or configured for data quality verification task scheduling, and the cycle, frequency, and time of data quality verification task execution can be set.

[0047] Among them, manual triggering and configuration scheduling execution are two completely independent execution methods. Even if automatic scheduling is set, manually triggered tasks can still be started on demand without being constrained by automatic scheduling; vice versa, the execution of automatic scheduling will not be interrupted or adjusted due to manual triggering. In the execution mechanism, whether it is manual triggering or configuration scheduling execution, there is no difference in priority between the two methods. Regardless of which method is used to start the data verification task, it will be executed in its own time order, and no method will be given a higher priority to preempt resources or execution time.

[0048] S104. After the data quality verification task is scheduled or manually executed, a data quality verification report is generated.

[0049] Each time a data quality verification task is executed, a corresponding data quality verification report will be generated. Only personnel who have been authorized to perform the specified data quality verification task can see the corresponding data quality verification report. In order to ensure that the data quality verification report is intuitive and easy to understand, the report contains the summary data and detailed data of the abnormal data, with the summary data in front and the detailed data in the back. At the same time, you can jump to the abnormal data detailed information with one click by clicking the abnormal data summary information.

[0050] S105. Determine whether to send the data quality verification report based on the content of the data quality verification report. If the summary data in the data quality verification report shows abnormal data, send the data quality verification report to the data quality verification task authorizer by email or other means; if the summary data in the data quality verification report shows no abnormal data, do not send the data quality verification report.

[0051] Among them, the data quality verification report can also be viewed and downloaded by yourself.

[0052] Example 2

[0053] The present application embodiment provides a data quality verification device for a securities company based on business scenarios, such as Figure 2 The figure shows a structural block diagram of a data quality verification device for a securities company based on a business scenario, including but not limited to the following modules:

[0054] The verification task configuration module 100 is used to configure the data quality verification rules into data quality verification tasks according to the customized verification scenarios;

[0055] Verification task authority configuration module 200, used to assign data quality verification tasks to designated personnel, so that they have the authority to view and execute verification tasks, as well as view, download, and receive data quality verification reports corresponding to data quality verification tasks;

[0056] A verification task execution module 300 is used to trigger the execution of a data quality verification task;

[0057] Furthermore, the verification task execution module includes:

[0058] Manual execution module 301, used to manually trigger the execution of data quality verification tasks;

[0059] The scheduling execution module 302 is used to assign the data quality verification task to a specified execution cycle, frequency, and time;

[0060] The verification report generation module 400 is used to generate a data quality verification report according to a specified format based on the verification results of the data quality verification rules in the data quality verification task;

[0061] Furthermore, the verification report generation module includes:

[0062] Aggregation module 401, used to aggregate the execution results of data quality rules in the verification task;

[0063] Output module 402, used to output the data quality verification report in a specified format;

[0064] The verification report push module 500 is used to push the data quality verification report to the designated personnel.

[0065] Furthermore, the verification report push module includes:

[0066] A judgment module 501 is used to determine whether to push the data quality verification report according to the content of the data quality verification report;

[0067] The push module 502 is used to send the data quality verification report to the corresponding personnel according to the authority configuration information if it is determined that the data quality verification report is to be pushed.

[0068] The log module 600 is used to record the operation records and execution records of the data quality verification tasks, as well as the viewing, downloading, and pushing records of the data quality verification reports.

[0069] The device is based on business scenarios and directly serves the data quality monitoring needs of specific businesses. It has strong operability, high data quality verification efficiency, and data quality verification task authority configuration, which can effectively implement the access control requirements of securities companies and ensure data security.

[0070] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A data quality verification device for the securities industry. It is characterized in that The verification task configuration module is used to configure the data quality verification rules according to the business scenario to form a data quality verification task suitable for the scenario; The verification task permission configuration module is used to assign data quality verification tasks to designated personnel, so that they have the authority to view and execute data quality verification tasks, as well as view, download, and receive data quality verification reports corresponding to data quality verification tasks; Verification task execution module, used to actively or passively trigger the execution of data quality verification tasks; The verification report generation module is used to generate a data quality verification report according to the specified format based on the execution results of the data quality verification rules in the data quality verification task; The verification report push module is used to push the data quality verification report to designated personnel.

2. The data quality verification device for the securities industry according to claim 1, It is characterized in that The verification task execution module includes: The manual execution module is used to manually trigger the execution of data quality verification tasks.

3. The data quality verification device for the securities industry according to claim 1 or 2, It is characterized in that The verification task execution module includes: a scheduling execution module, which is used to assign a specified execution cycle, frequency, and time to the data quality verification task.

4. The data quality verification device for the securities industry according to claim 3, It is characterized in that The verification report generation module includes: Aggregation module, used to aggregate the execution results of data quality rules in data quality verification tasks; The output module is used to output the data quality verification report in the specified format.

5. The data quality verification device for the securities industry according to claim 4, It is characterized in that The verification report push module includes: The judgment module is used to judge whether to push the data quality verification report according to the content of the data quality verification report; the push module is used to send the data quality verification report to the corresponding personnel according to the permission configuration information if it is judged that the data quality verification report is pushed; The log module is used to record the operation records and execution records of data quality verification tasks, as well as the viewing, downloading, and pushing records of data quality verification reports.

6. A method using the data quality verification device for the securities industry as claimed in claim 5, It is characterized in that The following steps are included: configuring customized data quality verification rules into data quality verification tasks according to business scenarios; assigning data quality verification tasks to designated personnel so that they have the authority to view and execute data quality verification tasks, as well as view, download, and receive data quality verification reports generated by data quality verification tasks; executing data quality verification tasks, which can be executed regularly by manually triggering execution or configuring a specified execution time, to generate a data quality verification report; and determining whether to send the data quality verification report based on the content of the data quality verification report.

7. The method of the data quality verification device for the securities industry according to claim 6, It is characterized in that The data quality verification rules adopt user-defined data quality verification rules, and the association relationship between the verification tasks and the verification rules is a one-to-many relationship.

8. The method of the data quality verification device for the securities industry according to claim 6, It is characterized in that The verification task establishes a many-to-many correspondence between the verification task and the designated personnel by authorizing the designated personnel.