Data dictionary-based data standardization test method

Abstract

The invention relates to the technical field of data standards, in particular to a data standardization testing method based on a data dictionary, and solves the problem that in the prior art, due to the fact that different businesses among business departments have different definitions, different data descriptions and different data formats on the same data, the data standardization testing efficiency is high. In order to overcome the defects that data are difficult to share and exchange due to missing of data standards, different standards, imperfect standard systems and the like, and due values of the data are affected, a unified standard system is built, and data standardization processing is performed according to the unified standards, so that the data sharing and exchange efficiency is improved. Therefore, unified and standard external business calibers and terms and normalized and standardized data are formed, and the data service level and quality are improved.

Description

Technical Field

[0001] The invention relates to the technical field of data standards, in particular to a data standardization testing method based on a data dictionary. Background Art

[0002] Data dictionary refers to the definition and description of data items, data structures, data flows, data storage, processing logic, etc. Its purpose is to provide detailed descriptions of each element in the data flow diagram and use the data dictionary as a simple modeling project. In short, the data dictionary is a collection of information that describes the data and is a collection of definitions of all data elements used in the system.

[0003] Digitalization is driving the development of society and technology. In people's work and research in various fields, data is needed to reflect their real objective feedback. As business division of labor becomes more and more detailed and business performance becomes more and more refined, people increasingly use data to understand behavior, thereby providing a basis for subsequent decision-making.

[0004] However, business departments often have different definitions, descriptions, and formats for the same data, which makes it difficult to share and exchange data, affecting the value of data. At this time, the characteristics of the data dictionary can solve the above problems, but there is currently no solution to combine them to solve the problem.

[0005] Therefore, it is necessary to design a data standardization testing method based on a data dictionary. By utilizing the standard data of the standard system and combining it with a standardized modeling system, it is possible to quickly build models directly through standard tables and standard fields, saving a lot of manual work in designing models, and ensuring that the model structure is standardized, thus ensuring the standard and reliability of data from the source. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the prior art and provide a data standardization testing method based on a data dictionary. By utilizing the standard data of the standard system and combining it with a standardized modeling system, the method can directly build models quickly through standard tables and standard fields, saving a lot of manual work in designing models, and ensuring the standard specifications of the model structure, thereby ensuring the standard and reliability of the data from the source.

[0007] In order to achieve the above object, the present invention provides a data standardization testing method based on a data dictionary:

[0008] Includes a data dictionary model consisting of functional architecture and business architecture;

[0009] S1, the functional architecture includes standard compliance testing, standard approval management, standard system document management, standard system management and basic support;

[0010] Standards compliance testing includes standards testing;

[0011] Standard approval management includes standard document approval, standard table approval, standard field approval and standard code approval. Standard system document management includes standard documents and standard terminology.

[0012] Standard system management includes standard tables, standard fields and standard codes;

[0013] Basic support includes user management, organization management, tenant management, data source management, permission control and system logs;

[0014] S2, business architecture includes standard testing business, standardized modeling system, standard system design, national and local general standards and industry vertical standards; the steps of business architecture include:

[0015] S2-1, design a standard system for data through national and local general standards and industry vertical standards;

[0016] S2-2, Standard system design conducts standard testing and quality evaluation through standard documents, standard tables, standard fields, standard codes and standard terms, and forms a test report;

[0017] S2-3, the standardized modeling system establishes a standard library and forms a data model design through standard system design.

[0018] Standard tests in S2-2 include report template management, creating test plans, creating test tasks, and generating test reports;

[0019] Report template management provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for the subsequent rapid generation of standard test reports. It includes the ability to add, edit, delete, view, and filter report templates. Specifically, it includes:

[0020] Report template content editing: supports online editing of the text content of the report template;

[0021] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0022] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0023] Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports.

[0024] Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template;

[0025] Report download: Provide report download function and generate reports in word format;

[0026] Creating a test plan provides the definition and management of standard test plans. According to different businesses and industries, targeted standard test plans are formulated and different applicable standard ranges are defined. Each plan applies a different standard system to meet the standard test needs in multiple scenarios. The test plan is used to create standard test tasks and is the basis for standard testing. It includes the ability to add, edit, delete, view, filter, and view associated tasks for the test plan. Specifically, it includes:

[0027] Testing scheme standard configuration: Provides the selection, configuration and viewing of the applicable standard range of the testing scheme, and supports priority selection based on the evaluation priority when multiple standards conflict;

[0028] Detection plan replication: supports the replication of detection plans to facilitate the rapid reuse of business experience;

[0029] Detection scheme control: supports the management of enabling and disabling detection schemes. Only enabled schemes can be officially used for detection.

[0030] Create a test task. Use the standard test plan to create a test task to test the data for standard compliance, and generate a customized test report based on the selected report template. Standard test tasks require selecting the library table objects to be tested and configuring the corresponding data elements for the library table fields. After the task is executed, the system performs standard compliance tests on the library table fields according to the data element requirements corresponding to each field, and provides the addition, editing, deletion, viewing, and filtering of test tasks. Specifically, it includes:

[0031] Detection field configuration: supports configuration association of data elements for library table fields, and supports standard intelligent automatic recommendation association;

[0032] Detection task replication: supports the replication of detection tasks to facilitate the rapid reuse of business experience;

[0033] Inspection task control: supports the execution and suspension of inspection tasks. After the task is completed, an inspection report will be generated according to the report template.

[0034] Generate test reports Through standard test reports, you can get a detailed and comprehensive understanding of the data's compliance with standards; through customized report templates, you can generate different test report results to ensure that the output report content fits the actual business concerns and provide the ability to view and filter standard reports; specifically, it includes:

[0035] Report template content editing: supports online editing of the text content of the report template;

[0036] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0037] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0038] Report template publishing: supports publishing and unpublishing of report templates. Only published report templates can be officially used to generate test reports.

[0039] The quality evaluation in S2-2 includes intelligent identification, detection scheme, quality rules, detection tasks and detection reports.

[0040] Intelligent recognition provides basic and structural analysis of database tables, conducts phased management and exploration of table contents, formulates and identifies quality rules for table fields, and recommends corresponding quality inspection rules through AI. Specifically, it includes:

[0041] Column analysis: supports basic analysis and structural analysis of tables in the database. Basic analysis is to analyze the null values, duplicate values, length, and frequency information in the table to discover data patterns and basic data quality issues; structural analysis is to analyze the structure of the data in the table and sort it. Structural analysis can help understand the basic situation of data quality.

[0042] Smart staging: supports staging management of table data, and performs staging exploration of data according to the time staging field to detect data volume fluctuations;

[0043] Rule recognition: supports the use of built-in data rule recognition algorithms to automatically discover three types of rule recognition: function dependency, value range, and dictionary in the table, and implement rule storage operations;

[0044] Quality rule recommendation: supports identification of table fields, uses AI recognition to quickly recommend quality detection rules for detection fields.

[0045] The testing plan provides the definition and management of quality testing plans. According to different businesses, industries, and different quality requirements, targeted quality testing plans are formulated; specifically, they include:

[0046] Inspection plan management: manage and maintain quality inspection plan information, including plan name and description, and support adding, editing, and deleting functions;

[0047] Inspection indicator management: manage and maintain indicator information under the scheme, define applicable objects and use standard range for each scheme, make judgments based on pre-set priorities when multiple standards conflict, support indicator system design for inspection schemes, and create or introduce built-in indicator systems;

[0048] Detection solution replication: Provides solution replication capability to achieve rapid reuse of standard system configurations.

[0049] Quality rule formulation includes basic rules and general rules. By screening the business data fields to be tested, data quality detection rules for each data table and field are formulated; specifically, they include:

[0050] Basic rules: support the maintenance of basic rules under the corresponding detection scheme, and support the addition, editing and deletion of basic rules;

[0051] General rules: Maintain and manage general rules for reference and recommendation of basic rules. Support operations by binding standard fields through rules for AI intelligent recommendation of detection rules.

[0052] The detection task creates a quality detection task, selects the detection scheme and report template, configures the alarm threshold, implements the quality task operation on the target data, and finally produces a quality detection report; it specifically includes:

[0053] Inspection task management: Provides inspection task management capabilities and selects inspection plans for inspection tasks. After selection, the task will be inspected according to the applicable standards in the plan;

[0054] Intelligent task configuration: select a report template, generate a test report based on the template, provide standard intelligent configuration, and recommend standard fields in batches with one click;

[0055] Detection task replication: Provides task replication capability to achieve rapid reuse of standard configurations.

[0056] The test report provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for subsequent rapid generation of standard test reports. It also includes the ability to add, edit, delete, view, and filter report templates. Specifically, it includes:

[0057] Report template content editing: supports online editing of the text content of the report template;

[0058] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated; in the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0059] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0060] Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports.

[0061] Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template;

[0062] Report download: Provides report download function to generate reports in word format.

[0063] Compared with the prior art, the present invention has the following beneficial effects:

[0064] The present invention forms a top-down standard system management of four levels of library, table, field and code by associating standard table classification with standard table, associating standard table with standard field, and associating standard field with standard code.

[0065] The present invention is based on Standard fields as well as Standard Code , perform standard compliance tests on the type, length, precision, code, etc. of the library table data, and promptly discover irregular and non-standard data.

[0066] The present invention provides the ability to quickly query and view standards. Through fuzzy matching and precise matching of keywords, relevant standards can be quickly located to view detailed information and related information.

[0067] The approval function of the present invention provides a complete business approval process for standard changes, ensuring that all changes to the standard are under control and standardizing the standard management process.

[0068] In general, the present invention improves the data service level and quality by building a unified standard system and performing data standardization processing according to unified standards, thereby forming a unified and standardized external business caliber and terminology and standardized and normalized data. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1 It is a functional architecture diagram of the present invention.

[0070] Figure 2 It is a schematic diagram of the business architecture of the present invention. DETAILED DESCRIPTION

[0071] See also Figures 1-2 The present invention is now further described in conjunction with the accompanying drawings. The present invention provides a data standardization test method based on a data dictionary:

[0072] Includes a data dictionary model consisting of functional architecture and business architecture;

[0073] S1, the functional architecture includes standard compliance testing, standard approval management, standard system document management, standard system management and basic support;

[0074] Standards compliance testing includes standards testing;

[0075] Standard approval management includes standard document approval, standard table approval, standard field approval and standard code approval. Standard system document management includes standard documents and standard terminology.

[0076] Standard system management includes standard tables, standard fields and standard codes;

[0077] Basic support includes user management, organization management, tenant management, data source management, permission control and system logs;

[0078] S2, business architecture includes standard testing business, standardized modeling system, standard system design, national and local general standards and industry vertical standards; the steps of business architecture include:

[0079] S2-1, design a standard system for data through national and local general standards and industry vertical standards;

[0080] S2-2, Standard system design conducts standard testing and quality evaluation through standard documents, standard tables, standard fields, standard codes and standard terms, and forms a test report;

[0081] S2-3, the standardized modeling system establishes a standard library and forms a data model design through standard system design.

[0082] Standard tests in S2-2 include report template management, creating test plans, creating test tasks, and generating test reports;

[0083] Report template management provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for the subsequent rapid generation of standard test reports. It includes the ability to add, edit, delete, view, and filter report templates. Specifically, it includes:

[0084] Report template content editing: supports online editing of the text content of the report template;

[0085] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0086] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0087] Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports.

[0088] Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template;

[0089] Report download: Provide report download function and generate reports in word format;

[0090] Creating a test plan provides the definition and management of standard test plans. According to different businesses and industries, targeted standard test plans are formulated and different applicable standard ranges are defined. Each plan applies a different standard system to meet the standard test needs in multiple scenarios. The test plan is used to create standard test tasks and is the basis for standard testing. It includes the ability to add, edit, delete, view, filter, and view associated tasks for the test plan. Specifically, it includes:

[0091] Testing scheme standard configuration: Provides the selection, configuration and viewing of the applicable standard range of the testing scheme, and supports priority selection based on the evaluation priority when multiple standards conflict;

[0092] Detection plan replication: supports the replication of detection plans to facilitate the rapid reuse of business experience;

[0093] Detection scheme control: supports the management of enabling and disabling detection schemes. Only enabled schemes can be officially used for detection.

[0094] Create a test task. Use the standard test plan to create a test task to test the data for standard compliance, and generate a customized test report based on the selected report template. Standard test tasks require selecting the library table objects to be tested and configuring the corresponding data elements for the library table fields. After the task is executed, the system performs standard compliance tests on the library table fields according to the data element requirements corresponding to each field, and provides the addition, editing, deletion, viewing, and filtering of test tasks. Specifically, it includes:

[0095] Detection field configuration: supports configuration association of data elements for library table fields, and supports standard intelligent automatic recommendation association;

[0096] Detection task replication: supports the replication of detection tasks to facilitate the rapid reuse of business experience;

[0097] Inspection task control: supports the execution and suspension of inspection tasks. After the task is completed, an inspection report will be generated according to the report template.

[0098] Generate test reports Through standard test reports, you can get a detailed and comprehensive understanding of the data's compliance with standards; through customized report templates, you can generate different test report results to ensure that the output report content fits the actual business concerns and provide the ability to view and filter standard reports; specifically, it includes:

[0099] Report template content editing: supports online editing of the text content of the report template;

[0100] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0101] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0102] Report template publishing: supports publishing and unpublishing of report templates. Only published report templates can be officially used to generate test reports.

[0103] The quality evaluation in S2-2 includes intelligent identification, detection scheme, quality rules, detection tasks and detection reports.

[0104] Intelligent recognition provides basic and structural analysis of database tables, conducts phased management and exploration of table contents, formulates and identifies quality rules for table fields, and recommends corresponding quality inspection rules through AI. Specifically, it includes:

[0105] Column analysis: supports basic analysis and structural analysis of tables in the database. Basic analysis is to analyze the null values, duplicate values, length, and frequency information in the table to discover data patterns and basic data quality issues; structural analysis is to analyze the structure of the data in the table and sort it. Structural analysis can help understand the basic situation of data quality.

[0106] Smart staging: supports staging management of table data, and performs staging exploration of data according to the time staging field to detect data volume fluctuations;

[0107] Rule recognition: supports the use of built-in data rule recognition algorithms to automatically discover three types of rule recognition: function dependency, value range, and dictionary in the table, and implement rule storage operations;

[0108] Quality rule recommendation: supports identification of table fields, uses AI recognition to quickly recommend quality detection rules for detection fields.

[0109] The testing plan provides the definition and management of quality testing plans. According to different businesses, industries, and different quality requirements, targeted quality testing plans are formulated; specifically, they include:

[0110] Inspection plan management: manage and maintain quality inspection plan information, including plan name and description, and support adding, editing, and deleting functions;

[0111] Inspection indicator management: manage and maintain indicator information under the scheme, define applicable objects and use standard range for each scheme, make judgments based on pre-set priorities when multiple standards conflict, support indicator system design for inspection schemes, and create or introduce built-in indicator systems;

[0112] Detection solution replication: Provides solution replication capability to achieve rapid reuse of standard system configurations.

[0113] Quality rule formulation includes basic rules and general rules. By screening the business data fields to be tested, data quality detection rules for each data table and field are formulated; specifically, they include:

[0114] Basic rules: support the maintenance of basic rules under the corresponding detection scheme, and support the addition, editing and deletion of basic rules;

[0115] General rules: Maintain and manage general rules for reference and recommendation of basic rules. Support operations by binding standard fields through rules for AI intelligent recommendation of detection rules.

[0116] The detection task creates a quality detection task, selects the detection scheme and report template, configures the alarm threshold, implements the quality task operation on the target data, and finally produces a quality detection report; it specifically includes:

[0117] Inspection task management: Provides inspection task management capabilities and selects inspection plans for inspection tasks. After selection, the task will be inspected according to the applicable standards in the plan;

[0118] Intelligent task configuration: select a report template, generate a test report based on the template, provide standard intelligent configuration, and recommend standard fields in batches with one click;

[0119] Detection task replication: Provides task replication capability to achieve rapid reuse of standard configurations.

[0120] The test report provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for subsequent rapid generation of standard test reports. It also includes the ability to add, edit, delete, view, and filter report templates. Specifically, it includes:

[0121] Report template content editing: supports online editing of the text content of the report template;

[0122] Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated; in the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task;

[0123] Report template copying: supports copying report templates to facilitate quick reuse of templates;

[0124] Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports.

[0125] Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template;

[0126] Report download: Provides report download function to generate reports in word format.

[0127] The above are only preferred embodiments of the present invention, which are only used to help understand the method and core ideas of the present application. The protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

[0128] The above embodiments can be implemented in whole or in part by software or hardware. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When a computer instruction or computer program is loaded or executed on a computer, a process or function according to an embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0129] The present invention solves the shortcomings in the prior art that data is difficult to share and exchange due to different definitions, descriptions and formats of the same data among business departments, resulting in missing data standards, inconsistent standards and imperfect standard systems, which affects the value of data. By building a unified standard system and standardizing data according to unified standards, a unified and standardized business caliber and terminology as well as normalized and standardized data are formed, thereby improving the level and quality of data services.

Claims

1. A data standardization testing method based on a data dictionary, characterized in that: Includes a data dictionary model consisting of functional architecture and business architecture; S1, the functional architecture includes standard compliance testing, standard approval management, standard system document management, standard system management and basic support; The standard compliance test includes a standard test; The standard approval management includes standard document approval, standard table approval, standard field approval and standard code approval; The standard system document management includes standard documents and standard terminology; The standard system management includes standard tables, standard fields and standard codes; The basic support includes user management, organization management, tenant management, data source management, permission control and system log; S2, the business architecture includes standard testing business, standardized modeling system, standard system design, national and local general standards and industry vertical standards; The steps of the business architecture include: S2-1, design the standard system through the national and local general standards and industry vertical standards; S2-2, the standard system design is to conduct standard testing and quality evaluation through standard documents, standard tables, standard fields, standard codes and standard terms, and form a test report; S2-3, the standardized modeling system establishes a standard library and forms a data model design through the standard system design.

2. The data standardization test method based on data dictionary according to claim 1 is characterized in that: The standard test in S2-2 includes report template management, creation of test plans, creation of test tasks and generation of test reports; The report template management provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for subsequent rapid generation of standard test reports. Includes the ability to add, edit, delete, view, and filter report templates; Specifically include: Report template content editing: supports online editing of the text content of the report template; Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task; Report template copying: supports copying report templates to facilitate quick reuse of templates; Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports. Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template; Report download: Provide report download function and generate reports in word format; The creation of the test plan provides the definition and management of the standard test plan. According to different businesses and industries, targeted standard test plans are formulated and different applicable standard ranges are defined. Each plan applies a different standard system to meet the standard test requirements in multiple scenarios. The test plan is used to create standard test tasks and is the basis for standard testing. It includes the ability to add, edit, delete, view, filter, and view associated tasks for the test plan. Specifically, it includes: Testing scheme standard configuration: Provides the selection, configuration and viewing of the applicable standard range of the testing scheme, and supports priority selection based on the evaluation priority when multiple standards conflict; Detection plan replication: supports the replication of detection plans to facilitate the rapid reuse of business experience; Detection scheme control: supports the management of enabling and disabling detection schemes. Only enabled schemes can be officially used for detection. The creation of the detection task utilizes the standard detection scheme, creates the detection task to perform standard compliance detection on the data, and generates a customized detection report according to the selected report template; the standard detection task requires the selection of the library table object to be detected, and the configuration of the corresponding data element for the library table field; after the task is executed, the system performs standard compliance detection on the library table field according to the data element requirements corresponding to each field, and provides the addition, editing, deletion, viewing, and screening of the detection task; which specifically includes: Detection field configuration: supports configuration association of data elements for library table fields, and supports standard intelligent automatic recommendation association; Detection task replication: supports the replication of detection tasks to facilitate the rapid reuse of business experience; Inspection task control: supports the execution and suspension of inspection tasks. After the task is completed, an inspection report will be generated according to the report template. The test report generation method uses standard test reports to provide a detailed and comprehensive understanding of the data's compliance with standards; generates different test report results through customized report templates to ensure that the output report content fits the actual business concerns and provides the ability to view and filter standard reports; specifically, it includes: Report template content editing: supports online editing of the text content of the report template; Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated. In the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task; Report template copying: supports copying report templates to facilitate quick reuse of templates; Report template publishing: supports publishing and unpublishing of report templates. Only published report templates can be officially used to generate test reports.

3. The data standardization test method based on data dictionary according to claim 1 is characterized in that: The quality evaluation in S2-2 includes intelligent identification, detection scheme, quality rules, detection tasks and detection reports.

4. The data standardization test method based on data dictionary according to claim 3 is characterized in that: The intelligent recognition provides basic analysis and structural analysis of database tables, conducts phased management exploration of data table contents, formulates and identifies quality rules for table fields, and recommends corresponding quality inspection rules through AI; Specifically include: Column analysis: supports basic analysis and structural analysis of tables in the database. The basic analysis is to analyze the null values, duplicate values, length, and frequency information in the table to find data patterns and basic data quality issues; the structural analysis is to analyze the structure of the data in the table and sort it. Structural analysis can help understand the basic situation of data quality; Smart staging: supports staging management of table data, and performs staging exploration of data according to the time staging field to detect data volume fluctuations; Rule recognition: supports the use of built-in data rule recognition algorithms to automatically discover three types of rule recognition: function dependency, value range, and dictionary in the table, and implement rule storage operations; Quality rule recommendation: supports identification of table fields, uses AI recognition to quickly recommend quality detection rules for detection fields.

5. The data standardization test method based on data dictionary according to claim 3 is characterized in that: The testing plan provides the definition and management of quality testing plans, and formulates targeted quality testing plans according to different businesses, industries, and different quality requirements and constraints; Specifically include: Inspection plan management: manage and maintain quality inspection plan information, including plan name and description, and support adding, editing, and deleting functions; Inspection indicator management: manage and maintain indicator information under the scheme, define applicable objects and use standard range for each scheme, make judgments based on pre-set priorities when multiple standards conflict, support indicator system design for inspection schemes, and create or introduce built-in indicator systems; Detection solution replication: Provides solution replication capability to achieve rapid reuse of standard system configurations. The data standardization test method based on data dictionary according to claim 3 is characterized in that the quality rule formulation includes basic rules and general rules, and the data quality detection rules for each data table and field are formulated by screening the business data fields to be tested; which specifically includes: Basic rules: support the maintenance of basic rules under the corresponding detection scheme, and support the addition, editing and deletion of basic rules; General rules: Maintain and manage general rules for reference and recommendation of basic rules. Support operations by binding standard fields through rules for AI intelligent recommendation of detection rules.

6. The data standardization test method based on data dictionary according to claim 3 is characterized in that: The detection task creates a quality detection task, selects a detection scheme and a report template, configures an alarm threshold, implements the quality task operation on the target data, and finally produces a quality detection report; Specifically include: Inspection task management: Provides inspection task management capabilities and selects inspection plans for inspection tasks. After selection, the task will be inspected according to the applicable standards in the plan; Intelligent task configuration: select a report template, generate a test report based on the template, provide standard intelligent configuration, and recommend standard fields in batches with one click; Detection task replication: Provides task replication capability to achieve rapid reuse of standard configurations.

7. The data standardization test method based on data dictionary according to claim 3 is characterized in that: The test report provides the ability to customize the test report template. By uploading the template file, the report template content can be configured online for subsequent rapid generation of standard test reports. It also includes the ability to add, edit, delete, view, and filter report templates. Specifically include: Report template content editing: supports online editing of the text content of the report template; Report template indicator configuration: supports inserting detection indicators into the report template, and selecting the indicator's numerical value and bar chart display method when the report is finally generated; in the report generated according to the report template, the corresponding real indicator result data will be displayed according to the detection results of the detection task; Report template copying: supports copying report templates to facilitate quick reuse of templates; Report template publishing: supports publishing and canceling report templates. Only published report templates can be officially used to generate test reports. Report viewing: The business system provides real data in the report through the interface, and the system renders and displays the report according to the report template; Report download: Provides report download function to generate reports in word format.

Images