Tool for compiling and treating government affair data catalog

Abstract

The invention discloses a tool for compiling and governing a government affair data catalog, which relates to the technical field of government affair data, and comprises a catalog management module for supporting the functions of data classification management, catalog basic element compiling, catalog basic element claiming, catalog extension element compiling, business system management and catalog migration management, creating, maintaining and dynamically adjusting a government affair data directory; the directory management module is responsible for accessing and managing an external directory data source and has four functions of data source management, data standard management, data quality management and flow arrangement; and the directory evaluation module provides index management, data service, external data connection and deep analysis mining functions, and supports efficiency evaluation and decision support for the government affair data directory. Uniformity, timeliness, accuracy and high-quality management of government affair data catalogues can be achieved, and the problems that existing catalogue compilation standards and specifications are not uniform, updating and maintenance are lagged, and data quality is poor are solved.

Description

Technical Field

[0001] The present invention relates to the field of government data technology, and specifically to a tool for compiling and managing government data directories. Background Art

[0002] The compilation dimensions of government data directories are usually divided by region or line, and different lines (different departments or business areas) and regions use relatively independent data directory compilation and management systems.

[0003] The current status of government data directory governance has some problems and challenges that need to be analyzed and resolved in depth:

[0004] (1) Inconsistency in standards and specifications: At present, there is no unified standard and specification for the compilation and management of government data directories. The compilation and management of directories in various regions and departments are differentiated and fragmented, resulting in insufficient uniformity and consistency in government data directories.

[0005] (2) Update and maintenance lags: There is a certain lag in the update and maintenance of government data directories, which cannot promptly reflect the latest status of information resources of relevant departments, resulting in low timeliness and accuracy of the information resource directories of relevant departments.

[0006] (3) Data quality needs to be improved: The quality and accuracy of government data directories need to be improved, which affects the effective management and utilization of information resources of relevant departments and also brings certain difficulties to the analysis and decision-making of government data. Summary of the invention

[0007] In response to the needs and shortcomings of current technological development, the present invention provides a tool for the compilation and management of government data directories to solve technical problems existing in traditional data directory management, such as inconsistent standards and specifications, delayed updates and maintenance, and poor data quality.

[0008] The tool for compiling and managing government data catalogs of the present invention adopts the following technical solutions to solve the above technical problems:

[0009] A tool for cataloguing and governing government data, including:

[0010] The directory management module supports the creation, maintenance and dynamic adjustment of government data directories through the functions of data classification management, directory basic element compilation, directory basic element claiming, directory extension element compilation, business system management and directory migration management;

[0011] The catalog governance module is responsible for the access and governance of external catalog data sources, including four functions: data source management, data standard management, data quality management, and process orchestration;

[0012] The directory evaluation module provides indicator management, data services, external data connection and in-depth analysis and mining functions, supporting the performance evaluation and decision support of the government data directory.

[0013] Optionally, the catalog management module involved provides online entry, change, and offline functions of data classification for each business field or industry line through the data classification management function;

[0014] The catalog management module supports the business guidance departments of industry lines in compiling, reviewing, publishing, updating and revoking the basic elements of the catalog through the compilation function of the basic elements of the catalog;

[0015] The catalog management module supports the business departments at all levels to claim, partially claim, not claim, and change the claim of catalog basic elements through the catalog basic element claim function;

[0016] The catalog management module supports business departments at all levels to reference catalog basic elements, compile, review and publish catalog extension elements through the catalog extension element compilation function;

[0017] The catalog management module supports business departments at all levels to compile, review and publish business system information through business system management functions, supports the customization of business items and the ability to associate business system names with multiple business items, and supports the classification of business systems in the fields of vertical management, self-built and self-used, and regional management;

[0018] The catalog management module implements the screening and display of migratable catalogs through the catalog migration management function, supports multi-business dimension retrieval of catalogs, and supports matching and association operations with new catalogs.

[0019] Further optionally, the directory management module involved supports both "bottom-up" and "top-down" modes through the directory basic element compilation function. Each business line is coordinated by the business guidance department and several supporting departments to clarify the basic elements of the government data directory, including:

[0020] The "bottom-up" model starts from the grassroots or lower-level business departments and gradually advances to the superior or higher-level management departments. That is, first collect requirements and information from the departments or personnel who actually use the data, and then summarize and report the collected data to the superior department for review and integration;

[0021] The "top-down" model starts from the top or higher management department of the organization and conveys instructions and requirements to lower-level departments. That is, the senior guidance department first determines the basic framework and standards of the data directory, and then the business departments at all levels refine and implement them on this basis.

[0022] Optionally, the constituent elements of the government data catalog are used to describe the characteristics of government data, including basic elements and extended elements;

[0023] The catalog management module formulates the basic elements of the government data catalog through the catalog basic element compilation function, including the following standard contents: data catalog name, data category, classification code, data field, data item name, data item code, data type, data source item basic element name, data source item basic element code, data source item business item name, data source item business item code, data level, government data summary;

[0024] The directory management module formulates the extended elements of the government data directory through the directory extension element compilation function, which includes the following standard contents: data directory code, data item name, data item code, data type, sharing type, usage requirements, source system, source system code, system classification, data source item implementation list or service guide name, data source item implementation list or service guide code, data-related item basic element name, data-related item basic element code, data classification, data processing degree, data area range, data time range, government data provider, government data summary, update cycle, and whether to publish.

[0025] Optionally, the directory governance module involved provides the functions of adding, viewing, modifying and deleting directory data sources through the data source management function, supports multiple data source types, and maintains the organizational relationship of data sources in the form of a directory tree;

[0026] The catalog governance module provides the functions of adding, importing, editing, exporting, deleting, and batch deleting data dictionaries through data standard management functions;

[0027] The catalog governance module supports the customization of data quality detection rules, quality detection task management, operation and maintenance, and abnormal data viewing through data quality management functions;

[0028] The catalog governance module uses the process orchestration function to combine multiple data quality detection rules in a serial and parallel manner to form a unified data quality detection process, providing visual, drag-and-drop process orchestration capabilities and supporting template management.

[0029] Preferably, the directory governance module involved supports multiple data source types including JDBC type, big data type, FTP, SFTP, and SSH through the data source management function.

[0030] Further optionally, the catalog evaluation module involved provides indicator classification definition, indicator basic content creation and maintenance functions through indicator management functions, and provides indicator calculation model definition and data requirement definition functions;

[0031] The catalog evaluation module provides indicator viewing, indicator data acquisition services, and evaluation report generation functions through the indicator data service function;

[0032] The catalog evaluation module provides configuration functions through data docking functions, regularly reads various parameters of external data, provides a service interface for indicator calculation data, obtains external indicator calculation data on demand, and provides a service interface for external system calls. The external system submits indicator calculation data by calling the service interface;

[0033] The catalog evaluation module provides analysis process and analysis model management functions through analysis and mining functions, integrates various analysis components, and can be managed and called in a unified manner, providing analysis data management and analysis model execution functions.

[0034] Further optionally, the basic contents of the indicators created by the indicator management function of the directory evaluation module involved include: the level of the directory compilation department, the scope and line coverage of the data directory, the granularity of the data classification, the completion rate of the data directory compilation, the pass rate of data directory reconciliation, quality inspection, and governance, and the dynamic update rate of the data directory.

[0035] Compared with the prior art, the tool for compiling and managing government data catalogs of the present invention has the following beneficial effects:

[0036] 1. The present invention not only solves the problem of inconsistent standards and specifications for compiling government data directories, but also solves the problems of delayed updating and maintenance of government data directories and poor data quality, thus achieving unified, timely, accurate and high-quality management of government data directories;

[0037] 2. The present invention formulates unified data directory standards and specifications through the data classification management and directory basic element compilation functions in the directory management module, ensuring that the data directory compilation and management systems between different lines (different departments or business fields) and regions are relatively independent but follow unified standards, thereby improving the updating and maintenance efficiency of the government data directory, ensuring that the directory can timely reflect the latest information resource situation, and improving the timeliness and accuracy of the directory;

[0038] 3. The present invention realizes the screening and display of migratable directories through the directory migration management function in the directory management module, supports multi-business dimension retrieval of the directory, supports matching and association operations with new directories, and supports performance evaluation and decision support for government data directories through the indicator management, data services, external data docking and in-depth analysis and mining functions provided by the directory evaluation module, thereby improving the updating and maintenance efficiency of the government data directory, ensuring that the directory can timely reflect the latest information resource status, and improving the timeliness and accuracy of the directory.

[0039] 4. The present invention supports the customization of data quality detection rules, quality detection task management, operation and maintenance, and abnormal data viewing functions through the data quality management function in the directory governance module. Through the process orchestration function in the directory governance module, multiple data quality detection rules are combined in a serial and parallel manner to form a unified data quality detection process, providing visual, drag-and-drop process orchestration capabilities, and supporting template management, thereby improving the quality and accuracy of the government data directory, ensuring that the data can effectively support the information resource management and utilization of relevant departments, and improving the accuracy and reliability of data analysis and decision-making. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Attached Figure 1 It is a schematic diagram of module functions of the present invention. DETAILED DESCRIPTION

[0041] In order to make the technical solution, the technical problem solved and the technical effect of the present invention more clearly understood, the technical solution of the present invention is clearly and completely described below in conjunction with specific embodiments.

[0042] Embodiment 1:

[0043] Combined with Figure 1 This embodiment proposes a tool for compiling and managing government data directories, which includes:

[0044] The directory management module supports the creation, maintenance and dynamic adjustment of government data directories through the functions of data classification management, directory basic element compilation, directory basic element claiming, directory extension element compilation, business system management and directory migration management;

[0045] The catalog governance module is responsible for the access and governance of external catalog data sources, including four functions: data source management, data standard management, data quality management, and process orchestration;

[0046] The directory evaluation module provides indicator management, data services, external data connection and in-depth analysis and mining functions, supporting the performance evaluation and decision support of the government data directory.

[0047] In this embodiment, the directory management module involved provides the functions of online entry, change, and offline of data classification for each business field or industry line through the data classification management function; the directory management module supports the business guidance department of the industry line to compile, review, publish, update, and revoke the basic elements of the directory through the directory basic element compilation function; the directory management module supports the business departments at all levels to claim, partially claim, not claim, and change the claim of the basic elements of the directory through the directory basic element claim function; the directory management module supports the business departments at all levels to quote the basic elements of the directory, compile, review, and publish the functions of directory extension elements through the directory extension element compilation function; the directory management module supports the business departments at all levels to compile, review, and publish business system information through the business system management function, supports the customization of business matters and the ability to associate business system names with multiple business matters, and supports the field classification of business systems in vertical management, self-built and self-used, and regional management; the directory management module implements the screening and display of migratable directories through the directory migration management function, supports multi-business dimension retrieval of the directory, and supports matching and association operations with new directories.

[0048] The directory management module supports both "bottom-up" and "top-down" modes through the directory basic elements compilation function. Each business line is coordinated by the business guidance department and several supporting departments to clarify the basic elements of the government data directory, including:

[0049] The "bottom-up" model starts from the grassroots or lower-level business departments and gradually advances to the superior or higher-level management departments. That is, first collect requirements and information from the departments or personnel who actually use the data, and then summarize and report the collected data to the superior department for review and integration;

[0050] The "top-down" model starts from the top or higher management department of the organization and conveys instructions and requirements to lower-level departments. That is, the senior guidance department first determines the basic framework and standards of the data directory, and then the business departments at all levels refine and implement them on this basis.

[0051] The components of the government data catalog are used to describe the characteristics of government data, including basic elements and extended elements;

[0052] The catalog management module formulates the basic elements of the government data catalog through the catalog basic element compilation function, including the following standard contents: data catalog name, data category, classification code, data field, data item name, data item code, data type, data source item basic element name, data source item basic element code, data source item business item name, data source item business item code, data level, government data summary;

[0053] The directory management module formulates the extended elements of the government data directory through the directory extension element compilation function, which includes the following standard contents: data directory code, data item name, data item code, data type, sharing type, usage requirements, source system, source system code, system classification, data source item implementation list or service guide name, data source item implementation list or service guide code, data-related item basic element name, data-related item basic element code, data classification, data processing degree, data area range, data time range, government data provider, government data summary, update cycle, and whether to publish.

[0054] In this embodiment, the directory governance module involved provides the functions of adding, viewing, modifying and deleting directory data sources through the data source management function, supports JDBC type, big data type, FTP, SFTP, SSH and other data source types, and maintains the organizational relationship of the data source in the form of a directory tree;

[0055] The catalog governance module provides the functions of adding, importing, editing, exporting, deleting, and batch deleting data dictionaries through data standard management functions;

[0056] The catalog governance module supports the customization of data quality detection rules, quality detection task management, operation and maintenance, and abnormal data viewing through data quality management functions;

[0057] The catalog governance module uses the process orchestration function to combine multiple data quality detection rules in a serial and parallel manner to form a unified data quality detection process, providing visual, drag-and-drop process orchestration capabilities and supporting template management.

[0058] In this embodiment, the catalog evaluation module involved provides the index classification definition, index basic content creation and maintenance functions through the index management function, and provides the index calculation model definition and data requirement definition functions; wherein, the created basic content of the index includes: the level of the catalog compilation department, the scope and line coverage of the data catalog, the granularity of the data classification, the completion of the data catalog compilation, the pass rate of the data catalog reconciliation, quality inspection, and governance, and the dynamic update degree of the data catalog;

[0059] The catalog evaluation module provides indicator viewing, indicator data acquisition services, and evaluation report generation functions through the indicator data service function;

[0060] The catalog evaluation module provides configuration functions through data docking functions, regularly reads various parameters of external data, provides a service interface for indicator calculation data, obtains external indicator calculation data on demand, and provides a service interface for external system calls. The external system submits indicator calculation data by calling the service interface;

[0061] The catalog evaluation module provides analysis process and analysis model management functions through analysis and mining functions, integrates various analysis components, and can be managed and called in a unified manner, providing analysis data management and analysis model execution functions.

[0062] In summary, the use of a tool for the compilation and management of government data directories according to the present invention can achieve unified, timely, accurate and high-quality management of government data directories, solve the problem of inconsistent standards and specifications for the compilation of government data directories, and also solve the problems of delayed updates and maintenance of government data directories and poor data quality.

[0063] The above specific examples are used to explain the principles and implementation methods of the present invention in detail. These examples are only used to help understand the core technical content of the present invention. Based on the above specific embodiments of the present invention, any improvements and modifications made by technicians in this technical field without departing from the principles of the present invention should fall within the scope of patent protection of the present invention.

Claims

1. A tool for compiling and managing government data catalogs, characterized in that: It includes: The directory management module supports the creation, maintenance and dynamic adjustment of government data directories through the functions of data classification management, directory basic element compilation, directory basic element claiming, directory extension element compilation, business system management and directory migration management; The catalog governance module is responsible for the access and governance of external catalog data sources, including four functions: data source management, data standard management, data quality management, and process orchestration; The directory evaluation module provides indicator management, data services, external data connection and in-depth analysis and mining functions, supporting the performance evaluation and decision support of the government data directory.

2. A tool for compiling and managing government data catalogs according to claim 1, characterized in that: The catalog management module provides online data entry, change and offline functions for data categories in various business fields or industry lines through the data category management function; The catalog management module supports the business guidance departments of the industry lines in compiling, reviewing, publishing, updating and revoking the basic elements of the catalog through the catalog basic elements compilation function; The catalog management module supports the functions of business departments at all levels to claim, partially claim, not claim, and change the claim of catalog basic elements through the catalog basic element claim function; The catalog management module supports the business departments at all levels to reference the basic elements of the catalog, compile, review and publish the catalog extension elements through the catalog extension element compilation function; The directory management module supports business departments at all levels to compile, review and publish business system information through business system management functions, supports the ability to customize business items and associate business system names with multiple business items, and supports the classification of business systems in the fields of vertical management, self-built and self-used, and regional management; The directory management module implements the screening and display of migratable directories through the directory migration management function, supports multi-business dimension retrieval of directories, and supports matching and association operations with new directories.

3. A tool for compiling and managing government data catalogs according to claim 2, characterized in that: The directory management module supports both "bottom-up" and "top-down" modes through the directory basic elements compilation function. Each business line is coordinated by the business guidance department and several supporting departments to clarify the basic elements of the government data directory, including: The "bottom-up" model starts from the grassroots or lower-level business departments and gradually advances to the superior or higher-level management departments. That is, first collect requirements and information from the departments or personnel who actually use the data, and then summarize and report the collected data to the superior department for review and integration; The "top-down" model starts from the top or higher management of the organization and conveys instructions and requirements to lower-level departments. That is, the senior guidance department first determines the basic framework and standards of the data directory, and then the business departments at all levels refine and implement them on this basis.

4. A tool for compiling and managing government data catalogs according to claim 2, characterized in that: The components of the government data catalog are used to describe the characteristics of government data, including basic elements and extended elements; The directory management module formulates the basic elements of the government data directory through the directory basic element compilation function, including the following standard contents: data directory name, data category, classification code, data field, data item name, data item code, data type, data source item basic element name, data source item basic element code, data source item business item name, data source item business item code, data level, government data summary; The directory management module formulates the extension elements of the government data directory through the directory extension element compilation function, including the following standard contents: data directory code, data item name, data item code, data type, sharing type, usage requirements, source system, source system code, system classification, data source item implementation list or service guide name, data source item implementation list or service guide code, data related item basic element name, data related item basic element code, data classification, data processing degree, data area range, data time range, government data provider, government data summary, update cycle, and whether to publish.

5. A tool for compiling and managing government data catalogs according to claim 2, characterized in that: The directory governance module provides the functions of adding, viewing, modifying and deleting directory data sources through the data source management function, supports multiple data source types, and maintains the organizational relationship of data sources in the form of a directory tree; The catalog management module provides the functions of adding, importing, editing, exporting, deleting, and batch deleting data dictionaries through the data standard management function; The catalog governance module supports the customization of data quality detection rules, quality detection task management, operation and maintenance, and abnormal data viewing functions through the data quality management function; The catalog governance module combines multiple data quality detection rules in a serial and parallel manner to form a unified data quality detection process through the process orchestration function, provides visual, drag-and-drop process orchestration capabilities, and supports template management.

6. A tool for compiling and managing government data catalogs according to claim 5, characterized in that: The directory management module supports multiple data source types such as JDBC, big data, FTP, SFTP, and SSH through the data source management function.

7. A tool for compiling and managing government data catalogs according to claim 5, characterized in that: The catalog evaluation module provides indicator classification definition, indicator basic content creation and maintenance functions through the indicator management function, and provides indicator calculation model definition and data requirement definition functions; The catalog evaluation module provides indicator viewing, indicator data acquisition services, and evaluation report generation functions through the indicator data service function; The catalog evaluation module provides a configuration function through a data docking function, regularly reads various parameters of external data, provides a service interface for indicator calculation data, calls and obtains the indicator calculation data provided by the outside on demand, and provides a service interface for the external system to call. The external system submits the indicator calculation data by calling the service interface; The catalog evaluation module provides analysis process and analysis model management functions through analysis and mining functions, integrates various analysis components, and can be managed and called in a unified manner, providing analysis data management and analysis model execution functions.

8. A tool for compiling and managing government data catalogs according to claim 7, characterized in that: The basic contents of the indicators created by the directory evaluation module through the indicator management function include: the level of the directory compilation department, the scope and line coverage of the data directory, the granularity of the data classification, the completion rate of the data directory compilation, the pass rate of data directory reconciliation, quality inspection, and governance, and the dynamic update rate of the data directory.

Images