A data governance method, device, equipment, and storage medium

Abstract

This application relates to the field of data governance, and provides a data governance method, apparatus, device, and storage medium. The method includes: obtaining target data and determining the metadata within the target data; determining the association relationships between the target data and generating a data relationship graph based on the association relationships; generating standard data based on the data relationship graph and determining the governance effect under the current governance rules based on the standard data; when the governance effect does not meet the standard, adjusting the current governance rules according to the governance effect; where the governance effect not meeting the standard means that the governance value is not within the preset range. Thus, through the analysis of the data relationship graph, the resource utilization situation of the data platform can be monitored, reasonable governance can be automatically performed, the data platform development process can be optimized, and the quality of data products can be improved; by combining the graph database and NLP technologies, the barriers between IT and business can be broken through, communication can be made efficiently, and the process from the demand side to the development side can be standardized.

Description

Technical Field

[0001] The present application relates to the field of data governance, and in particular to a data governance method, apparatus, device, and storage medium. Background Art

[0002] Data governance is a set of management behaviors related to data usage in an organization. Initiated and promoted by the enterprise data governance department, it involves a series of policies and processes for formulating and implementing commercial applications and technical management of internal data across the entire enterprise.

[0003] The key to successful data governance lies in metadata management, which is a reference framework that gives context and meaning to data. Effectively governed metadata can provide a view of the data flow, the ability to perform impact analysis, a common business vocabulary, and accountability for its terms and definitions, ultimately providing an audit trail for compliance. Metadata management has become an important function that enables the IT (Internet Technology) department to monitor changes in complex data integration environments while delivering trustworthy and secure data. Therefore, good metadata management tools play a core role in global data governance.

[0004] With the popularization of big data and AI (Artificial Intelligence) applications, whether it is emerging Internet companies or enterprises transitioning from traditional models to the IT technology field, the amount of structured and unstructured data they possess has increased sharply, and the data types are complex and diverse. While maintaining high resource costs, enterprises do not know the asset value of the data they own, nor can they obtain sufficient information from non-standardized data to support business or make business decisions. Against this background, an effective data governance method and system are needed to manage the vast amount of messy data and empower the business with a data governance platform. Summary of the Invention

[0005] In view of the above problems, the present application is proposed to provide an effective data governance method, which can manage the vast amount of messy data, and a data governance method, apparatus, device, and storage medium for solving the problem of empowering the business through a data governance platform, including:

[0006] A data governance method, including:

[0007] Obtain target data and determine the metadata within the target data; wherein, the metadata types include technical types, operation types, and business types;

[0008] Determine the association relationship between the target data, and generate a data relationship graph based on the association relationship;

[0009] Generate standard data based on the data relationship graph, and determine the governance effect under the current governance rules based on the standard data;

[0010] When the governance effect does not meet the standard, adjust the current governance rules according to the governance effect; wherein, the governance effect not meeting the standard means that the governance value is not within the preset range.

[0011] Further, the step of determining the association relationship between the target data and generating a data relationship graph based on the association relationship includes:

[0012] Determine the corresponding specification information of the target data; wherein, the type of the specification information corresponds one-to-one with the type of the metadata;

[0013] Generate the association relationship based on each type of the specification information and the corresponding metadata;

[0014] Generate the data relationship graph based on the target data and the association relationship.

[0015] Further, the step of generating the association relationship based on each type of the specification information and the corresponding metadata includes:

[0016] Generate node information and attribute information based on each type of the metadata and the graph database;

[0017] Generate a corresponding relationship based on each type of the specification information;

[0018] Generate the association relationship based on the node information, the attribute information and the corresponding relationship.

[0019] Further, the step of generating standard data based on the data relationship graph and determining the governance effect under the current governance rules based on the standard data includes:

[0020] Obtain data objects based on the data relationship graph;

[0021] Generate standard data based on the data objects and business requirements;

[0022] Determine the governance effect under the current governance rules based on the standard data.

[0023] Further, the step of generating standard data based on the data objects and business requirements includes:

[0024] Determine data information based on the data objects; wherein, the data information includes data object labels, data object attributes and data object relationships;

[0025] Generate the standard data based on the data object tags, the data object attributes, the data object relationships, and the business requirements.

[0026] Further, the step of generating the standard data based on the data object tags, the data object attributes, the data object relationships, and the business requirements includes:

[0027] Generate standard coding information based on the data object tags, the data object attributes, the data object relationships, and the business requirements;

[0028] Obtain standard metrics, standard dimensions, and standard tags based on the standard coding information;

[0029] Generate the standard data based on the standard metrics, the standard dimensions, and the standard tags.

[0030] Further, the step of determining the governance effect under the current governance rules based on the standard data includes:

[0031] Determine the current governance rules based on the standard data; wherein the current governance rules include resource utilization rate and compliance rate;

[0032] Generate the governance effect based on the standard data, the resource utilization rate, and the compliance rate.

[0033] An embodiment of the present invention also discloses a data governance device, which includes:

[0034] An acquisition module, configured to acquire target data and determine the metadata in the target data; wherein the metadata types include technical type, operation type, and business type;

[0035] A generation module, configured to determine the association relationships between the target data and generate a data relationship graph based on the association relationships;

[0036] A determination module, configured to generate standard data based on the data relationship graph and determine the governance effect under the current governance rules based on the standard data;

[0037] An adjustment module, configured to adjust the current governance rules according to the governance effect when the governance effect does not meet the standard; wherein the governance effect not meeting the standard means that the governance value is not within the preset range.

[0038] An embodiment of the present invention also discloses a computer device, including a processor, a memory, and a computer program stored on the memory and capable of running on the processor. When the computer program is executed by the processor, the steps of a data governance method as described above are implemented.

[0039] An embodiment of the present invention also discloses a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of a data governance method as described above are implemented.

[0040] The present application has the following advantages:

[0041] In an embodiment of the present application, by obtaining target data and determining the metadata in the target data; wherein, the metadata types include technical type, operation type and business type; determining the association relationship between the target data, and generating a data relationship graph according to the association relationship; generating standard data according to the data relationship graph, and determining the governance effect under the current governance rules according to the standard data; when the governance effect does not meet the standard, adjusting the current governance rules according to the governance effect; wherein, the governance effect not meeting the standard means that the governance value is not within the preset range. Thus, through the analysis of the data relationship graph, the resource utilization situation of the data platform can be monitored, reasonable governance can be automatically performed, the data platform development process can be optimized, and the quality of data products can be improved; by combining the graph database and NLP (Natural Language Processing) technology, the barriers between IT and business can be broken through, efficient communication can be achieved, and the process from the demand side to the development side can be standardized. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions of the present application, the drawings required for the description of the present application will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0043] Figure 1 is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0044] Figure 2 is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0045] Figure 3 is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0046] Figure 4 is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0047] Figure 5 is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0048] Figure 6 It is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0049] Figure 7 It is a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0050] Figure 8 It is a block diagram of the structure of a data governance device provided by an embodiment of the present application;

[0051] Figure 9 It is a schematic diagram of the structure of a computer device provided by an embodiment of the present invention. Detailed implementation manners

[0052] To make the objectives, features, and advantages of the present application more obvious and understandable, the present application will be further described in detail below with reference to the accompanying drawings and specific implementation manners. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the protection scope of the present application.

[0053] Referring to Figure 1 , it shows a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0054] A data governance method, the method includes:

[0055] S110. Obtain target data and determine the metadata in the target data; wherein, the metadata types include technical type, operation type, and business type;

[0056] S120. Determine the association relationship between the target data and generate a data relationship graph according to the association relationship;

[0057] S130. Generate standard data according to the data relationship graph and determine the governance effect under the current governance rules according to the standard data;

[0058] S140. When the governance effect does not meet the standard, adjust the current governance rules according to the governance effect; wherein, the situation that the governance effect does not meet the standard means that the governance value is not within the preset range.

[0059] In an embodiment of the present application, target data is obtained, and metadata within the target data is determined; wherein, the metadata types include technical type, operation type, and business type; the association relationship between the target data is determined, and a data relationship graph is generated based on the association relationship; standard data is generated based on the data relationship graph, and the governance effect under the current governance rules is determined based on the standard data; when the governance effect does not meet the standard, the current governance rules are adjusted according to the governance effect; wherein, the governance effect not meeting the standard means that the governance value is not within the preset range. Thus, through the analysis of the data relationship graph, the resource utilization situation of the data platform can be monitored, reasonable governance can be automatically performed, the data platform development process can be optimized, and the quality of data products can be improved; by combining the graph database and NLP technology, the barriers between IT and business can be broken through, communication can be made efficiently, and the process from the demand side to the development side can be standardized.

[0060] Next, a data governance method in this exemplary embodiment will be further described.

[0061] As described in step S110, target data is obtained, and metadata within the target data is determined; wherein, the metadata types include technical type, operation type, and business type.

[0062] It should be noted that by obtaining target data, the metadata within the target data is determined, wherein the metadata types at least include technical type, i.e., technical metadata, operation type, i.e., operation metadata, and business type, i.e., business metadata; that is, metadata can be divided into technical metadata, operation metadata, and business metadata.

[0063] As described in step S120, the association relationship between the target data is determined, and a data relationship graph is generated based on the association relationship.

[0064] It should be noted that a data relationship graph is generated through the management relationship between the target data, that is, a data relationship graph is generated through the association relationship among technical metadata, operation metadata, and business metadata and themselves.

[0065] In an embodiment of the present invention, the specific process of "determining the association relationship between the target data and generating a data relationship graph based on the association relationship" described in step S120 can be further described in combination with the following description.

[0066] Refer to Figure 2 , which shows a step flowchart of a data governance method provided in an embodiment of the present application;

[0067] As described in the following steps,

[0068] S210. Determine the specification information corresponding to the target data; wherein, the type of the specification information corresponds one-to-one with the type of the metadata.

[0069] S220. Generate the association relationship based on the specification information of each type and the corresponding metadata.

[0070] S230. Generate the data relationship graph based on the target data and the association relationship.

[0071] It should be noted that to determine the specification information corresponding to the target data, wherein the type of the specification information corresponds one-to-one with the type of the metadata, that is, there is corresponding specification information for technical metadata, operation metadata, and business metadata respectively. Among them, the specification information is divided into technical metadata specification information, operation metadata specification information, and business metadata specification information according to the type of metadata.

[0072] In a specific implementation, the specification information is determined based on technical metadata, operation metadata, and business metadata. Among them, the specification information includes technical metadata specification information, operation metadata specification information, and business metadata specification information. Specifically, the business metadata specification information means that the design principle of business metadata follows theme grouping, subject area, business object, logical entity, and attribute, and stipulates data standards. The operation metadata specification information means that the operation metadata is obtained from audit logs or system tracing points and needs to include normalized information such as system events and user behaviors. The technical metadata specification information means that the technical metadata consists of databases, physical tables, views, etc.

[0073] It should be noted that the association relationship is generated based on the specification information of each type and the corresponding metadata, that is, the association relationship between the technical metadata, the operation metadata, and the business metadata is determined by relying on the technical metadata specification information, the operation metadata specification information, and the business metadata specification information.

[0074] In a specific implementation, the association relationship means that the design specification needs to meet the requirement that each piece of the above metadata can be accurately and uniquely associated. For example, the logical entity of business metadata corresponds to the physical table of technical metadata, and the attribute needs to correspond to the field. The association design between operation metadata and technical metadata needs to be covered in the metadata design specification, such as the corresponding relationship between each database table and field, the corresponding relationship between the field and OLAP (Online Analytical Processing) dimensions and metrics, and the corresponding relationship between ETL (Extract-Transform-Load) tasks and tables.

[0075] It should be noted that the data relationship graph is generated based on the target data and the association relationship, that is, the data relationship graph is generated by relying on the technical metadata, the operation metadata, the business metadata and the association relationship;

[0076] In a specific implementation, by accessing and integrating the above-mentioned technical metadata, operation metadata, and business metadata, and using a graph database, each piece of metadata is converted into nodes (points) and attributes in the graph database, and then relationships (edges) are constructed according to the association relationship to form a data relationship graph.

[0077] In an embodiment of the present invention, the specific process of "generating the association relationship according to each type of the specification information and the corresponding metadata" in step S220 can be further described in combination with the following description.

[0078] Refer to Figure 3 which shows a flowchart of the steps of a data governance method provided by an embodiment of the present application;

[0079] As described in the following steps,

[0080] S310. Generate node information and attribute information according to each type of the metadata and the graph database;

[0081] S320. Generate corresponding relationships according to each type of the specification information;

[0082] S330. Generate the association relationship according to the node information, the attribute information and the corresponding relationships.

[0083] It should be noted that generating node information and attribute information according to each type of the metadata and the graph database means generating node information and attribute information through technical metadata, operation metadata, business metadata and the graph database;

[0084] It should be noted that generating corresponding relationships according to each type of the specification information means generating corresponding relationships among the technical metadata specification information, the operation metadata specification information, and the business metadata specification information;

[0085] It should be noted that generating the association relationship according to the node information, the attribute information and the corresponding relationships means generating the association relationship according to the node information, the attribute information and the corresponding relationships;

[0086] In a specific implementation, by accessing and integrating technical metadata, operation metadata, and business metadata, and using a graph database, the technical metadata, operation metadata, and business metadata are converted into nodes (points) and attributes in the graph database, and then relationships (edges) are constructed according to the association relationship to form a data relationship graph.

[0087] As described in step S130, determine the governance effect under the current governance rules according to the data relationship graph.

[0088] It should be noted that standard data is generated according to the data relationship graph, and the governance effect is generated according to the standard data and the current governance rules.

[0089] In an embodiment of the present invention, the specific process of "generating standard data according to the data relationship graph and determining the governance effect under the current governance rules" described in step S130 can be further described in combination with the following description.

[0090] Refer to Figure 4 , which shows the step flow chart of a data governance method provided by an embodiment of the present application;

[0091] As described in the following steps,

[0092] S410. Obtain data objects according to the data relationship graph;

[0093] S420. Generate standard data according to the data objects and business requirements;

[0094] S430. Determine the governance effect under the current governance rules according to the standard data.

[0095] It should be noted that obtaining data objects according to the data relationship graph means obtaining a plurality of data objects according to the data relationship graph;

[0096] It should be noted that generating standard data according to the data objects and business requirements means obtaining a plurality of data objects in the data relationship graph and generating standard data through business requirements and data objects; among them, the standard data facilitates IT and business users to query the required data targets from their respective perspectives;

[0097] It should be noted that determining the governance effect under the current governance rules according to the standard data means determining the governance effect that can be achieved by the current governance rules in the standard data.

[0098] In an embodiment of the present invention, the specific process of "generating standard data according to the data objects and business requirements" described in step S420 can be further described in combination with the following description.

[0099] Refer to Figure 5 , which shows the step flow chart of a data governance method provided by an embodiment of the present application;

[0100] As described in the following steps,

[0101] S510. Determine data information based on the data object; wherein, the data information includes a data object label, a data object attribute, and a data object relationship;

[0102] S520. Generate the standard data based on the data object label, the data object attribute, the data object relationship, and the service requirement.

[0103] It should be noted that data information is determined based on the data object; wherein, the data information at least includes a data object label, a data object attribute, and a data object relationship; the standard data is generated based on the data object label, the data object attribute, the data object relationship, and the service requirement.

[0104] In an embodiment of the present invention, the specific process of "generating the standard data based on the data object label, the data object attribute, the data object relationship, and the service requirement" described in step S520 can be further described in combination with the following description.

[0105] Refer to Figure 6 , which shows a step flow chart of a data governance method provided in an embodiment of the present application;

[0106] As described in the following steps,

[0107] S610. Generate standard coding information based on the data object label, the data object attribute, the data object relationship, and the service requirement;

[0108] S620. Obtain standard indicators, standard dimensions, and standard labels based on the standard coding information;

[0109] S630. Generate the standard data based on the standard indicators, the standard dimensions, and the standard labels.

[0110] It should be noted that generating standard coding information based on the data object label, the data object attribute, the data object relationship, and the service requirement means performing natural language processing on the data object label, the data object attribute, the data object relationship, and the service requirement to generate standard coding information;

[0111] It should be noted that obtaining standard indicators, standard dimensions, and standard labels based on the standard coding information means obtaining standard indicators, standard dimensions, and standard labels based on the standard coding information;

[0112] It should be noted that generating the standard data based on the standard indicators, the standard dimensions, and the standard labels means generating standard data through the standard indicators, the standard dimensions, and the standard labels.

[0113] In a specific implementation, standard indicators, standard dimensions and standard labels are obtained based on the standard coding information; the standard data is generated based on the standard indicators, standard dimensions and standard labels; business descriptions (i.e. business needs) such as the number of signed customers, real-time premiums, and renewals due for good car owners are converted into standard indicators such as operating indicators, standard dimensions such as composite dimensions and standard labels such as group labels of standard coding information (i.e. standardized coding) through NLP (natural language processing) technology, and then converted into standard data, i.e. logically stored tables, fields, resource operations generated during data processing, and data products such as API (Application Programming Interface), reports, etc.

[0114] In one embodiment of the present invention, the specific process of "determining the governance effect under the current governance rule based on the standard data" in step S430 can be further explained in combination with the following description.

[0115] Reference Figure 7 , showing a step flow chart of a data governance method provided by an embodiment of the present application;

[0116] As described in the following steps,

[0117] S710, determining the current governance rule according to the standard data; wherein the current governance rule includes resource utilization rate and compliance rate;

[0118] S720. Generate the governance effect based on the standard data, the resource utilization rate and the compliance rate.

[0119] It should be noted that the current governance rules are confirmed based on standard data; the current governance rules include resource utilization and compliance rate; the governance effect is generated based on standard data, resource utilization and compliance rate; that is, the data processing link is opened up, and the current governance rules are specified for standard data, that is, procedural data such as files, data lake tables, yarn (Yet Another Resource Negotiator) tasks, ETL tasks, and data products such as mart tables, label tables, dimension fields, indicator fields, APIs, and reports to improve development efficiency and quality, and automatically monitor data resources that touch the red line (that is, compliance rate); track changes in metadata (that is, resource utilization) to measure the effectiveness of governance rules, and also reversely measure the rationality of data specifications, update specifications, or access other valid metadata; govern the platform in iterations.

[0120] As described in step S140, when the governance effect does not meet the standard, the current governance rules are adjusted according to the governance effect; wherein, the governance effect does not meet the standard means that the governance value is not within a preset range.

[0121] It should be noted that the non-compliance of the governance effect means that the governance value is not within the preset range. That is, when it is determined that the governance effect fails to reach the expected goal or effect, the current governance rule is adjusted to make the governance effect within the expected goal or effect; when the governance value is within the preset range, there is no need to adjust the current governance rule; it is possible to determine whether to adjust the current governance rule based on the governance effect.

[0122] For the device embodiments, since they are basically similar to the method embodiments, the description is relatively simple. For the relevant parts, refer to the partial description of the method embodiments.

[0123] Refer to Figure 8 , which shows the structural block diagram of a data governance device provided by an embodiment of the present application;

[0124] A data governance device, the device specifically includes:

[0125] An acquisition module 810, configured to acquire target data and determine the metadata in the target data; wherein, the metadata types include technical type, operation type, and business type;

[0126] A generation module 820, configured to determine the association relationship between the target data and generate a data relationship graph according to the association relationship;

[0127] A determination module 830, configured to generate standard data according to the data relationship graph and determine the governance effect under the current governance rule according to the standard data;

[0128] An adjustment module 840, configured to adjust the current governance rule according to the governance effect when the governance effect does not meet the standard; wherein, the non-compliance of the governance effect means that the governance value is not within the preset range.

[0129] In an embodiment of the present invention, the generation module 820 includes:

[0130] A first determination sub-module, configured to determine the corresponding specification information of the target data; wherein, the specification information types correspond one-to-one with the metadata types;

[0131] A first generation sub-module, configured to generate the association relationship according to each type of the specification information and the corresponding metadata;

[0132] A second generation sub-module, configured to generate the data relationship graph according to the target data and the association relationship.

[0133] In an embodiment of the present invention, the first generation sub-module includes:

[0134] The first generation unit is configured to generate node information and attribute information based on the metadata of each type and the graph database;

[0135] The second generation unit is configured to generate corresponding relationships based on the specification information of each type;

[0136] The third generation unit is configured to generate the association relationship based on the node information, the attribute information, and the corresponding relationship.

[0137] In an embodiment of the present invention, the determination module 830 includes:

[0138] The first acquisition sub-module is configured to acquire data objects based on the data relationship graph;

[0139] The third generation sub-module is configured to generate standard data based on the data objects and business requirements;

[0140] The second determination sub-module is configured to determine the governance effect under the current governance rule based on the standard data.

[0141] In an embodiment of the present invention, the second generation sub-module includes:

[0142] The first determination unit is configured to determine data information based on the data objects; wherein the data information includes data object labels, data object attributes, and data object relationships;

[0143] The fourth generation unit is configured to generate the standard data based on the data object labels, the data object attributes, the data object relationships, and the business requirements.

[0144] In an embodiment of the present invention, the fourth generation unit includes:

[0145] The first generation sub-unit is configured to generate standard coding information based on the data object labels, the data object attributes, the data object relationships, and the business requirements;

[0146] The first acquisition sub-unit is configured to acquire standard indicators, standard dimensions, and standard labels based on the standard coding information;

[0147] The second generation sub-unit is configured to generate the standard data based on the standard indicators, the standard dimensions, and the standard labels.

[0148] In an embodiment of the present invention, the second determination sub-module includes:

[0149] The second determination unit is configured to determine the current governance rule based on the standard data; wherein the current governance rule includes resource utilization rate and compliance rate;

[0150] A fifth generation unit, configured to generate the governance effect according to the standard data, the resource utilization rate, and the compliance rate.

[0151] Refer to Figure 9 , which shows a computer device for a data governance method of the present invention, and specifically may include the following:

[0152] The computer device 12 is presented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 connecting different system components (including the system memory 28 and the processing unit 16).

[0153] The bus 18 represents one or more of several types of bus 18 structures, including a memory bus 18 or a memory controller, a peripheral bus 18, a graphics acceleration port, a processor, or a local bus 18 using any bus 18 structure in a variety of bus 18 structures. For example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus 18, a Micro Channel Architecture (MAC) bus 18, an Enhanced ISA bus 18, a Video Electronics Standards Association (VESA) local bus 18, and a Peripheral Component Interconnect (PCI) bus 18.

[0154] The computer device 12 typically includes a variety of computer system-readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0155] The system memory 28 may include computer system-readable media in the form of volatile memory, such as a random access memory (RAM) 30 and / or a cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, a storage system 34 may be used for reading and writing on non-removable, non-volatile magnetic media (commonly referred to as a "hard disk drive"). Although Figure 9 not shown in the figure, a disk drive for reading and writing on a removable non-volatile disk (such as a "floppy disk"), and an optical disk drive for reading and writing on a removable non-volatile optical disk (such as a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 through one or more data media interfaces. The memory may include at least one program product having a set (for example, at least one) of program modules 42, and these program modules 42 are configured to execute the functions of the embodiments of the present invention.

[0156] A program / utilities 40 having a set (at least one) of program modules 42 can be stored, for example, in a memory. Such program modules 42 include—but are not limited to—an operating system, one or more application programs, other program modules 42, and program data. Each or some combination of these examples may include an implementation of a network environment. The program modules 42 generally execute the functions and / or methods in the embodiments described in the present invention.

[0157] The computer device 12 can also communicate with one or more external devices 14 (such as a keyboard, a pointing device, a display 24, a camera, etc.), and can also communicate with one or more devices that enable an operator to interact with the computer device 12, and / or communicate with any device that enables the computer device 12 to communicate with one or more other computing devices (such as a network card, a modem, etc.). Such communication can be carried out through an input / output (I / O) interface 22. Moreover, the computer device 12 can also communicate with one or more networks (such as a local area network (LAN)), a wide area network (WAN), and / or a public network (such as the Internet) through a network adapter 20. As shown in the figure, the network adapter 20 communicates with other modules of the computer device 12 through a bus 18. It should be understood that although Figure 9 not shown in the figure, other hardware and / or software modules can be used in combination with the computer device 12, including but not limited to: microcode, device drivers, a processing unit 16, an external disk drive array, a RAID system, a tape drive, and a data backup storage system 34, etc.

[0158] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing a data governance method provided by the embodiments of the present invention.

[0159] That is, when the above processing unit 16 executes the above program, it realizes: obtaining target data and determining the metadata within the target data; wherein, the metadata types include technical types, operation types, and business types; determining the association relationships between the target data and generating a data relationship graph based on the association relationships; generating standard data based on the data relationship graph and determining the governance effect under the current governance rules based on the standard data; when the governance effect does not meet the standard, adjusting the current governance rules based on the governance effect; wherein, the governance effect not meeting the standard means that the governance value is not within a preset range.

[0160] In the embodiments of the present invention, the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it realizes a data governance method provided by all embodiments of the present application:

[0161] That is, when the program is executed by the processor, it realizes: obtaining target data and determining the metadata within the target data; wherein the metadata types include technical type, operation type, and business type; determining the association relationship between the target data and generating a data relationship graph according to the association relationship; generating standard data according to the data relationship graph and determining the governance effect under the current governance rules according to the standard data; when the governance effect does not meet the standard, adjusting the current governance rules according to the governance effect; wherein the governance effect not meeting the standard means that the governance value is not within the preset range.

[0162] Any combination of one or more computer-readable media may be employed. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present document, the computer-readable storage medium may be any tangible medium that contains or stores a program which can be used by or in connection with an instruction execution system, apparatus, or device.

[0163] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take many forms, including - but not limited to - an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.

[0164] Computer program code for performing the operations of the present invention may be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the operator's computer, partially on the operator's computer, executed as a stand-alone software package, partially on the operator's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the operator's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by connecting through the Internet using an Internet service provider). Each embodiment in this specification is described in a progressive manner. The key point of each embodiment is to illustrate the differences from other embodiments. For the same or similar parts among the embodiments, reference may be made to each other.

[0165] Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they learn the basic creative concepts. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

[0166] Finally, it should also be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or terminal device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or terminal device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the existence of additional identical elements in the process, method, article or terminal device comprising the said element.

[0167] The above has introduced in detail a data governance method, apparatus, device and storage medium provided by the present application. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A data governance method, characterized in that, it includes: Obtain target data and determine the metadata within the target data; wherein, the metadata types include technical type, operation type, and business type; Determine the association relationships between the target data, and generate a data relationship graph based on the association relationships; determine the corresponding specification information for the target data; wherein, the specification information types correspond one-to-one with the metadata types; generate the association relationships based on each type of the specification information and the corresponding metadata; generate the data relationship graph based on the target data and the association relationships; classify the specification information into technical metadata specification information, operation metadata specification information, and business metadata specification information according to the metadata type; the business metadata specification information includes theme grouping, theme domain, business object, logical entity, and attribute; the operation metadata specification information includes system events and user behaviors obtained from audit logs or system buried points; the technical metadata specification information includes databases, physical tables, and views; Generate standard data based on the data relationship graph, and determine the governance effect under the current governance rules based on the standard data; obtain data objects based on the data relationship graph; generate standard data based on the data objects and business requirements; determine data information based on the data objects; wherein, the data information includes data object labels, data object attributes, and data object relationships; generate the standard data based on the data object labels, the data object attributes, the data object relationships, and the business requirements; generate standard coding information based on the data object labels, the data object attributes, the data object relationships, and the business requirements; obtain standard metrics, standard dimensions, and standard labels based on the standard coding information; generate the standard data based on the standard metrics, the standard dimensions, and the standard labels; determine the governance effect under the current governance rules based on the standard data; When the governance effect does not meet the standard, adjust the current governance rules based on the governance effect; wherein, the governance effect not meeting the standard means that the governance value is not within the preset range.

2. The method according to claim 1, characterized in that, the step of generating the association relationships based on each type of the specification information and the corresponding metadata includes: Generate node information and attribute information based on each type of the metadata and a graph database; Generate corresponding relationships based on each type of the specification information; Generate the association relationships based on the node information, the attribute information, and the corresponding relationships.

3. The method according to claim 1, characterized in that, the step of determining the governance effect under the current governance rules based on the standard data includes: Determine the current governance rules based on the standard data; wherein, the current governance rules include resource utilization rate and compliance rate; Generate the governance effect based on the standard data, the resource utilization rate, and the compliance rate.

4. A data governance device, characterized in that, it includes: An acquisition module, configured to acquire target data and determine metadata within the target data; wherein, the metadata types include technology type, operation type, and business type; A generation module, configured to determine the association relationships between the target data and generate a data relationship graph based on the association relationships; determine the corresponding specification information of the target data; wherein, the specification information types correspond one-to-one with the metadata types; generate the association relationships based on the specification information of each type and the corresponding metadata; generate the data relationship graph based on the target data and the association relationships; classify the specification information into technical metadata specification information, operation metadata specification information, and business metadata specification information according to the metadata type; the business metadata specification information includes subject grouping, subject domain, business object, logical entity, and attribute; the operation metadata specification information includes system events and user behaviors obtained from audit logs or system buried points; the technical metadata specification information includes databases, physical tables, and views; A determination module, configured to generate standard data based on the data relationship graph and determine the governance effect under the current governance rules based on the standard data; obtain data objects based on the data relationship graph; generate standard data based on the data objects and business requirements; determine data information based on the data objects; wherein, the data information includes data object labels, data object attributes, and data object relationships; generate the standard data based on the data object labels, the data object attributes, the data object relationships, and the business requirements; generate standard coding information based on the data object labels, the data object attributes, the data object relationships, and the business requirements; obtain standard indicators, standard dimensions, and standard labels based on the standard coding information; generate the standard data based on the standard indicators, the standard dimensions, and the standard labels; determine the governance effect under the current governance rules based on the standard data; An adjustment module, configured to adjust the current governance rules based on the governance effect when the governance effect does not meet the standard; wherein, the governance effect not meeting the standard means that the governance value is not within the preset range.

5. A computer device, characterized in that, it includes a processor, a memory, and a computer program stored on the memory and capable of running on the processor, and when the computer program is executed by the processor, the method according to any one of claims 1 to 3 is implemented.

6. A computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images