Big data data governance full process visualization method, device and storage medium

Abstract

The present application relates to a method, device and storage medium for visualizing the entire process of data governance of big data, and to the field of data governance technology, wherein the method includes: responding to a data configuration request corresponding to the entire process of data governance triggered by a user, and displaying a configuration interface; responding to configuration information input by a user through the configuration interface, and performing data configuration on the data to be configured requested by the data configuration request; and displaying the entire process of data governance that has completed the data configuration on the client to complete the visualization of the entire process of data governance. The present application displays the entire process of data governance on the client by configuring data, avoiding the need to enter different data governance step pages for search and viewing when viewing the overall process of data governance, thereby increasing the speed of operation and solving the problem of complex operation of traditional methods.

Description

Technical Field

[0001] The present application relates to the field of data governance technology, and specifically to a full-process visualization method, device and storage medium for data governance of big data. Background Art

[0002] In today's era, the concept of "data assetization" has been understood and accepted by most people. Whether it is enterprises, governments or other organizations, more and more attention is paid to the management of data assets. However, data is not equal to assets, that is to say, not all data is data assets, and there is also junk data in the data.

[0003] Data governance governs data assets that can create value for the enterprise, rather than all data. The purpose of data governance is to control data through effective data resource control methods to improve data quality and thus improve data monetization capabilities.

[0004] Data governance is critical to ensuring that data is shared accurately, appropriately, and protected. An effective data governance program will return value to the business through improved decision-making, reduced costs, reduced risks, and improved security compliance, ultimately reflecting increased revenue and profits.

[0005] The steps of big data governance operations include four major stages: access, connecting resources from the business system to the data center. Governance, the data center performs data governance (error correction, verification, completion, etc.) on the accessed resources. Release, publishing the correct resources after governance. Application, for third parties to call and realize data application.

[0006] The entire process of big data data governance refers to data resource sorting, data access, data collection, data governance, data results, data release, data application (data call), etc.

[0007] Traditional big data governance operations only process different data governance steps for resources. If you want to view the overall data governance process of a resource, you need to enter different data governance step pages to search and view. The operation is complicated and only supports the table level but not the single data record level.

[0008] Therefore, it is necessary to improve the prior art to overcome the above defects in the prior art. Summary of the invention

[0009] The purpose of this application is to provide a method, device and storage medium for visualizing the entire process of data governance of big data, so as to solve the problem that traditional big data governance operations only process different data governance steps for resources. If you want to view the overall data governance process of a certain resource, you need to enter different data governance step pages to search and view, which is complicated to operate.

[0010] The purpose of this application is achieved through the following technical solutions:

[0011] First, a visualization method for the entire process of data governance of big data is provided, including:

[0012] Respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface;

[0013] In response to the configuration information input by the user through the configuration interface, data configuration is performed on the data to be configured requested by the data configuration request;

[0014] The entire data governance process that completes the data configuration is displayed on the client to complete the visualization of the entire data governance process.

[0015] Optionally, the configuration information includes:

[0016] Configuration data basic information, configuration data list information and configuration data table query information.

[0017] Optionally, the basic information of the configuration data includes:

[0018] Configure the data source, data table or view to which the traceability form belongs, configure the primary key field, and configure the Chinese name of the data table. The traceability form refers to the source table of the requested data to be configured.

[0019] Optionally, the configuration data list information includes:

[0020] Configure the data table list display content, the display content includes: the column width of the sub-display segment in the data list, whether the display field is displayed, and the display name of the data list.

[0021] Optionally, the configuration data table query information includes:

[0022] Generate corresponding query conditions based on different data types, including the label name, default text, and whether it is a time field.

[0023] Optionally, displaying the configured data includes:

[0024] Call the general interface and render and display it on the client page.

[0025] Optionally, the method further includes:

[0026] The data classification to which the traceability form selected by the user belongs is received to distinguish the data to be configured, wherein the data classification includes: data source department, data source system, and data subject classification.

[0027] In the second aspect, a device for visualizing the entire process of data governance of big data is provided, including:

[0028] The trigger response module is used to respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface;

[0029] A data configuration module, configured to respond to the configuration information input by the user through the configuration interface and to perform data configuration on the data to be configured requested by the data configuration request;

[0030] The visualization module is used to display the entire data governance process that completes the data configuration on the client to complete the visualization of the entire data governance process.

[0031] According to a third aspect, an electronic device is provided, comprising a processor and a memory, wherein the memory stores a program, and when the program is executed by the processor, it is used to implement the steps of the method according to the first aspect.

[0032] According to a fourth aspect, a computer storage medium is provided, wherein a program is stored on the computer storage medium, and when the program is executed by a processor, the program is used to implement the steps of the method according to the first aspect.

[0033] Compared with the prior art, the present application has the following beneficial effects: the visualization method of the present application receives a data configuration request corresponding to the entire data governance process, performs data configuration on the data to be configured corresponding to the entire data governance process, and sends the entire data governance process that has completed the data configuration to the client for display, so as to complete the visualization of the entire data governance process. Through a configurable method, the visualization of the entire data governance process of big data is realized, avoiding searching and viewing the entire process through the search page, and the operation is simple, which improves the operation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 This is a network architecture diagram of a data governance full-process visualization system provided by an embodiment of the present application;

[0035] Figure 2 This is a flow chart of a data governance full-process visualization method provided by an embodiment of the present application;

[0036] Figure 3 It is a structural block diagram of a data governance full-process visualization device provided by an embodiment of the present application;

[0037] Figure 4 It is a schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0039] For traditional big data governance operations, only different data governance steps are processed for resources. If you want to view the overall data governance process of a certain resource, you need to enter different data governance step pages to search and view, which is a problem of complex operations. The present application provides a full-process visualization method, device and storage medium for big data data governance.

[0040] Figure 1 A network architecture diagram of a data governance full-process visualization system provided by an embodiment of the present application is given as follows: Figure 1 As shown, the network architecture includes a server 101 and a client 102 , wherein the server 101 is communicatively connected with the client 102 .

[0041] The service end 101 may be a server, and the client 102 may be a computer, a smart terminal, etc.

[0042] The user triggers a data configuration request on the client 102. After receiving the data configuration request, the server 101 responds to the user's data configuration request and displays the configuration interface. The user enters configuration information through the configuration interface displayed on the client 102. The server 101 performs data configuration on the data to be configured requested by the data configuration request according to the received configuration information, and then displays the entire data governance process after the data configuration is completed on the client 102, realizing the visualization of the entire data governance process.

[0043] The specific implementation methods for visualizing the entire data governance process will be described in detail below.

[0044] Figure 2 A flowchart of a data governance full-process visualization method provided by an embodiment of the present application is given below. Figure 1 The server 101 in the network architecture shown is the execution subject, and the data governance full process visualization method of this application is described as follows: Figure 2 As shown in the figure, the data governance full-process visualization method includes:

[0045] S201: Respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface.

[0046] Specifically, in this embodiment, the user enters the data governance interface by opening the client, and triggers a data configuration request corresponding to the entire data governance process through the data governance interface, wherein the data configuration request includes the requested data to be configured.

[0047] The server displays the configuration interface on the client based on the received data configuration request.

[0048] S202: receiving configuration information input by the user in the configuration interface, and performing data configuration on the data to be configured requested by the data configuration request.

[0049] Specifically, the configuration interface of this embodiment displays at least the configuration components corresponding to each process in the entire data governance process.

[0050] In the configuration interface of the client, the user operates the configuration components of each process, for example, clicks the configuration component corresponding to the current process, enters the corresponding configuration information in the pop-up input box, or selects the corresponding configuration information in the configuration component pop-up selection box corresponding to the current process.

[0051] In this embodiment, before inputting configuration information, the user selects a data classification, that is, selects a data classification described in the traceability form, such as a data source department, a data source system, a data subject classification, etc., for distinguishing data.

[0052] Optionally, in this embodiment, the configuration information includes basic configuration data information, configuration data list information and configuration data table query information.

[0053] Configure basic data information, including: configure the data source, data table or view to which the traceability form belongs, configure the primary key field, and configure the Chinese name of the data table. The traceability form refers to the source table of the requested data to be configured.

[0054] Configuring data list information includes: configuring the data table list display content, the display content includes: the column width of the sub-display segment in the data list, whether the display field is displayed, and the display name of the data list

[0055] Configure data table query information, including: generating corresponding query conditions according to different data types, querying the label name of the field, default text, and whether it is a time field.

[0056] S203: The entire data governance process of completing the data configuration is displayed on the client to complete the visualization of the entire data governance process.

[0057] Specifically, this embodiment renders and displays on the client page by calling a general interface.

[0058] This embodiment can realize the display of personalized configuration process and related pages by calling the interface.

[0059] In summary, the visualization method of the present application receives a data configuration request corresponding to the entire data governance process, performs data configuration on the data to be configured corresponding to the entire data governance process, and sends the entire data governance process that has completed the data configuration to the client for display, so as to complete the visualization of the entire data governance process. Through a configurable method, the visualization of the entire data governance process of big data is realized, avoiding the need to view the entire process through a search page, and the operation is simple, which improves the operation efficiency.

[0060] In addition, after the data table structure product changes, the application does not require developers to adjust the code, and only needs to configure the data according to steps S201-S202. Moreover, through data configuration, the application also supports data traceability of the entire process of data governance at the single data record level.

[0061] This application also provides a data management full process visualization device, Figure 4 A structural block diagram of a data governance full-process visualization device provided by an embodiment of the present application is given, such as Figure 4 As shown, the data governance full process visualization device includes:

[0062] An original file download module, used to receive an original file download request from at least one client, and download the original file to be signed to the corresponding client, so that the at least one client signs the original file to be signed and then extracts the signature data, wherein the original file to be signed is pre-generated by the server;

[0063] A data receiving module, used to receive signature data sent by each client;

[0064] The data merging module is used for merging the signature data into the original file to be signed in response to each client completing the sending of the signature data, so as to obtain a merged signature file.

[0065] Figure 3 A structural block diagram of a data governance full-process visualization device provided by an embodiment of the present application is given, such as Figure 3 As shown, the data governance full process visualization device includes:

[0066] The trigger response module is used to respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface;

[0067] An information receiving module, used to receive configuration information input by a user on the configuration interface;

[0068] A data configuration module, configured to perform data configuration on the data to be configured requested by the data configuration request according to the configuration information;

[0069] The visualization module is used to display the entire data governance process that completes the data configuration on the client to complete the visualization of the entire data governance process.

[0070] The data governance full-process visualization device provided by the above two device embodiments and the corresponding data governance full-process visualization method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0071] It should be noted that the data governance full-process visualization device provided in the above embodiment is only illustrated by the division of the above-mentioned functional modules. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the data governance full-process visualization device is divided into different functional modules to complete all or part of the functions described above.

[0072] The present application also provides an electronic device, Figure 4 is a structural block diagram of an electronic device provided by an embodiment of the present application, such as Figure 4 As shown, the electronic device includes a processor and a memory, wherein:

[0073] The processor may include one or more processing cores, such as a 4-core processor, a 6-core processor, etc. The processor may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array).

[0074] The memory may include high-speed random access memory and non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card (Flash Card), at least one disk storage device, a memory device, or other volatile solid-state storage devices.

[0075] A computer program is stored in the memory of this embodiment, and the computer program can be run on the processor. When the processor executes the computer program, all or part of the implementation steps in the relevant embodiments of the data governance full-process visualization method of this application or the above-mentioned data governance full-process visualization device, and / or other contents described in the text can be implemented.

[0076] Those skilled in the art will understand that Figure 4This is only one possible implementation of the electronic device of the embodiment of the present application. In other implementations, more or fewer components may be included, or certain components may be combined, or different components may be included, which is not limited in this embodiment.

[0077] The present application also provides a computer storage medium, on which a program is stored. When the program is executed by a processor, it is used to implement the steps of the above-mentioned data governance full-process visualization method embodiment.

[0078] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0079] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the patent application. It should be noted that, for a person of ordinary skill in the art, several variations and improvements may be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A full-process visualization method for data governance of big data, characterized in that: The method comprises: Respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface; In response to the configuration information input by the user through the configuration interface, data configuration is performed on the data to be configured requested by the data configuration request; the configuration information includes: Configuration data basic information, configuration data list information and configuration data table query information; The basic information of the configuration data includes: Configure the data source, data table or view to which the traceability form belongs, configure the primary key field, and configure the Chinese name of the data table. The traceability form refers to the source table of the requested data to be configured; The configuration data list information includes: Configure the data table list display content, the display content includes: the column width of the text display segment in the data list, whether the display field is displayed and the display name of the data list; The configuration data table query information includes: Generate corresponding query conditions based on different data types, including the tag name, default text, and whether it is a time field; The entire data governance process that completes the data configuration is displayed on the client to complete the visualization of the entire data governance process.

2. The method according to claim 1, characterized in that The entire data governance process of completing the data configuration is displayed on the client, including: Call the general interface and render and display it on the client page.

3. The method according to claim 1, characterized in that The method further comprises: The data classification to which the traceability form selected by the user belongs is received to distinguish the data to be configured, wherein the data classification includes: data source department, data source system, and data subject classification.

4. A full-process visualization device for data management of big data, characterized in that: include: The trigger response module is used to respond to the data configuration request corresponding to the entire data governance process triggered by the user and display the configuration interface; A data configuration module, configured to respond to the configuration information input by the user through the configuration interface and to perform data configuration on the data to be configured requested by the data configuration request; The configuration information includes: Configuration data basic information, configuration data list information and configuration data table query information; The basic information of the configuration data includes: Configure the data source, data table or view to which the traceability form belongs, configure the primary key field, and configure the Chinese name of the data table. The traceability form refers to the source table of the requested data to be configured; The configuration data list information includes: Configure the data table list display content, the display content includes: the column width of the text display segment in the data list, whether the display field is displayed and the display name of the data list; The configuration data table query information includes: Generate corresponding query conditions based on different data types, including the tag name, default text, and whether it is a time field; The visualization module is used to display the entire data governance process that completes the data configuration on the client to complete the visualization of the entire data governance process.

5. An electronic device, characterized in that: The invention comprises a processor and a memory, wherein the memory stores a program, and when the program is executed by the processor, it is used to implement the steps of the method according to any one of claims 1 to 3.

6. A computer storage medium, characterized in that: The computer storage medium stores a program, and when the program is executed by the processor, it is used to implement the steps of the method according to any one of claims 1 to 3.

Images