Master data management method based on data-in-data station

Abstract

The invention discloses a main data governance method based on a data center, and relates to the technical field of main data governance, and the method comprises the steps: receiving main data information, and recognizing and uploading the source and range of the main data information; establishing a core data center, integrating the collected main data information and the original data by the core data center, and establishing a new data processing framework; the data processing framework extracts the main data information according to the content of the main data information, uploads the main data information to the subject domain of each department, and fuses and covers the original data; setting an access permission level system, and setting a viewing permission according to the data value and the management hierarchy of the main data information; according to the method, a user tracking system is set, and information and browsing range of a login user are stored and tracked, so that data of different departments and different systems in an enterprise can be mutually independent and can be effectively connected and shared, integration and utilization of the data are increased, and accuracy, consistency, safety and availability of the data are facilitated.

Description

Technical Field

[0001] The present invention relates to the technical field of master data management, and in particular to a method for master data management based on a data center. Background Art

[0002] The existing master data governance methods based on the data center still have the following drawbacks in actual use:

[0003] The data middle platform is the core of the new information application framework system, which accumulates the business and data of each business unit during the digital transformation of government and enterprises, builds a data construction, management and use system including data technology, data governance, data operation, etc., and realizes data empowerment. However, due to the independence of data from different departments and systems within the enterprise, there is a lack of effective connection and sharing between them, which makes data difficult to integrate and utilize, affecting the operational efficiency of the enterprise and limiting the maximization of data value. Summary of the invention

[0004] The purpose of the present invention is to provide a method for master data governance based on a data middle platform to solve the problem that the data of different departments and systems within an enterprise are independent of each other and lack effective connection and sharing with each other, which makes data difficult to integrate and utilize, affects the operational efficiency of the enterprise, and limits the maximization of data value.

[0005] In order to achieve the above-mentioned object, the present invention provides the following technical solutions: A method for master data governance based on a data middle platform, comprising receiving the master data information, identifying the source and scope of the master data information and uploading it;

[0006] Establishing a core data center, the core data center integrates the collected master data information with the original data and establishes a new data processing framework;

[0007] The data processing framework extracts and uploads the master data information to the subject domains of various departments according to the content of the master data information, and integrates and covers the original data;

[0008] Establish access rights hierarchy system and set viewing rights according to the data value and management level of the master data information;

[0009] Establish a user tracking system to store and track the information of logged-in users and their browsing scope.

[0010] Further, receiving the master data information, and identifying and uploading the source and scope of the master data information, specifically includes:

[0011] The received master data information is collected in the data center, which serves as the data access portal and integrates data from various business systems, logs, files, etc.

[0012] Analyze and identify the direct sources, indirect sources and data collection tools of the master data information, as well as the time range, subject range and data range through metadata;

[0013] The integrated master data information is uploaded.

[0014] Furthermore, a core data center is established, which integrates the collected master data information with the original data and establishes a new data processing framework, specifically including:

[0015] The core data center filters the uploaded master data information based on a rule-based filtering algorithm by setting conditions for duplicate, erroneous or inconsistent data and only retains data that meets specific rules for filtering;

[0016] Predefine each department, classify the master data information based on Bloom filter, and divide the relevant data into the predefines of each department;

[0017] A data processing framework is formed with the master data information as the center and various departments as access terminals.

[0018] Furthermore, the data processing framework is formed with the master data information as the center and each department as the access terminal; and further includes:

[0019] The master data information has a wide range of content. It stores vague and unclear data of departments, creates connection and sharing conditions for departments, and directly enters the data processing framework through the access terminal of each department to manage and utilize the master data information.

[0020] Furthermore, the data processing framework extracts and uploads the master data information to the subject domains of various departments according to the content of the master data information, and integrates and covers the original data, specifically including:

[0021] Based on the K-means algorithm, the master data information and similar information in the original data can be clustered, compared and analyzed with the original data to obtain accurate data;

[0022] The accurate data overlaps with the data processing framework, covers and optimizes the same or similar data, merges the differentiated data, and updates the original data.

[0023] Furthermore, based on the K-means algorithm, the master data information and similar information in the original data can be clustered, and compared and analyzed with the original data to obtain accurate data, which also includes:

[0024] Extracting key information from the data processing framework using OCR technology, and the extraction scope includes image, audio and video data;

[0025] Compare similar data, and when the similarity value is greater than the preset percentage, update the original data;

[0026] When the similarity value is less than the preset percentage, the original data is kept.

[0027] Furthermore, an access rights hierarchy system is established to set up viewing rights according to the data value and management level of the master data information, specifically including:

[0028] The value of data is classified as top secret: the highest decision-making level, management level and executive level have the right to view it.

[0029] Confidential: The middle decision-making level, management level and executive level have the right to view.

[0030] Secret: The grassroots have the right to view;

[0031] The decision-making, management, executive and grassroots levels all need to register an enterprise account to access the enterprise data platform.

[0032] Furthermore, the decision-making, management, execution and grassroots levels all need to register an account with the enterprise and enter the enterprise data platform, which also includes:

[0033] Users from each department can access the data center through a corporate account. They can not only view the information of their department, but also conduct large-scale searches on the master data information and obtain viewing permissions from senior management levels.

[0034] Furthermore, a user tracking system is established to store and track the information of logged-in users and their browsing scope, including:

[0035] Identify users who access the master data information, record users' browsing behavior and search content in the data center, analyze related operations, and push relevant data in a timely manner based on users' departments and search content.

[0036] Furthermore, identifying the user who accesses the master data information also includes:

[0037] Abnormal user behavior is detected based on network tracking algorithms. When user operations violate and endanger data security, the protection system is triggered, so that security protection measures can be taken in a timely manner.

[0038] Compared with the prior art, the master data governance method based on the data middle platform provided by the present invention has the following beneficial effects:

[0039] The method of master data governance based on a data middle platform includes receiving the master data information, identifying the source and scope of the master data information and uploading it; establishing a core data center, the core data center integrates the collected master data information with the original data, and establishes a new data processing framework; the data processing framework extracts and uploads the master data information to the subject domains of each department according to the content of the master data information, and integrates and covers the original data; establishes an access permission hierarchy system, and establishes viewing permissions according to the data value and management level of the master data information; establishes a user tracking system, and stores and tracks the information of the logged-in user and the browsing scope, so that the data of different departments and different systems within the enterprise can be independent of each other, and can be effectively connected and shared with each other, thereby increasing the integration and utilization of data and facilitating the accuracy, consistency, security and availability of data. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0041] Figure 1 A schematic diagram of the overall process provided by an embodiment of the present invention;

[0042] Figure 2 A schematic diagram of a data processing framework provided by an embodiment of the present invention;

[0043] Figure 3 A block diagram of access permission levels provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0044] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings.

[0045] See also Figure 1-3 , a master data governance method based on a data middle platform, including receiving master data information, identifying the source and scope of the master data information and uploading it;

[0046] Establish a core data center, which integrates the collected master data information with the original data and establishes a new data processing framework;

[0047] The data processing framework extracts and uploads the master data information to the subject domains of each department, integrating and overwriting the original data;

[0048] Establish access rights hierarchy system and set viewing rights according to the data value and management level of master data information;

[0049] Establish a user tracking system to store and track the information of logged-in users and their browsing scope.

[0050] S101. Receive master data information, identify the source and scope of the master data information, and upload it, including:

[0051] The received master data information is collected in the data center, which serves as the data access portal and integrates data from various business systems, logs, files, etc.

[0052] Analyze and identify the direct source, indirect source and data collection tools of master data information, as well as the time range, subject range and data range through metadata;

[0053] Upload the integrated master data information.

[0054] S102. Establish a core data center. The core data center integrates the collected master data information and original data and establishes a new data processing framework, including:

[0055] The core data center uses a rule-based filtering algorithm to filter the uploaded master data information, setting conditions for duplicate, erroneous or inconsistent data to only retain data that meets specific rules;

[0056] Predefine each department, classify the master data information based on Bloom filter, and divide the relevant data into the predefined categories of each department;

[0057] A data processing framework is formed with master data information as the center and various departments as access points.

[0058] S106, forming a data processing framework with master data information as the center and various departments as access terminals; further comprising:

[0059] The content of master data is quite broad. It stores vague and unclear data of departments, creates connection and sharing conditions for departments, and directly enters the data processing framework through the access terminal of each department to manage and utilize the master data information.

[0060] S103. The data processing framework extracts and uploads the master data to the subject domains of various departments, and integrates and covers the original data, including:

[0061] Based on the K-means algorithm, the master data information and similar information in the original data can be clustered, and compared with the original data to obtain accurate data;

[0062] By overlapping accurate data with the data processing framework, covering and optimizing identical and similar data, and integrating differentiated data, the original data is updated.

[0063] Based on the K-means algorithm, the master data information and similar information in the original data can be clustered, and compared with the original data to obtain accurate data, including:

[0064] Extract key information from the data processing framework through OCR technology, and the extraction range includes image, audio and video data;

[0065] Compare similar data, and when the similarity value is greater than the preset percentage, update the original data;

[0066] When the similarity value is less than the preset percentage, the original data is kept.

[0067] S104. Establish an access rights hierarchy system and set viewing rights based on the data value and management level of the master data information, including:

[0068] S107. Classify data value as top secret: the highest decision-making level, management level and executive level have access to it.

[0069] Confidential: The middle decision-making level, management level and executive level have the right to view.

[0070] Secret: The grassroots have the right to view;

[0071] The decision-making, management, executive and grassroots levels all need to register an enterprise account to access the enterprise data platform.

[0072] The decision-making, management, execution and grassroots levels all need to register an account with the enterprise to access the enterprise data platform, which also includes:

[0073] Users from each department can access the data center through a corporate account. They can not only check the information of their department, but also conduct large-scale searches of master data information and obtain viewing permissions from senior management.

[0074] S105. Establish a user tracking system to store and track the information of logged-in users and their browsing scope, including:

[0075] Identify users who access the master data information, record users’ browsing behavior and search content in the data center, analyze related operations, and push relevant data in a timely manner based on the user’s department and search content

[0076] Identify users who access master data information, including:

[0077] Abnormal user behavior is detected based on network tracking algorithms. When user operations violate and endanger data security, the protection system is triggered, so that security protection measures can be taken in a timely manner.

[0078] The above description is only by way of illustration of certain exemplary embodiments of the present invention. It is undoubted that those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the above drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. A method for master data governance based on a data middle platform, characterized in that: Including receiving the master data information, identifying the source and scope of the master data information and uploading it; Establishing a core data center, the core data center integrates the collected master data information with the original data and establishes a new data processing framework; The data processing framework extracts and uploads the master data information to the subject domains of various departments according to the content of the master data information, and integrates and covers the original data; Establish access rights hierarchy system and set viewing rights according to the data value and management level of the master data information; Establish a user tracking system to store and track the information of logged-in users and their browsing scope.

2. According to claim 1, a method for master data management based on a data middle platform is characterized in that: Receiving the master data information, and identifying and uploading the source and scope of the master data information, specifically including: The received master data information is collected in the data center, which serves as the data access portal and integrates data from various business systems, logs, files, etc. Analyze and identify the direct sources, indirect sources and data collection tools of the master data information, as well as the time range, subject range and data range through metadata; The integrated master data information is uploaded.

3. According to claim 1, a method for master data governance based on a data middle platform is characterized in that: Establish a core data center, which integrates the collected master data information with the original data and establishes a new data processing framework, specifically including: The core data center filters the uploaded master data information based on a rule-based filtering algorithm by setting conditions for duplicate, erroneous or inconsistent data and only retains data that meets specific rules for filtering; Predefine each department, classify the master data information based on Bloom filter, and divide the relevant data into the predefines of each department; A data processing framework is formed with the master data information as the center and various departments as access terminals.

4. The method for master data governance based on a data middle platform according to claim 3 is characterized in that: The data processing framework is formed with the master data information as the center and each department as the access terminal; and further includes: The master data information has a wide range of content. It stores vague and unclear data of departments, creates connection and sharing conditions for departments, and directly enters the data processing framework through the access terminal of each department to manage and utilize the master data information.

5. The method for master data governance based on a data middle platform according to claim 1 is characterized in that: The data processing framework extracts and uploads the master data information to the subject domains of various departments, and integrates and covers the original data, specifically including: Based on the K-means algorithm, the master data information and similar information in the original data can be clustered, compared and analyzed with the original data to obtain accurate data; The accurate data overlaps with the data processing framework, covers and optimizes the same or similar data, merges the differentiated data, and updates the original data.

6. A method for master data governance based on a data middle platform according to claim 5, characterized in that: Based on the K-means algorithm, the master data information and similar information in the original data can be clustered, compared and analyzed with the original data to obtain accurate data, and also includes: Extracting key information from the data processing framework using OCR technology, and the extraction scope includes image, audio and video data; Compare similar data, and when the similarity value is greater than the preset percentage, update the original data; When the similarity value is less than the preset percentage, the original data is kept.

7. The method for master data governance based on a data middle platform according to claim 1 is characterized in that: Establish access rights hierarchy system, and set viewing rights according to the data value and management level of the master data information, including: The value of data is classified as top secret: the highest decision-making level, management level and executive level have the right to view it. Confidential: The middle decision-making level, management level and executive level have the right to view. Secret: The grassroots level has the right to view; The decision-making, management, executive and grassroots levels all need to register an enterprise account to access the enterprise data platform.

8. The method for master data governance based on a data middle platform according to claim 1 is characterized in that: The decision-making, management, execution and grassroots levels all need to register an account with the enterprise to access the enterprise data platform, which also includes: Users from each department can access the data center through a corporate account. They can not only view the information of their department, but also conduct large-scale searches on the master data information and obtain viewing permissions from senior management levels.

9. The method for master data governance based on data middle platform according to claim 1 is characterized in that: Establish a user tracking system to store and track the information of logged-in users and their browsing scope, including: Identify users who access the master data information, record users' browsing behavior and search content in the data center, analyze related operations, and push relevant data in a timely manner based on users' departments and search content.

10. A method for master data governance based on a data middle platform according to claim 9, characterized in that: Identifying the user who has access to the master data information also includes: Abnormal user behavior is detected based on network tracking algorithms. When user operations violate and endanger data security, the protection system is triggered, so that security protection measures can be taken in a timely manner.

Images