Data supervision method and device, equipment and storage medium

Abstract

The invention provides a data supervision method and device, equipment and a storage medium. The method comprises the following steps: a user initiates application information through a resource directory module corresponding to a data medium system, and a user management module identifies the user and the application information according to a grading standard established by a classification and grading module, generates respective corresponding grading information and verifies whether the grading information is matched or not; after matching succeeds, interface hooking is conducted on the interface service module through the corresponding resource directory module according to interface data information generated by the classification and grading module, so that first data information is obtained, and path hooking is conducted on the data source module through the resource directory module according to a hooking path generated by the classification and grading module; therefore, the second data information is obtained, different obtaining modes are selected according to different scenes, and a record log is generated after the user extracts the data information. According to the method, the data supervision efficiency and quality are improved, and the normalization and safety of data use and management are enhanced.

Description

Technical Field

[0001] The present application relates to the field of data management, and in particular to a method, apparatus, device and storage medium for data supervision. Background Art

[0002] As the amount of data used in daily work and life continues to increase, classifying and storing large amounts of data has become one of the important links in data management. In addition, some of the data has a certain degree of confidentiality, such as government data. Therefore, while classifying and storing the data, it is also necessary to manage some of the data confidentially to ensure the security and privacy of the data.

[0003] At present, data classification and grading are all achieved by adding labels. Corresponding labels are directly added to the data, and then the data is processed accordingly according to the added labels. Adding labels includes adding confidentiality labels only to important data to ensure that the data is not public; and adding corresponding labels to all special data, and managing each special data separately.

[0004] However, the existing technology only adds labels to important data and lacks targeted management of other data. Instead, it adds corresponding labels to all special data, making the data management process too complicated and cumbersome, reducing data management efficiency. In addition, the existing technology only manages data by adding labels to data, which still poses certain security risks for industries that strictly control data, and it is difficult to provide users with the required data in a targeted manner. Summary of the invention

[0005] The present application provides a method, apparatus, device and storage medium for data supervision, which are used to improve the efficiency and quality of data supervision, and to enhance data security and the standardization of data use, thereby enhancing the degree of data value realization.

[0006] In a first aspect, the present application provides a method for data supervision, which is applied to a data middle-end system, wherein the data middle-end system includes a data source module, and the method includes:

[0007] The data middle-end system obtains the target user's classification information and application information, and determines the classification information of the application information based on the application information and classification standards;

[0008] The data middle platform system determines whether the target user's classification information matches the classification information of the application information based on the classification information of the target user, and obtains the matching result of the classification information of the target user;

[0009] The data center system determines the target approval process for the target user's application information based on the matching results, and obtains the target approval results for the application information;

[0010] The data middle-office system extracts the target data information corresponding to the application information from the data source module based on the target approval results and application information, sends the target data information to the target user, and generates a record log.

[0011] Optionally, when the target is approved, the data center system extracts the target data information corresponding to the application information from the data source module according to the target approval result and the application information, specifically including:

[0012] The data middle platform system also includes a resource directory module, a classification and grading module, and an interface service module;

[0013] The resource directory module in the data center system obtains the application information and the classification information of the application information, and determines the classification information of the application information according to the classification standard;

[0014] The application information and the corresponding classification information and grading information are sent to the interface service module, so that the interface service module determines the target data interface according to the classification information and grading information, and extracts the first target data information from the data source module according to the target data interface, wherein the first target data information includes the first interface data information corresponding to the application information.

[0015] Optionally, when the target is approved, the method further includes:

[0016] The resource directory module determines the library table data and / or file data according to the classification information and the classification information of the application information;

[0017] The second target data information is extracted from the data source module according to the library table data and / or the file data, wherein the second target data information includes the library table data information and / or the file data information corresponding to the application information.

[0018] Optionally, before the data middle station system obtains the grading information and application information of the target user, the method further includes:

[0019] The data source module in the data middle platform system obtains the data source, and obtains the corresponding metadata in sequence according to the data source, wherein the data source includes the data structure of library tables, files and interfaces, and the data information corresponding to the data source includes library table data information, file data information and interface data information;

[0020] After establishing the data classification standard and data classification standard in the classification and classification module, the data source module classifies and classifies the metadata according to the classification standard and classification standard tags, generates corresponding classification information and classification information, and determines whether the classification information and classification information of the metadata have changed according to the actual standards;

[0021] When the classification information and / or grading information of the metadata has not changed, the data source module obtains data information based on the metadata, enables the interface service module to convert data information of different data structures into corresponding data interfaces, and enables the resource directory module to perform interface mounting based on the data interface to realize resource online.

[0022] Optionally, when the classification information and / or the rating information of the metadata has not changed, the method further includes:

[0023] The data source module generates a library table mounting path and a file mounting path according to the library table data information and the file data information of the data information, and enables the resource directory module to mount the library table according to the library table mounting path and to mount the file table according to the file mounting path.

[0024] Optionally, when the classification information and / or the rating information of the metadata changes, the method further includes:

[0025] The data source module enables metadata corresponding business approval personnel to approve changes to classified information and / or graded information, freeze the use of metadata related data information, and make corrections based on the approval results.

[0026] Optionally, the data middle platform system also includes a data acquisition module and a data processing module;

[0027] The data acquisition module obtains the corresponding original data information according to the metadata;

[0028] The data acquisition module sends the original data information to the data processing module, so that the data processing module processes the original data information, generates data information and sends the data information to the data source module, so that the data source module stores the data information.

[0029] Optionally, the data middle platform system also includes a user management module;

[0030] The user management module obtains the application information of the target user, and generates the classification information corresponding to the target user and the classification information corresponding to the application information according to the classification standard;

[0031] The user management module generates a matching result according to the classification information corresponding to the target user and the classification information corresponding to the application information, and generates a target approval result according to the matching result.

[0032] Optionally, classifying and grading the metadata further includes:

[0033] Manually check and / or correct the classification information and rating information of the metadata.

[0034] In a second aspect, the present application provides a data supervision device, which is applied to a data middle station system, including:

[0035] The acquisition module is used to enable the data middle platform system to obtain the classification information and application information of the target user, and determine the classification information of the application information according to the application information and the classification standard;

[0036] A processing module is used to enable the data middle platform system to determine whether the target user's classification information matches the classification information of the application information, and obtain the matching result of the target user's classification information;

[0037] The processing module is also used to enable the data middle platform system to determine the target approval process of the target user's application information according to the matching results, and obtain the target approval result of the application information;

[0038] The processing module is also used to enable the data middle-end system to extract the target data information corresponding to the application information from the data source module according to the target approval result and application information, send the target data information to the target user, and generate a record log.

[0039] In a third aspect, the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0040] Memory stores computer-executable instructions;

[0041] The processor executes the computer-executable instructions stored in the memory to implement the method involved in the first aspect.

[0042] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the method involved in the first aspect as above.

[0043] The present application provides a method, device, equipment and storage medium for data supervision, which provides the basis of classification standards and grading standards for data resource online and data supervision by establishing a classification and grading module of the data middle platform system, wherein after the data source module obtains the data source, the metadata obtained by scanning the data source is classified and graded according to the classification standard and grading standard to improve data management efficiency, and then the classification and grading results are reviewed to see if they have changed, and the classification and grading review process is carried out for the changed data, and the classification and grading information is confirmed multiple times to avoid errors in the classification and grading results and cause data security risks, and the use of relevant data information is immediately frozen after the change is confirmed, the data transmission is blocked, and the correction is made in time, and the classification and grading information is confirmed again after the correction is successful until it is completely correct, and the data information is obtained and processed according to the classification and grading of the metadata, and stored in the data source module, and relevant attachment information is established in the data source module, the interface service module and the resource directory module, so as to form multiple paths for data information extraction. When the user extracts data through the application information, the user management module is used for hierarchical review, and after confirming that it meets the specifications, the corresponding interface data information or attachment path is obtained from the data source module and / or the interface service module through the resource directory module, and the data usage is traced through the log storage to improve the accuracy, stability and security of data information use. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0045] Figure 1 A flowchart of a data supervision method provided in an embodiment of the present application;

[0046] Figure 2 A schematic diagram of the structure of a data middle platform system provided in an embodiment of the present application;

[0047] Figure 3 A flowchart of a data supervision method provided in an embodiment of the present application;

[0048] Figure 4 A flowchart of a data supervision method provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of the structure of a data monitoring device provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0051] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0052] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0053] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0054] As the amount of data increases, a large amount of data needs to be managed to improve the efficiency of data acquisition. In the prior art, data is usually managed by classifying and grading, wherein the classification and grading is usually implemented by labeling. In particular, for the management of government data, by adding labels to the data that needs to be kept confidential, the data is divided into two categories and / or grades: labeled data and unlabeled data. However, when adding labels to the data, if too few labels are used, it is difficult to fully classify and / or grade the data. When too many labels are used, corresponding labels are added to all data with certain characteristics, thereby achieving comprehensive classification and / or grading. However, the number of labels is too large and the contents are different, resulting in an overly complicated data management process, affecting the efficiency and quality of data management.

[0055] In addition, the existing technology only manages data by classifying or grading the data. However, when the data corresponding to any classification or grading is used differently by different users, the usage method cannot be managed accurately, thereby reducing the security and privacy of the data and reducing the guarantee of standardized use of data.

[0056] In this application, the data side, user side, transmission medium side and audit side are established based on the data middle platform system to realize data supervision in the data middle platform system. Among them, a standardized hierarchical classification model is established through neural network training, and the model is used to classify and grade data, users, and transmission media accordingly. According to the different user classifications and the different application data categories, the data side provides the required data to the corresponding user according to the corresponding classification and data category and through the transmission medium of the user's corresponding classification. When the user applies, the corresponding business review process is selected through further approval by classification to conduct business review on the user's application, ensuring that the relevant work unit of the user conducts standardized review and ensuring the security of government data or other data that needs to be kept confidential. And when the data resources are launched on the data side, the application obtains metadata according to the data source, and classifies and grades the data in units of metadata, ensuring that the data classification and grading are comprehensive, while also reducing the complexity of the process and improving the efficiency of data management. After classification and grading, the corresponding data information is obtained according to different categories and grades, and processed and stored, and then different data provision methods are generated according to the different data structures of the stored data to ensure the stability of data provision.

[0057] The present application provides a data supervision method, device, equipment and storage medium, which are intended to solve the above technical problems in the prior art.

[0058] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0059] Figure 1 A flowchart of a data supervision method provided in an embodiment of the present application is as follows: Figure 1 As shown, the data supervision method is applied to the data middle platform system, and the data supervision method includes the following steps:

[0060] S101. The data middle-end system obtains the grading information and application information of the target user, and determines the grading information of the application information according to the application information and the grading standard.

[0061] More specifically, the target user inputs application information through the data platform system, and the data middle-office system determines the corresponding classification information based on the target user, then obtains the classification information and application information corresponding to the target user, and determines the classification information of the application information based on the application information and the classification standards.

[0062] Optionally, the grading standards are established and maintained by the data middle platform system.

[0063] S102. The data middle platform system determines whether the target user's classification information matches the classification information of the application information based on the classification information of the target user, and obtains the matching result of the target user's classification information.

[0064] More specifically, the data middle platform system determines whether the target user's classification information matches the application information's classification information based on the obtained target user's classification information and the application information's classification information, and obtains the matching result of the target user's classification information, wherein the matching result includes a successful match and a failed match.

[0065] S103. The data middle-end system determines the target approval process for the target user's application information based on the matching results, and obtains the target approval result for the application information.

[0066] More specifically, the data center system determines the target approval process for the target user's application information based on the matching results, and obtains the target approval result of the corresponding application information after the approval is completed. The target approval process includes the business approval process.

[0067] In a possible embodiment, when the matching result is a matching failure, the data middle-end system returns a matching failure notification to the target user, wherein the matching failure notification includes that the application information classification does not match your classification, and please reconfirm.

[0068] In a possible embodiment, when the matching result is a successful match, the data middle-office system confirms the target approval process corresponding to the application information category according to the application information classification, and sends the target approval process to the corresponding business personnel, instructing the business personnel to approve the application information. After the business personnel completes the approval, the approval result is uploaded to the data middle-office system, and the data middle-office system obtains the target approval result corresponding to the application information.

[0069] For example: hierarchical information includes level one information, level two information, level three information and level four information, among which level one information includes confidential information, level two information includes sensitive information, level three information includes restricted information, and level four information includes public information. Therefore, the business approval processes corresponding to each level of information include confidential information approval process, sensitive information approval process, restricted information approval process and public information approval process.

[0070] Optionally, the approver of the target approval process is the relevant business personnel, that is, the manager responsible for data usage at the target user's location, and according to the different levels of the target users, the corresponding target approval process is also different. At the same time, the relevant data personnel can make appropriate modifications to the target approval process according to actual conditions.

[0071] S104. The data middle platform system extracts the target data information corresponding to the application information from the data source module according to the target approval result and the application information, sends the target data information to the target user, and generates a record log.

[0072] More specifically, the data center system extracts the target data information corresponding to the application information from the data source module according to the target approval result and the application information, sends the target data information to the target user, and generates a record log. Among them, the target approval result includes target approval passed and target approval failed.

[0073] In a possible embodiment, when the target approval is passed, the data middle-end system extracts the target data information corresponding to the application information according to the target approval result and the application information, and sends the target data information to the target user.

[0074] Optionally, after the target user obtains the target data information, the data middle-end system generates and stores a record log, and extracts any record log to view and trace the use of any data information when necessary, so as to obtain the relevant application information of the corresponding data information. The record log includes the applicant, application data, data acquisition time, applicant classification and application information classification information.

[0075] In a possible embodiment, when the target is approved, the data middle-end system sends an approval failure notification to the target user. The approval failure notification includes that your application has not been approved. Please confirm with the relevant business personnel.

[0076] In the data supervision method provided in the embodiment of the present application, the target users and application information are graded through the data middle-end system, and the target users and the initiated application information are first determined to determine whether the graded information is consistent, thereby improving the security of the data information. In order to avoid errors caused by the level information not being updated in time, when the graded information is consistent, the relevant business personnel corresponding to the target user level are further required to review the application information through different processes, and the relevant data information is sent to the user only after the approval is passed. By confirming twice whether the user has the right to view and / or use the application information, the security of the data information is further guaranteed, and the monitoring and management of the use of data information is enhanced by generating and storing record diaries.

[0077] Optionally, the data middle platform system includes a data source module, such as Figure 2 As shown, Figure 2The structural diagram of a data middle platform system provided in an embodiment of the present application, in addition to the data source module 101, the data middle platform system 10 also includes a resource directory module 105, a classification and grading module 106, an interface service module 104, a data acquisition module 102, a data processing module 103 and a user management module 107. Among them, the data source module 101 includes library table data information 1011, file data information 1012 and interface data information 1013.

[0078] Among them, the classification and grading module is respectively communicated with the data source module, the interface service module, the user management module and the resource directory module, the user management module is communicated with the resource directory module, the data acquisition module is communicated with the data processing module, the data acquisition module is also communicated with the data source module, the interface service module is communicated with the resource directory module, the interface service module is also communicated with the data source module, and the resource directory module is also communicated with the data source module.

[0079] Optionally, the data source module also includes library table data information 1011 , file data information 1012 and interface data information 1013 .

[0080] Figure 3 A flowchart of a data supervision method provided in an embodiment of the present application is as follows: Figure 3 As shown, this data supervision method is applied to Figure 2 The data middle platform system shown in the figure, the data supervision method specifically includes the following steps:

[0081] S301. The user management module obtains application information.

[0082] More specifically, the target user initiates application information through the user management module resource directory module, and the user management module obtains the application information.

[0083] S302: The grading and classification module sends the grading standards to the user management module.

[0084] More specifically, the grading and classification module establishes grading standards and classification standards, and sends the grading standards to the user management module, wherein the classification standards include data information classification standards, and the grading standards include data information grading standards and user grading standards.

[0085] Optionally, the data information classification standard includes classification standards in three dimensions: subject classification, national economic industry classification, and government service object classification. Among them, the subject classification includes the government information disclosure catalog and the government information resource classification specified in GB / T 21063.4; the industry classification includes the national economic industry classification and code specified in GB / T 4754; and the government service object classification includes the actual government service content, such as marriage, employment, etc.

[0086] Optionally, the data information classification standards include level one classification (confidential data), level two classification (sensitive data), level three classification (restricted data) and level four classification (public data).

[0087] Optionally, the user classification standard includes primary user classification, secondary user classification, tertiary user classification and quaternary user classification.

[0088] S303: The user management module obtains the classification standard, determines the application information and the classification information of the target user, and generates the classification information matching result and the target approval result.

[0089] More specifically, the user management module obtains the grading standard, determines the grading information corresponding to the application information and the grading information corresponding to the target user according to the neural network model corresponding to the grading standard, and matches the grading information corresponding to the application information and the grading information corresponding to the target user. When the grading information corresponding to the application information and the grading information corresponding to the target user match each other, the corresponding target approval process is determined according to the grading information corresponding to the application information, and the approval instruction is sent to the business personnel corresponding to the target approval process, so that the business personnel can approve it, and when the target approval result of the business personnel is obtained, the subsequent data information extraction steps are executed.

[0090] Optionally, when the classification information corresponding to the target user is a first-level user classification, the classification information corresponding to the data information that the target user can obtain includes the first-level classification (confidential data), the second-level classification (sensitive data), the third-level classification (restricted data) and the fourth-level classification (public data); when the classification information corresponding to the target user is a second-level user classification, the classification information corresponding to the data information that the target user can obtain includes the second-level classification (sensitive data), the third-level classification (restricted data) and the fourth-level classification (public data); when the classification information corresponding to the target user is a third-level user classification, the classification information corresponding to the data information that the target user can obtain includes the third-level classification (restricted data) and the fourth-level classification (public data).

[0091] In a possible embodiment, when the classification information corresponding to the target user is the fourth-level user classification, and the classification information of the data information corresponding to the target user's application information is the first-level classification (confidential data), a classification information matching failure result is generated.

[0092] In a possible embodiment, when the classification information corresponding to the target user is the third-level user classification, and the classification information of the data information corresponding to the target user's application information is the fourth-level classification (confidential data), a successful classification information matching result is generated, and the corresponding target approval process is selected for approval based on the classification information of the data information corresponding to the application information.

[0093] In a possible embodiment, the business personnel corresponding to the target approval process approves the application information initiated by the target user according to the actual situation during the approval process, and confirms that the data information corresponding to the application information is not allowed to be viewed by the target user on that day, and generates a target approval failure result.

[0094] S304: The user management module sends the application information and the classification information of the application information to the resource directory module.

[0095] More specifically, when extracting data information, the user management module sends application information and classification information of the application information to the resource directory module.

[0096] S305. The classification and grading module sends the classification standard to the resource directory module.

[0097] S306: The resource directory module obtains the classification standard, the application information, and the classification information of the application information, and determines the classification information of the application information.

[0098] More specifically, the resource directory module obtains classification standards and application information, determines classification information corresponding to the application information according to a neural network model corresponding to the classification standards, and also obtains grading information corresponding to the application information.

[0099] S307: The resource directory module sends the grading information and classification information of the application information to the interface service module.

[0100] S308: The interface service module obtains the classification information and the classification information of the application information, and extracts the first target information from the data source module.

[0101] More specifically, when the target is approved, the interface service module determines the target data interface based on the classification information and grading information of the application information, and extracts the first target data information from the data source module based on the target data interface, wherein the data interface includes a library table data interface and a file data interface, and the first target data information includes the library table interface data information and / or file interface data information corresponding to the application information.

[0102] Optionally, the user can determine and obtain the corresponding library table interface data information and / or file interface data information through any classification information and / or any hierarchical information corresponding to the application information, and extract the corresponding library table data information and / or file data information from the data source module based on the obtained library table interface data information and / or file interface data information.

[0103] Optionally, when the target is approved, the resource directory module also directly determines the library table data and / or file data corresponding to the application information from the data source module based on the classification information and grading information of the application information; and then extracts the second target data information from the data source module based on the determined library table data and / or file data corresponding to the application information, wherein the second target data information includes the library table data information and / or file data information corresponding to the application information.

[0104] Optionally, when the target is approved, the interface service module obtains the third target data information corresponding to the application information from the second interface data information in the data source module according to the classification information and grading information of the application information, wherein the third target data information includes the second interface data information corresponding to the application information.

[0105] Optionally, before the interface service module determines the data interface according to the classification information and the grading information of the application information, the interface service module also needs to establish each data interface corresponding to each classification information and / or each grading information.

[0106] In the data supervision method provided in the embodiment of the present application, the user management module generates the user's classification information and the application information's classification information, and determines whether the user is qualified to obtain the data by comparing the two classification information, and performs classification review on the user to ensure the safety of data information use. Afterwards, the target data information corresponding to the classification information is obtained from the interface service module according to the classification information in the resource directory module, and the corresponding target data information can also be directly obtained from the data source module. Two methods of obtaining data information are used to ensure the stability of data information acquisition.

[0107] Figure 4 A flowchart of a data supervision method provided in an embodiment of the present application is as follows: Figure 4 As shown, this data supervision method is applied to Figure 2 The data middle platform system shown in the figure, before the data middle platform system obtains the classification information and application information of the target user, the data supervision method includes the following steps:

[0108] S401: The data source module obtains the data source and corresponding metadata.

[0109] More specifically, the data source module obtains data sources from relevant platforms and obtains metadata corresponding to each data source based on the data sources, wherein the relevant platforms include platforms that can provide required relevant data to users, such as: data platforms of the user's unit and third-party platforms.

[0110] The data source includes all the information for establishing a database connection, providing the original basis for any required data. By providing the correct data source name, the corresponding database connection can be determined. For example, by specifying the name of the required file, the required file can be determined in the file system. The specified name of the required file is the data source of the required file.

[0111] Optionally, metadata includes data attribute descriptions, which are data used to describe data information attributes. For example, a student information table includes the name, grade and student ID information of all students in a class, where name, grade and student ID are data describing student information, i.e., metadata of student information.

[0112] Optionally, data information corresponding to each metadata can be obtained based on the metadata, where the data information includes basic units of data for describing specific values. For example, a student information table includes information on the names, grades and student numbers of all students in a class, where the name, grades and student number corresponding to the first student are specific values, namely, data information.

[0113] S402: The classification and grading module sends the classification standard and grading standard to the data source module.

[0114] More specifically, the classification and grading module establishes classification standards and grading standards, and the classification and grading module sends the neural network model corresponding to the classification standards and the neural network model corresponding to the grading standards to the data source module.

[0115] Optionally, the classification and grading module establishes classification standards and grading standards, including: the classification and grading module extracts personal information samples of relevant users and characteristic information samples of relevant data, and establishes a neural network based on the relationship between the personal information samples and the grading information, and the relationship between the characteristic information samples of the data and the grading information and classification information, and performs model training, so as to obtain the classification standards and grading standards. By training the personal information samples, the grading and classification model can output user grading information consistent with the expected user grading according to the input of any user personal information, and can also output data information grading information and data information classification information consistent with the expected grading and classification of the data information according to the input of characteristic information of any data information.

[0116] Among them, the hierarchical classification model for obtaining the hierarchical information and the classified information can be any appropriate neural network that can realize feature extraction or target feature recognition, including but not limited to convolutional neural networks, reinforcement learning neural networks, generative networks in adversarial neural networks, etc. Among them, the setting of the specific structure in the neural network can be appropriately set by those skilled in the art according to actual needs, such as the number of convolutional layers, the size of the convolution kernel, the number of channels, etc., and the embodiment of the present invention does not limit this.

[0117] Optionally, the classification standards and grading standards may be adjusted accordingly based on actual conditions.

[0118] S403: The data source module classifies and grades the metadata, generates corresponding classification information and grade information, and determines whether there is a change.

[0119] More specifically, the data source module acquires the classification standard and the grading standard, and generates classification information corresponding to each metadata according to the classification standard, and generates grading information corresponding to each metadata according to the grading standard.

[0120] Optionally, the individual metadata are graded according to a grading standard and a primary metadata grade, a secondary metadata grade, a tertiary metadata grade and a quaternary metadata grade are generated.

[0121] Optionally, each graded metadata is classified, and a subject metadata classification, a national economic industry metadata classification, and a government service object metadata classification are generated.

[0122] Optionally, the classification information and rating information of the metadata are manually checked and / or corrected.

[0123] Optionally, whether the classification information and grading information of the metadata have changed is determined based on actual standards. When the classification information and / or grading information of the metadata has not changed, steps S404-S411 are executed, wherein the actual standards include changes in grading information of the current target user and changes in grading information and / or classification information of the application information.

[0124] S404: When there is no change, the data source module sends metadata to the data collection module.

[0125] More specifically, the data source module sends the classified and graded metadata to the data collection module.

[0126] S405: The data acquisition module obtains metadata, and obtains corresponding original data information according to the metadata.

[0127] More specifically, the data acquisition module obtains each metadata after classification and grading, and obtains corresponding original data information according to the attribute information indicated by each metadata.

[0128] Optionally, the hierarchical information of the original data information includes a first-level original data information hierarchy, a second-level original data information hierarchy, a third-level original data information hierarchy and a fourth-level original data information hierarchy.

[0129] Optionally, the classification information of the original data information includes the classification of subject original data information, the classification of national economic industry original data information and the classification of government service object original data information.

[0130] Optionally, the original data information under each category also includes original data information of a library table structure, original data information of a file structure, and original data information of an interface structure.

[0131] S406: The data acquisition module sends raw data information to the data processing module.

[0132] S407: The data processing module obtains the original data information and processes it to generate data information.

[0133] More specifically, the data processing module obtains original data information under each classification and classification, and processes each original data information to generate data information under each classification and classification.

[0134] For example: the data processing module screens out abnormal raw data information from the raw data information of each library table structure and processes the abnormal raw data information. It also screens out the original data information of each library table structure and desensitizes the original data information to ensure the comprehensiveness of the original data information.

[0135] S408: The data processing module sends data information to the data source module.

[0136] S409: The data source module obtains and stores data information.

[0137] More specifically, the data source module obtains data information and stores it in different databases according to different structures of the data information.

[0138] In a possible embodiment, the data source module stores the data information of the library table structure in the library table database, and then represents it as the library table data information, stores the data information of the file structure in the file database, and then represents it as the file data information, and stores the data information of the interface structure in the interface database, and then represents it as the second interface data information.

[0139] S410. The data source module sends data information and its classification information and grading information to the interface service module.

[0140] More specifically, the data source module sends each piece of data information and the classification information and grading information corresponding to each piece of data information to the interface service module.

[0141] S411. The interface service module obtains data information and its classification information and grading information, and establishes a data interface.

[0142] More specifically, the interface service module obtains data information and its classification information and grading information, selects corresponding data information according to each classification information and grading information, and establishes corresponding first data interface information for each data information. The first data interface information includes a data interface corresponding to the library table data information and a data interface corresponding to the file data information.

[0143] Optionally, the interface service module obtains the library table data information and file data information in the data source module, and simultaneously obtains the classification standard and the grading standard, and converts various types of library table data information into library table interface data information corresponding to the classification information according to the classification standard, converts various types of file data information into file interface data information corresponding to the classification information according to the classification standard, and converts various types of library table data information into library table interface data information corresponding to the grading information according to the grading standard, and converts various types of file data information into file interface data information corresponding to the grading information according to the grading standard, so that the resource directory module obtains the interface data information from the interface service module for interface mounting, thereby obtaining the corresponding data information,

[0144] Optionally, the resource directory module also directly obtains the second interface data information in the data source module through the interface service module to perform interface mounting, thereby obtaining corresponding data information.

[0145] Optionally, when the classification information and / or hierarchical information of the metadata has not changed, the resource online process also includes: the data source module generates a library table mounting path and a file mounting path based on the library table data information and file data information of the stored data information, so that the resource directory module mounts the library table path according to the library table mounting path, and / or mounts the file path according to the file mounting path.

[0146] Optionally, it is determined whether the classification information and the grading information of the metadata have changed according to actual standards. When the classification information and / or the grading information of the metadata have changed, step S412 is executed.

[0147] S412. When a change occurs, the data source module performs classification and graded approval, and freezes the use of metadata-related data information based on the approval results and makes corrections.

[0148] More specifically, when the classification information and / or grading information of the metadata changes, the data source module enables the business personnel related to the target users and / or the application information to classify and grade the metadata corresponding to the application information to confirm whether there is a change. When the data source module obtains the changed approval results generated by the classification and grading approval business personnel, it sends a corresponding metadata classification information and / or grading information change warning to the data middle-office system, freezes the use of the corresponding metadata and related data information, and then makes corresponding corrections according to the instructions of the classification and grading approval results.

[0149] In the data supervision method provided in the embodiment of the present application, by presetting the model and the launch of relevant data information resources in advance, the supervision and use of data information are guaranteed. Among them, by presetting the comprehensive and customizable standards for classification and grading in the classification and grading module according to the actual situation, a standard basis is provided for the use and supervision of data. In the process of resource launch, by reviewing whether the metadata classification information and grading information have changed, the changes in the way data is used caused by changing policies at any time, thereby causing unsafe risks such as data leakage, and further confirming the changes through relevant business personnel, the accuracy of the review is improved. When the graded and classified information changes, an early warning is issued in time and the use of relevant data information is frozen to enhance data security.

[0150] Optionally, during the resource online process, the resource directory module compiles a resource directory based on the grading standards and classification standards in the classification and grading module, and establishes a corresponding resource interface based on each grading information and each classification information, so that the resource interface performs resource mounting on the first interface data information and the second interface data information in the interface service module and the library table mounting path and the file mounting path in the data source module, respectively, so that the user can obtain the corresponding data information through the resource interface corresponding to the resource directory.

[0151] Optionally, for different users, the available resource directories displayed in the resource directory module are different.

[0152] Figure 5 A schematic diagram of a data monitoring device provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the data supervision device 500 includes:

[0153] The acquisition module 501 is used to enable the data middle platform system to obtain the classification information and application information of the target user, and determine the classification information of the application information according to the application information and the classification standard;

[0154] Processing module 502, used to enable the data middle platform system to determine whether the target user's classification information matches the classification information of the application information, and obtain the matching result of the target user's classification information;

[0155] The processing module 502 is also used to enable the data middle platform system to determine the target approval process of the target user's application information according to the matching result, and obtain the target approval result of the application information;

[0156] The processing module 502 is also used to enable the data middle-end system to extract the target data information corresponding to the application information from the data source module according to the target approval result and the application information, send the target data information to the target user, and generate a record log.

[0157] Optionally, when the target approval is passed, the processing module 502 is further used to enable the data middle platform system to extract the target data information corresponding to the application information from the data source module according to the target approval result and the application information, specifically including:

[0158] The data middle platform system also includes a resource directory module, a classification and grading module, and an interface service module;

[0159] The resource directory module in the data center system obtains the application information and the classification information of the application information, and determines the classification information of the application information according to the classification standard;

[0160] The application information and the corresponding classification information and grading information are sent to the interface service module, so that the interface service module determines the target data interface according to the classification information and grading information, and extracts the first target data information from the data source module according to the target data interface, wherein the first target data information includes the first interface data information corresponding to the application information.

[0161] Optionally, when the target is approved, the processing module 502 is further used to enable the resource directory module to determine the library table data and / or file data according to the classification information and the classification information of the application information;

[0162] The second target data information is extracted from the data source module according to the library table data and / or the file data, wherein the second target data information includes the library table data information and / or the file data information corresponding to the application information.

[0163] Optionally, the acquisition module 501 is further configured to enable the data middle station system to acquire the grading information and application information of the target user, and the method further includes:

[0164] The data source module in the data middle platform system obtains the data source, and obtains the corresponding metadata in sequence according to the data source, wherein the data source includes the data structure of library tables, files and interfaces, and the data information corresponding to the data source includes library table data information, file data information and interface data information;

[0165] After establishing the data classification standard and data classification standard in the classification and classification module, the data source module classifies and classifies the metadata according to the classification standard and classification standard tags, generates corresponding classification information and classification information, and determines whether the classification information and classification information of the metadata have changed according to the actual standards;

[0166] When the classification information and / or grading information of the metadata has not changed, the data source module obtains data information based on the metadata, enables the interface service module to convert data information of different data structures into corresponding data interfaces, and enables the resource directory module to perform interface mounting based on the data interface to realize resource online.

[0167] Optionally, when the classification information and / or hierarchical information of the metadata has not changed, the processing module 502 is also used to enable the data source module to generate a library table mounting path and a file mounting path based on the library table data information and the file data information of the data information, and to enable the resource directory module to perform library table mounting according to the library table mounting path and perform file table mounting according to the file mounting path.

[0168] Optionally, when the classification information and / or grading information of the metadata changes, the processing module 502 is also used to enable the data source module to enable the business approval personnel corresponding to the metadata to approve the changes to the classification information and / or grading information, freeze the use of the relevant data information of the metadata, and make corrections based on the approval results.

[0169] Optionally, the data middle platform system also includes a data acquisition module and a data processing module;

[0170] The acquisition module 501 is also used to enable the data acquisition module to acquire the corresponding original data information according to the metadata;

[0171] The data acquisition module sends the original data information to the data processing module, so that the data processing module processes the original data information, generates data information and sends the data information to the data source module, so that the data source module stores the data information.

[0172] Optionally, the data middle platform system also includes a user management module;

[0173] The acquisition module 501 is further used to enable the user management module to acquire the application information of the target user, and generate the classification information corresponding to the target user and the classification information corresponding to the application information according to the classification standard;

[0174] The user management module generates a matching result according to the classification information corresponding to the target user and the classification information corresponding to the application information, and generates a target approval result according to the matching result.

[0175] Optionally, the processing module 502 is further configured to enable a human to check and / or modify the classification information and grading information of the metadata according to actual standards.

[0176] like Figure 6 As shown, an embodiment of the present application provides an electronic device 600, which includes a processor 601 and a memory 602 communicatively connected to the processor.

[0177] The memory 602 is used to store computer instructions executable by the processor;

[0178] The processor 601 implements each step of the method in the above embodiment when executing the computer instruction. For details, please refer to the relevant description in the above method embodiment.

[0179] Optionally, the processor 601 can be independent or integrated with the memory 602. When the processor 601 is independently provided, the electronic device further includes a bus for connecting the processor 601 and the memory 602.

[0180] An embodiment of the present application further provides a computer-readable storage medium, in which computer instructions are stored. When a processor executes the computer instructions, each step of the method in the above embodiment is implemented.

[0181] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0182] It should be further noted that, although the various steps in the flowchart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear description in this article, there is no strict order restriction on the execution of these steps, and these steps can be set to be executed in other orders. Moreover, at least a part of the steps in the flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0183] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present application can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0184] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present application may be integrated into one unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0185] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. If not specifically stated, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. If not specifically stated, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory RRAM (Resistive Random Access Memory), a dynamic random access memory DRAM (Dynamic Random Access Memory), a static random access memory SRAM (Static Random-Access Memory), an enhanced dynamic random access memory EDRAM (Enhanced Dynamic Random Access Memory), a high-bandwidth memory HBM (High-Bandwidth Memory), a hybrid memory cube HMC (Hybrid Memory Cube), etc.

[0186] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, an interface server or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0187] In the above embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0188] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0189] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for data supervision, characterized in that: Applied to a data middle platform system, the data middle platform system includes a data source module, and the method includes: The data middle platform system obtains the grading information and application information of the target user, and determines the grading information of the application information according to the application information and the grading standard; The data middle platform system determines whether the target user's classification information matches the classification information of the application information according to the classification information of the target user, and obtains the matching result of the classification information of the target user; The data middle platform system determines the target approval process of the target user's application information according to the matching result, and obtains the target approval result of the application information; The data middle platform system extracts the target data information corresponding to the application information from the data source module according to the target approval result and the application information, sends the target data information to the target user, and generates a record log.

2. The data supervision method according to claim 1, characterized in that: When the target is approved, the data center system extracts the target data information corresponding to the application information from the data source module according to the target approval result and the application information, specifically including: The data middle platform system also includes a resource directory module, a classification and grading module and an interface service module; The resource directory module in the data center system obtains the application information and the classification information of the application information, and determines the classification information of the application information according to the classification standard; The application information and the corresponding classification information and grading information are sent to the interface service module, so that the interface service module determines the target data interface according to the classification information and the grading information, and extracts the first target data information from the data source module according to the target data interface, wherein the first target data information includes the first interface data information corresponding to the application information.

3. The data supervision method according to claim 2, characterized in that: When the target is approved, the method further includes: The resource directory module determines the library table data and / or file data according to the classification information and the classification information of the application information; The second target data information is extracted from the data source module according to the library table data and / or the file data, wherein the second target data information includes the library table data information and / or the file data information corresponding to the application information.

4. The data supervision method according to claim 1, characterized in that: Before the data middle platform system obtains the grading information and application information of the target user, the method further includes: The data source module in the data middle platform system obtains the data source, and sequentially obtains the corresponding metadata according to the data source, wherein the data source includes the data structure of library tables, files and interfaces, and the data information corresponding to the data source includes library table data information, file data information and interface data information; After establishing the data classification standard and the data grading standard in the classification and grading module, the data source module classifies and grades the metadata according to the classification standard and the grading standard mark, generates corresponding classification information and grading information, and determines whether the classification information and grading information of the metadata have changed according to the actual standard; When the classification information and / or hierarchical information of the metadata has not changed, the data source module obtains data information based on the metadata, enables the interface service module to convert data information of different data structures into corresponding data interfaces, and enables the resource directory module to perform interface mounting based on the data interface to realize resource online.

5. The data supervision method according to claim 4, characterized in that: When the classification information and / or the rating information of the metadata has not changed, the method further includes: The data source module generates a library table mounting path and a file mounting path according to the library table data information and the file data information of the data information, and enables the resource directory module to perform library table mounting according to the library table mounting path and file table mounting according to the file mounting path.

6. The data supervision method according to claim 4, characterized in that: When the classification information and / or the rating information of the metadata changes, the method further includes: The data source module enables the business approval personnel corresponding to the metadata to approve changes to the classification information and / or classification information, freeze the use of data information related to the metadata, and make corrections based on the approval results.

7. The data supervision method according to claim 1, characterized in that: The data middle platform system also includes a data acquisition module and a data processing module; The data acquisition module obtains corresponding original data information according to the metadata; The data acquisition module sends the original data information to the data processing module, so that the data processing module processes the original data information, generates data information and sends the data information to the data source module, so that the data source module stores the data information.

8. The data supervision method according to claim 1, characterized in that: The data middle platform system also includes a user management module; The user management module obtains the application information of the target user, and generates the classification information corresponding to the target user and the classification information corresponding to the application information according to the classification standard; The user management module generates a matching result according to the classification information corresponding to the target user and the classification information corresponding to the application information, and generates a target approval result according to the matching result.

9. The data supervision method according to claim 4, characterized in that: Classifying and grading metadata also includes: Manually check and / or correct the classification information and rating information of the metadata.

10. A data supervision device, characterized in that: Applied to data middle-end systems, including: An acquisition module, used to enable the data middle platform system to acquire the grading information and application information of the target user, and determine the grading information of the application information according to the application information and the grading standard; A processing module, configured to enable the data middle platform system to determine whether the target user's grading information matches the grading information of the application information, and obtain a matching result of the target user's grading information; The processing module is further used to enable the data middle platform system to determine the target approval process of the target user's application information according to the matching result, and obtain the target approval result of the application information; The processing module is also used to enable the data middle-end system to extract the target data information corresponding to the application information from the data source module according to the target approval result and the application information, send the target data information to the target user, and generate a record log.

11. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 9 when executed by a processor.

Images