A data classification and grading method, device, equipment and medium based on data set

Through data classification and grading methods based on data sets, identify data structures and sensitive data, generate evaluation reports and encrypt and verify, the data flow disconnection and security compliance problems in the existing technology are solved, and the compliance of data flow is achieved and security.

CN117951174BActive Publication Date: 2024-11-12杭州数圭通科技有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311869006.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-29
Publication Date
2024-11-12
Estimated Expiration
2043-12-29

AI Technical Summary

Technical Problem

The existing data classification and grading methods use each data field as an object for identification and evaluation, resulting in inadequate management methods with database management tools and data owners, and inability to effectively support data flow, resulting in disconnection between data flow and security compliance risks.

Method used

Using a dataset-based method, by determining dynamic data and static data, creating target data sets, identifying data structures, performing random sampling and data dictionary acquisition, establishing standard field mapping relationships, performing standard matching evaluation, generating data evaluation reports, and Sensitive data is desensitized and encrypted to store evidence.

Benefits of technology

It realizes compliance and security of data flow, helps data owners to reasonably avoid risks, provides security policy basis for data life cycle management, and solves the problem of data classification and grading in traditional methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117951174B_ABST
    Figure CN117951174B_ABST
Patent Text Reader

Abstract

This application discloses a data classification and grading method, apparatus, device, and medium based on a dataset, relating to the field of data security and compliance technology. The method includes: obtaining all data fields from the data to be classified and graded to obtain the data fields to be classified and graded, and creating a dataset based on these fields to obtain a target dataset; identifying the data structure of the target dataset to obtain the dataset structure; randomly sampling data from the target dataset and obtaining a data dictionary corresponding to the static dataset in the target dataset; matching all standard fields in the classification and grading identification rules of the dataset with the target dataset based on the data dictionary and sample data to establish a mapping relationship; and using the mapping relationship and identification rules to perform a standardized matching evaluation of the target dataset to obtain a self-evaluation result, thereby generating a data evaluation report. This application enables dynamic classification and grading of data, helping data owners reasonably avoid data flow risks, thereby promoting compliant data flow.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data security compliance in data infrastructure, and in particular to a data classification and grading method, device, equipment and medium based on a data set. Background Art

[0002] Data classification and grading are the main measures for data security governance and data asset management, and are the basis for the safe and compliant use of data elements. For example, public data can be classified and graded according to the degree of harm caused by the destruction of public data (such as general data, important data, and core data), thereby providing a basis for the formulation of security policies for data full life cycle management. In addition, data classification and grading can not only ensure that users with lower trust levels cannot access sensitive data, thereby protecting important data assets, but also avoid taking unnecessary security measures for unimportant data.

[0003] At present, the mainstream data classification and grading method is to identify and evaluate each data field as an object. However, this method is technically incompatible with the management methods of most database management tools, and is also incompatible with the data management methods used by data owners. Therefore, it will cause great confusion to users. Even if a certain degree of data classification and grading is achieved, users cannot use and control each field separately according to the evaluation results. In addition, the current data classification and grading method aims to provide evaluation results, without considering the support for user-related subsequent operations after the evaluation. Data classification and grading evaluation is a prerequisite for data flow. Therefore, the disconnection between data classification and grading and data flow will cause inconvenience to data owners and new data security and compliance risks.

[0004] In summary, how to classify and grade data is a technical problem that needs to be further solved in this field. Summary of the invention

[0005] In view of this, the purpose of this application is to provide a data classification and grading method, device, equipment and medium based on data sets, which can help data owners reasonably avoid data flow risks, promote data compliance flow, solve the problem of traditional data classification and grading being out of touch with data flow, and provide a basis for the formulation of security strategies for data life cycle management. The specific plan is as follows:

[0006] In a first aspect, the present application discloses a data classification and grading method based on a data set, comprising:

[0007] Determine the data to be classified and graded including dynamic data and static data;

[0008] Acquire all data fields in the data to be classified and graded, obtain the data fields to be classified and graded, and create a data set based on all the data fields to be classified and graded, to obtain a target data set; the target data set includes a dynamic data set and a static data set;

[0009] Identify the data structure of the target data set, and obtain the data set structure including a database, a data table, and data fields;

[0010] Randomly sampling the data in the target data set to obtain sample data, and obtaining a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set;

[0011] Based on the data dictionary and the sample data, the target data set is matched one by one with all standard fields included in the data set classification and grading identification rule to establish a mapping relationship between the target data set and the standard fields;

[0012] The target data set is respectively evaluated for standardized matching using the mapping relationship and the data set classification and grading identification rules to obtain a self-assessment result with a grading type of core data, important data or general data, and a data assessment report with legal and judicial effect is generated based on the self-assessment result and sent to the data owner.

[0013] Optionally, the step of matching the target data set with all standard fields included in the data set classification and grading identification rule one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields includes:

[0014] Using NLP algorithms, large language models and weighted algorithms and based on the data dictionary and the sample data, the data fields in the target data set are matched one by one with all the standard fields included in the data set classification and grading identification rules to establish a mapping relationship between the target data set and the standard fields.

[0015] Optionally, the determination condition for the classification type being the important data and the core data is that all data fields in a specific field combination of the data set classification and grading identification rule exist in the target data set, and the data volume of the target data set reaches a preset quantity threshold.

[0016] Optionally, the step of creating a data set based on all the data fields to be classified and graded to obtain a target data set includes:

[0017] Creating a data set based on all the data fields to be classified and graded to obtain an initial data set;

[0018] Randomly acquiring data fields from different data tables in the initial data set to obtain a plurality of randomly acquired fields, and arranging and combining all the randomly acquired fields to form a dynamic data set;

[0019] Accordingly, after sending the data evaluation report to the data owner, the method further includes:

[0020] Using the mapping relationship, all data and sensitive data identification rules in the dynamic data set and the static data set are matched one by one to identify the sensitive data in the dynamic data set and the static data set;

[0021] Marking the sensitive data to obtain marked data, and performing compliance processing on the marked data to obtain a desensitized dynamic data set and a desensitized static data set containing the desensitized data;

[0022] The desensitized dynamic data set and the desensitized static data set are respectively exported as files of a target file type to obtain a first file, and the first file is sent to a data demander.

[0023] Optionally, after sending the first file to the data demander, the method further includes:

[0024] Identify a data set that does not contain sensitive data in the target data set and export it as a file of the target file type to obtain a second file;

[0025] The first file and the second file are encrypted and stored respectively to obtain stored data, and the stored data is sent to the data owner.

[0026] Optionally, the encrypting and storing the first file and the second file separately to obtain the stored evidence data includes:

[0027] Encrypt the first file and the second file respectively using a national secret symmetric algorithm to obtain encrypted data;

[0028] Correspondingly, after encrypting and storing the first file and the second file to obtain the stored evidence data, the method further includes:

[0029] A digital fingerprint is generated for the encrypted data using a digest algorithm and a timestamp, and the digital fingerprint is saved in the blockchain.

[0030] Optionally, the data classification and grading method based on the data set further includes:

[0031] Treat data fields from different data tables with the same data meaning as the same field to obtain multiple standard fields;

[0032] The plurality of standard fields are combined in different combination modes to obtain a plurality of groups of the specific field combinations, and classification and grading identification rules are created based on the plurality of groups of the specific field combinations to obtain the classification and grading identification rules for the data set.

[0033] In a second aspect, the present application discloses a data classification and grading device based on a data set, comprising:

[0034] A data determination module, used for determining the data to be classified and graded including dynamic data and static data;

[0035] A field acquisition module, used to acquire all data fields in the data to be classified and graded, and obtain the data fields to be classified and graded;

[0036] A data set creation module, used to create a data set based on all the data fields to be classified and graded, to obtain a target data set; the target data set includes a dynamic data set and a static data set;

[0037] A structure recognition module, used to recognize the data structure of the target data set and obtain the data set structure including a database, a data table and data fields;

[0038] A random sampling module, used to randomly sample the data in the target data set to obtain sample data;

[0039] A dictionary acquisition module, used to acquire a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set;

[0040] A matching module, used for matching the target data set with all standard fields included in the data set classification and grading identification rule one by one based on the data dictionary and the sample data, so as to establish a mapping relationship between the target data set and the standard fields;

[0041] A matching evaluation module, used to perform standardized matching evaluation on the target data set by using the mapping relationship and the data set classification and grading identification rule, so as to obtain a self-evaluation result of the grading type being core data, important data or general data;

[0042] A report generation and sending module is used to generate a data evaluation report with legal and judicial effects based on the self-evaluation results and send the data evaluation report to the data owner.

[0043] In a third aspect, the present application discloses an electronic device, comprising a processor and a memory; wherein, when the processor executes a computer program stored in the memory, the aforementioned data classification and grading method based on a data set is implemented.

[0044] In a fourth aspect, the present application discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned data classification and grading method based on a data set is implemented.

[0045] It can be seen that the present application first determines the data to be classified and graded including dynamic data and static data, then obtains all data fields in the data to be classified and graded to obtain the fields of the data to be classified and graded, and creates a data set based on all the fields of the data to be classified and graded to obtain a target data set including a dynamic data set and a static data set, then identifies the data structure of the target data set to obtain a data set structure including a database, a data table and a data field, then randomly samples the data in the target data set to obtain sample data, and obtains a data dictionary corresponding to the static data set in the target data set, and then matches the target data set with all standard fields included in the data set classification and grading identification rules one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields, and finally uses the mapping relationship and the data set classification and grading identification rules to perform standardized matching evaluation on the target data set respectively to obtain a self-evaluation result with a grading type of core data, important data or general data, and generates a data evaluation report with legal and judicial effects based on the self-evaluation result and sends the data evaluation report to the data owner. This application dynamically classifies and grades data based on data sets, and can obtain self-assessment results of classification types such as core data, important data or general data. Based on the self-assessment results, a data assessment report with legal and judicial effects is generated and sent to the data owner, thereby effectively identifying whether the data owner has core data, important data and general data, thereby helping the data owner to reasonably avoid data flow risks, promote compliant data flow, and solve the problem of disconnection between traditional data classification and grading and data flow, thereby providing a basis for the formulation of security strategies for data full life cycle management. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0047] Figure 1A flow chart of a data classification and grading method based on a data set disclosed in this application;

[0048] Figure 2 A schematic diagram of a specific data set classification and grading rule disclosed in this application;

[0049] Figure 3 A flowchart of a specific data classification and grading method based on a data set disclosed in this application;

[0050] Figure 4 A schematic diagram of a specific dynamic data set creation process disclosed in this application;

[0051] Figure 5 A schematic diagram of a specific dynamic data set creation process disclosed in this application;

[0052] Figure 6 This is a schematic diagram of the structure of a data classification and grading device based on a data set disclosed in this application;

[0053] Figure 7 This is a structural diagram of an electronic device disclosed in this application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0055] The present application discloses a data classification and grading method based on a data set. Figure 1 As shown, the method includes:

[0056] Step S11: Determine the data to be classified and graded including dynamic data and static data.

[0057] In this embodiment, the data to be classified and graded are first acquired to obtain the data to be classified and graded; wherein the data to be classified and graded includes dynamic data and static data, the dynamic data specifically refers to dynamically flowing data, and the static data specifically refers to existing static stock data, which may be data collected in a certain period of time in the past, such as stand-alone applications, programs on personal computers, server programs, etc. The static stock data may be located in a database, and both the dynamic data and the static data include data tables and data fields.

[0058] Step S12: Acquire all data fields in the data to be classified and graded, obtain the data fields to be classified and graded, and create a data set based on all the data fields to be classified and graded to obtain a target data set; the target data set includes a dynamic data set and a static data set.

[0059] In this embodiment, after determining the data to be classified and graded containing dynamic data and static data, all data fields in the dynamic data and static data in the above-mentioned data to be classified and graded are obtained respectively to obtain the data fields to be classified and graded, and then a data set is created based on all the above-mentioned data fields to be classified and graded, thereby obtaining a target data set containing a dynamic data set and a static data set; wherein, the data set specifically refers to a collection of data, the basic form usually appears in a table form, and each column represents a specific variable, that is, a field, and each row corresponds to the data content of a certain member, and the number of rows determines the size of the data set. A complete data set can be composed of data table related attributes such as metadata, data volume, usage scenario, personal information evaluation and data timeliness. These attributes can be selected according to the specific application scenario. The simplest data set can be a database table in the traditional sense, but for the data flow scenario, the complete attributes of the data set should be adopted, so as to truly reflect the value of the flow data and the need for easy management and use from a practical perspective.

[0060] Step S13: Identify the data structure of the target data set, and obtain the data set structure including a database, a data table, and data fields.

[0061] In this embodiment, after creating a data set based on all the data fields to be classified and graded to obtain a target data set, further, the data structures of the database, data table and data field in the target data set are identified respectively, thereby obtaining a data set structure. In a specific implementation, an intelligent recognition algorithm, such as an NLP (Natural Language Processing) algorithm, can be used to identify the data structure of the database, data table and each data field in the target data set.

[0062] Step S14: Randomly sample the data in the target data set to obtain sample data, and obtain a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set.

[0063] In this embodiment, after obtaining the data set structure including databases, data tables and data fields, the data contained in the above target data set can be randomly sampled according to the preset sampling quantity to obtain sample data. For example, 10 sample data are randomly selected from the target data set, and then the data dictionary corresponding to the static data set in the above target data set is obtained; wherein the data dictionary is a data set that can clearly describe and characterize the true meaning of all user databases (such as business databases), data tables and each field, and the specific acquisition method can be obtained by pre-accessing the user database in a bypass manner. The method does not need to change any structure and content of the user database, and the data dictionary includes the description information of all databases, data tables and data fields in the data set structure corresponding to the static data set, such as the attribute information of the database, and the attribute information includes but is not limited to metadata, data volume, usage scenario, personal information evaluation and data timeliness and other data table related attributes.

[0064] Step S15: Based on the data dictionary and the sample data, the target data set is matched one by one with all the standard fields included in the data set classification and grading identification rules to establish a mapping relationship between the target data set and the standard fields.

[0065] In this embodiment, after obtaining the data dictionary corresponding to the static data set in the target data set, the target data set can be further matched one by one with all standard fields contained in the data set classification and grading identification rules based on the above data dictionary and the above sample data, that is, the target data set is matched with the standard fields, so as to establish a mapping relationship between the two.

[0066] Step S16: Use the mapping relationship and the data set classification and grading identification rules to perform standardized matching evaluation on the target data set to obtain a self-assessment result with a grading type of core data, important data or general data, and generate a data evaluation report with legal and judicial effects based on the self-assessment result and send the data evaluation report to the data owner.

[0067] In this embodiment, after establishing the mapping relationship between the target data set and the standard field, the target data set is respectively evaluated for standardized matching using the mapping relationship and the data set classification and grading identification rules, so that the data sets in the target data set are graded into any one of core data, important data or general data, and a corresponding self-assessment result is obtained; wherein, the important data refers to data that does not involve state secrets but is closely related to national security, economic development and public interests, including but not limited to data collected and generated by various institutions in important industries and fields such as public communications and information services, energy, transportation, water conservancy, finance, public services, e-government, etc. in their business activities. These data do not involve state secrets, but once leaked, tampered with or abused, they will have an adverse impact on national security, economic and social development and public interests; then, a data evaluation report with legal and judicial effects is generated based on the self-assessment results, so as to legally avoid the legal risks of the data owner in the process of external data flow, and finally the data evaluation report is sent to the data owner.

[0068] In this embodiment, the process of creating the data set classification and grading identification rule may specifically include: treating data fields from different data tables with the same data meaning as the same field to obtain multiple standard fields; combining the multiple standard fields in different combination modes to obtain multiple groups of specific field combinations, and creating classification and grading identification rules based on the multiple groups of the specific field combinations to obtain the data set classification and grading identification rule. For example, see Figure 2 As shown, data field 1 from data table A, data field 1 from data table B, and data field 1 from data table C with the same data meaning are used as standard field 1, and data field 2 from data table A, data field 2 from data table B, and data field 2 from data table C with the same data meaning are used as standard field 2, ..., and then all standard fields (i.e., standard field 1, standard field 2, standard field 3, ...) are combined in different combinations, such as combining standard field 1 and standard field 2 into one group, combining standard field 2, standard field 3, and standard field 5 into one group, etc., so as to obtain multiple groups of specific field combinations, and then create corresponding classification and grading identification rules based on multiple groups of specific field combinations, such as rule 1 includes standard field 1 and standard field 2, rule 2 includes standard field 2, standard field 3, and standard field 5, etc., and then obtain a data set classification and grading identification rule including various sub-rules (i.e., including rule 1, rule 2, etc.). It should be pointed out that the data set classification and grading identification rule can also be created based on industry regulations, similar to the rules in the virus library of antivirus software, and the rule can be dynamically updated with the library.

[0069] It should be pointed out that the judgment conditions for the classification type of the important data and the core data must meet two conditions at the same time, specifically, all the data fields in the specific field combination in the data set classification and classification identification rule exist in the target data set, and the data volume of the target data set reaches the preset quantity threshold. That is, all the data fields in the specific field combination in the data set classification and classification identification rule can be found in the target data set, for example, all the data fields in the specific field combination (including standard field 1 and standard field 2) in rule 1 (that is, data field 1 in data table A, data field 1 in data table B, data field 1 in data table C, data field 2 in data table A, data field 2 in data table B, and data field 2 in data table C) can be found in the target data set, and the data volume of the target data set reaches the preset quantity threshold.

[0070] It can be seen that the embodiment of the present application first determines the data to be classified and graded including dynamic data and static data, then obtains all data fields in the data to be classified and graded to obtain the fields of the data to be classified and graded, and creates a data set based on all the fields of the data to be classified and graded to obtain a target data set including a dynamic data set and a static data set, then identifies the data structure of the target data set to obtain a data set structure including a database, a data table and a data field, then randomly samples the data in the target data set to obtain sample data, and obtains a data dictionary corresponding to the static data set in the target data set, and then matches the target data set with all standard fields included in the data set classification and grading identification rules one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields, and finally uses the mapping relationship and the data set classification and grading identification rules to perform standardized matching evaluation on the target data set respectively to obtain a self-evaluation result with a grading type of core data, important data or general data, and generates a data evaluation report with legal and judicial effects based on the self-evaluation result and sends the data evaluation report to the data owner. The embodiment of the present application dynamically classifies and grades data based on data sets, and can obtain self-assessment results of classification types such as core data, important data or general data, and generate a data assessment report with legal and judicial effects based on the self-assessment results and send it to the data owner, thereby effectively identifying whether the data owner has core data, important data and general data, thereby helping the data owner to reasonably avoid data flow risks, promote compliant data flow, and solve the problem of disconnection between traditional data classification and grading and data flow, thereby providing a basis for the formulation of security strategies for data full life cycle management.

[0071] The present application embodiment discloses a specific data classification and grading method based on a data set, see Figure 3 As shown, the method includes:

[0072] Step S21: Determine the data to be classified and graded including dynamic data and static data.

[0073] Step S22: Acquire all data fields in the data to be classified and graded to obtain the data fields to be classified and graded, and create a data set based on all the data fields to be classified and graded to obtain an initial data set.

[0074] In this embodiment, all data fields of the dynamic data and static data in the above-mentioned data to be classified and graded can be obtained respectively to obtain the data fields to be classified and graded, and then data sets can be created based on all the above-mentioned data fields to be classified and graded corresponding to the dynamic data and the static data respectively to obtain the initial data set.

[0075] Step S23: randomly acquiring data fields from different data tables in the initial data set to obtain a plurality of randomly acquired fields, and arranging and combining all the randomly acquired fields to form a dynamic data set, thereby obtaining a target data set including the dynamic data set and the static data set.

[0076] In this embodiment, for the initial data set corresponding to the dynamic data, data fields can be randomly obtained from different data tables in the initial data set corresponding to the dynamic data, to obtain multiple randomly obtained fields, and then all the randomly obtained fields are arranged and combined to form a dynamic data set. It should be noted that the initial data set corresponding to the static data can be directly used as a static data set to obtain a target data set containing the dynamic data set and the static data set. For details, see Figure 4 As shown, data fields are randomly obtained from different data tables in the initial data set corresponding to the dynamic data and arranged and combined to obtain a dynamic data set 1 of table A. field 2, table C. field 1, table D. field 1, and table E. field 1; or, see Figure 5 As shown, data fields are randomly obtained from different data tables in the initial data set corresponding to the dynamic data and arranged and combined to obtain a dynamic data set 2 of Table A. Field 1, Table B. Field 2, Table D. Field 4, Table F. Field 1, Table E. Field 3.

[0077] Step S24: Identify the data structure of the target data set, and obtain the data set structure including a database, a data table, and data fields.

[0078] Step S25: Randomly sample the data in the target data set to obtain sample data, and obtain a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set.

[0079] Step S26: Using the NLP algorithm, large language model and weighted algorithm and based on the data dictionary and the sample data, the data fields in the target data set are matched one by one with all the standard fields included in the data set classification and grading identification rules to establish a mapping relationship between the target data set and the standard fields.

[0080] In this embodiment, after obtaining the data dictionary corresponding to the static data set in the target data set, the NLP algorithm can be used to perform semantic recognition on the data dictionary and the sample data to obtain the semantic recognition result, and then the NLP algorithm, large language model (LLM) and weighted algorithm are used to match the data fields in the target data set with all the standard fields contained in the data set classification and grading recognition rules based on the data dictionary and the sample data, that is, the data fields in the target data set are matched with the standard fields one by one, so as to establish a mapping relationship between the two. It should be pointed out that the complete rule content of a single standard field can specifically include the database, the data table, the field description characteristics, the field content characteristics and other related knowledge features, and a single standard field can have one or more matching recognition rules, wherein each matching recognition rule can be defined in the form of knowledge features + recognition algorithm (such as NLP algorithm, large language model, etc.), and for the recognition of the standard field composed of multiple matching recognition rules, the final matching degree can be calculated by the weighted algorithm, and then it is determined whether to establish a mapping relationship between the data field in the target data set and the standard field according to the matching degree. For example, when a data table named INPATIENTINFO and a field named PATIENTNAME in the data table are extracted from the target data set, when the description information "patient name" of the data field is obtained from the data dictionary, the NLP algorithm is then used to segment the table name, field name and its description information to obtain the feature decomposition results of "INPATIENT" + "INFO", "PATIENT" + "NAME", "patient" + "name", and then the sub-rules for the table name, field name and field description information contained in each standard field are scanned. For example, a rule for the "patient name" standard field is scanned. At this time, the large language model can be used to calculate the matching degree with each sub-rule respectively to obtain the initial matching degree value, and then the weighted algorithm is used to weight the above initial matching degree value according to the weighted ratio of the standard field, so as to calculate the final matching degree value 0.9 with the standard field. Since the final matching degree value 0.9 is greater than the matching degree threshold 0.6 corresponding to the standard field, that is, the matching degree requirement is met, the mapping relationship between the standard field and the corresponding data field in the target data set can be established.

[0081] Step S27: Use the mapping relationship and the data set classification and grading identification rules to perform standardized matching evaluation on the target data set to obtain a self-assessment result with a grading type of core data, important data or general data, and generate a data evaluation report with legal and judicial effects based on the self-assessment result and send the data evaluation report to the data owner.

[0082] Step S28: using the mapping relationship to match all the data in the dynamic data set and the static data set with the sensitive data identification rules one by one, so as to identify the sensitive data in the dynamic data set and the static data set.

[0083] In this embodiment, after a data assessment report with legal and judicial effect is generated based on the self-assessment results and the data assessment report is sent to the data owner, further, all the data in the dynamic data set and the static data set are matched one by one with the sub-rules in the pre-created sensitive data identification rules using the above-mentioned mapping relationship, so as to identify the sensitive data in the above-mentioned dynamic data set and the above-mentioned static data set; wherein, the sensitive data refers to data that may cause serious harm to society or individuals after leakage. Specifically, sensitive data includes all non-public or unclassified information, which may be confidential proprietary information that the organization needs to protect or people and other types of data that the organization protects due to the value of the data to the organization or the organization's compliance with current laws and regulations, such as personal identity information (personal privacy data), protected health information, proprietary data, etc.

[0084] It should be pointed out that the identification of sensitive data is specifically aimed at the identification of data content. Specifically, it can be based on a single record scanning method to identify whether there is sensitive data in the data field in the data set and the content of each data record, that is, the determination of sensitive data is made on a data record basis. In a specific implementation, the identification of sensitive data can be achieved by presetting the identification threshold, and the data records that meet the identification threshold requirements can be directly determined as sensitive data. By adjusting the identification threshold, the accuracy of sensitive data identification can be optimized, and the strictness of the sensitive data identification requirements can also be adjusted.

[0085] Step S29: Mark the sensitive data to obtain marked data, and perform compliance processing on the marked data to obtain a desensitized dynamic data set and a desensitized static data set containing the desensitized data, and then export the desensitized dynamic data set and the desensitized static data set as files of the target file type, respectively, to obtain a first file, and send the first file to the data demander.

[0086] In this embodiment, after identifying the sensitive data in the dynamic data set and the static data set, the above-mentioned sensitive data can be marked first to obtain marked data, and then the above-mentioned marked data can be compliantly processed, so as to desensitize the above-mentioned sensitive data to obtain desensitized data, and then obtain a desensitized dynamic data set and a desensitized static data set containing the desensitized data, and finally, the above-mentioned desensitized dynamic data set and the above-mentioned desensitized static data set are exported as files according to preset target file types, such as Word, PDF (Portable Document Format), etc. to obtain a first file, and then the above-mentioned first file is sent to the data demander for use.

[0087] Furthermore, after sending the first file to the data demander, it may also include: identifying a data set that does not contain sensitive data in the target data set and exporting it as a file of the target file type to obtain a second file; encrypting and storing the first file and the second file respectively to obtain evidence data, and sending the evidence data to the data owner. In this embodiment, after sending the above-mentioned first file to the data demander, it is possible to further identify a data set that does not contain any sensitive data in the target data set, and then export the identified data set as a file according to the above-mentioned target file type to obtain a second file. In order to facilitate calling when needed, ensure that the data is not tampered with and can be traced for evidence, and ensure data security by preventing user data from being leaked, and meet the requirements of defining the responsibilities of both parties to the data flow, the above-mentioned first file and the above-mentioned second file may be encrypted and stored respectively to obtain corresponding evidence data, and then the above-mentioned evidence data may be sent to the data owner.

[0088] Specifically, the encryption and storage of the first file and the second file respectively to obtain the stored data may include: using a national secret symmetric algorithm to encrypt the first file and the second file respectively to obtain encrypted data; correspondingly, the encryption and storage of the first file and the second file respectively to obtain the stored data may also include: using a digest algorithm and a timestamp to generate a digital fingerprint for the encrypted data, and saving the digital fingerprint to the blockchain. In this embodiment, the first file and the second file may be encrypted respectively using a national secret symmetric algorithm to obtain encrypted data, and the encryption and key may use dedicated cryptographic hardware to ensure that the key is not leaked. In addition, in order to ensure that the data set is not tampered with and is traceable, and to verify that the encrypted data packet has not been tampered with during evidence collection, a digest algorithm (i.e., MD, Message Digest) and a timestamp can be used to generate a digitally unique digital fingerprint for the above encrypted data. Furthermore, in order to ensure that the digital fingerprint cannot be changed once it is generated, and to enhance the credibility and traceability of the mobile data storage, the above digital fingerprint can also be saved in the blockchain; wherein, the digest algorithm includes but is not limited to MD2 / 4 / 5, SHA1 / SHA224 / SHA256 / SHA384, SM3 algorithm, MAC algorithm, etc.

[0089] Among them, for more specific processing procedures of the above steps S21, S24, S25, and S27, reference can be made to the corresponding contents disclosed in the aforementioned embodiments, which will not be repeated here.

[0090] It can be seen that the embodiment of the present application is different from the traditional field-based classification and grading method. The present embodiment performs classification and grading based on data sets. For data owners, their stock database management method is mainly a relational database with data tables as units, and the demand for flowing data generally also has a data table with a certain data volume. Therefore, taking the data table as a data set and performing data grading on the data set as the object can meet the data supply and demand sides' management and data security and compliance sharing needs for data classification and grading, and can also meet the management requirements of the competent authorities for data classification and grading, thereby solving the problem of disconnection between data grading supervision and data flow; furthermore, by encrypting and storing the data set corresponding to the compliant data, it is convenient to take appropriate and reasonable management and security protection measures for important data and sensitive data in the next step, thereby standardizing the management and utilization of data assets and promoting the safe and compliant sharing and flow of data elements; in addition, by desensitizing sensitive data, sensitive data can be protected and the security of sensitive data can be improved.

[0091] Accordingly, the present application also discloses a data classification and grading device based on a data set, see Figure 6 As shown, the device comprises:

[0092] A data determination module 11 is used to determine the data to be classified and graded including dynamic data and static data;

[0093] A field acquisition module 12 is used to acquire all data fields in the data to be classified and graded, and obtain the data fields to be classified and graded;

[0094] A data set creation module 13 is used to create a data set based on all the data fields to be classified and graded to obtain a target data set; the target data set includes a dynamic data set and a static data set;

[0095] A structure recognition module 14 is used to recognize the data structure of the target data set and obtain the data set structure including a database, a data table and data fields;

[0096] A random sampling module 15 is used to randomly sample the data in the target data set to obtain sample data;

[0097] A dictionary acquisition module 16 is used to acquire a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set;

[0098] A matching module 17, configured to match the target data set with all standard fields included in the data set classification and grading identification rule one by one based on the data dictionary and the sample data, so as to establish a mapping relationship between the target data set and the standard fields;

[0099] A matching evaluation module 18 is used to perform standardized matching evaluation on the target data set by using the mapping relationship and the data set classification and grading identification rule to obtain a self-evaluation result of the grading type being core data, important data or general data;

[0100] The report generation and sending module 19 is used to generate a data evaluation report with legal and judicial effects based on the self-evaluation results and send the data evaluation report to the data owner.

[0101] Among them, the specific working processes of the above-mentioned modules can refer to the corresponding contents disclosed in the aforementioned embodiments, which will not be repeated here.

[0102] It can be seen that in the embodiment of the present application, first determine the data to be classified and graded including dynamic data and static data, then obtain all data fields in the data to be classified and graded to obtain the fields of the data to be classified and graded, and create a data set based on all the fields of the data to be classified and graded to obtain a target data set including a dynamic data set and a static data set, then identify the data structure of the target data set to obtain a data set structure including a database, a data table and a data field, then randomly sample the data in the target data set to obtain sample data, and obtain a data dictionary corresponding to the static data set in the target data set, and then match the target data set with all standard fields included in the data set classification and grading identification rules one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields, and finally use the mapping relationship and the data set classification and grading identification rules to perform standardized matching evaluation on the target data set respectively to obtain a self-evaluation result with a grading type of core data, important data or general data, and generate a data evaluation report with legal and judicial effects based on the self-evaluation result and send the data evaluation report to the data owner. The embodiment of the present application dynamically classifies and grades data based on data sets, and can obtain self-assessment results of classification types such as core data, important data or general data, and generate a data assessment report with legal and judicial effects based on the self-assessment results and send it to the data owner, thereby effectively identifying whether the data owner has core data, important data and general data, thereby helping the data owner to reasonably avoid data flow risks, promote compliant data flow, and solve the problem of disconnection between traditional data classification and grading and data flow, thereby providing a basis for the formulation of security strategies for data full life cycle management.

[0103] In some specific embodiments, the matching module 17 may specifically include:

[0104] A data field matching unit is used to use an NLP algorithm, a large language model and a weighted algorithm and based on the data dictionary and the sample data, match the data fields in the target data set with all the standard fields included in the data set classification and grading identification rules one by one to establish a mapping relationship between the target data set and the standard fields.

[0105] In some specific embodiments, the determination conditions for the classification type being the important data and the core data are that all data fields in a specific field combination of the data set classification and grading identification rule exist in the target data set, and the data volume of the target data set reaches a preset quantity threshold.

[0106] In some specific embodiments, the data set creation module 13 may specifically include:

[0107] A data set creation unit, used to create a data set based on all the data fields to be classified and graded, to obtain an initial data set;

[0108] A data field acquisition unit, used to randomly acquire data fields from different data tables in the initial data set to obtain a plurality of randomly acquired fields;

[0109] A permutation and combination unit, used for permuting and combining all the randomly acquired fields to form a dynamic data set;

[0110] Accordingly, after the report generating and sending module 19, the following may also be included:

[0111] A sensitive data identification unit, used to use the mapping relationship to match all the data in the dynamic data set and the static data set with the sensitive data identification rules one by one, so as to identify the sensitive data in the dynamic data set and the static data set;

[0112] A sensitive data marking unit, used to mark the sensitive data to obtain marked data;

[0113] A compliance processing unit, used for carrying out compliance processing on the labeled data to obtain a desensitized dynamic data set and a desensitized static data set containing the desensitized data;

[0114] A file exporting unit, used for exporting the desensitized dynamic data set and the desensitized static data set as files of target file types respectively, to obtain a first file;

[0115] The file sending unit is used to send the first file to the data demander.

[0116] In some specific embodiments, after the file sending unit, the following may also be included:

[0117] a data set identification and exporting unit, configured to identify a data set in the target data set that does not contain sensitive data and export the data set as a file of the target file type to obtain a second file;

[0118] An encryption evidence storage unit, used to encrypt and store the first file and the second file respectively to obtain evidence data;

[0119] The evidence data sending unit is used to send the evidence data to the data owner.

[0120] In some specific embodiments, the encrypted evidence storage unit may specifically include:

[0121] A file encryption unit, used to encrypt the first file and the second file respectively using a national secret symmetric algorithm to obtain encrypted data;

[0122] Correspondingly, the encrypted evidence storage unit may also include:

[0123] A digital fingerprint generating unit, used to generate a digital fingerprint for the encrypted data using a digest algorithm and a timestamp;

[0124] The digital fingerprint storage unit is used to store the digital fingerprint in the blockchain.

[0125] In some specific embodiments, the data classification and grading device based on the data set may further include:

[0126] A standard field acquisition unit, used for treating data fields from different data tables with the same data meaning as the same field to obtain multiple standard fields;

[0127] A standard field combination unit, used for combining the plurality of standard fields in different combination modes to obtain a plurality of groups of the specific field combinations;

[0128] The identification rule creation unit is used to create classification and grading identification rules based on multiple groups of the specific field combinations to obtain the classification and grading identification rules of the data set.

[0129] Furthermore, the present application also discloses an electronic device. Figure 7 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content in the diagram cannot be considered as any limitation on the scope of use of the present application.

[0130] Figure 7 A schematic diagram of the structure of an electronic device 20 provided in an embodiment of the present application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 is used to store a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the data classification and grading method based on a data set disclosed in any of the aforementioned embodiments. In addition, the electronic device 20 in this embodiment may specifically be an electronic computer.

[0131] In this embodiment, the power supply 23 is used to provide working voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and the external device, and the communication protocol it follows is any communication protocol that can be applied to the technical solution of the present application, and is not specifically limited here; the input and output interface 25 is used to obtain external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs and is not specifically limited here.

[0132] In addition, the memory 22, as a carrier for storing resources, can be a read-only memory, a random access memory, a disk or an optical disk, etc. The resources stored thereon can include an operating system 221, a computer program 222, etc., and the storage method can be temporary storage or permanent storage.

[0133] The operating system 221 is used to manage and control the hardware devices and computer programs 222 on the electronic device 20, and can be Windows, Unix, Linux, etc. In addition to including a computer program that can be used to complete the data classification and grading method based on the data set executed by the electronic device 20 disclosed in any of the aforementioned embodiments, the computer program 222 can further include a computer program that can be used to complete other specific tasks.

[0134] Furthermore, the present application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, the aforementioned disclosed data classification and grading method based on a data set is implemented. For the specific steps of the method, reference may be made to the corresponding contents disclosed in the aforementioned embodiments, and no further description will be given here.

[0135] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0136] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0137] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0138] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0139] The above is a detailed introduction to a data classification and grading method, device, equipment and medium based on a data set provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data classification and grading method based on data sets, It is characterized in that include: Determine the data to be classified and graded including dynamic data and static data; Acquire all data fields in the data to be classified and graded, obtain the data fields to be classified and graded, and create a data set based on all the data fields to be classified and graded, to obtain a target data set; the target data set includes a dynamic data set and a static data set; Identify the data structure of the target data set to obtain a data set structure including a database, a data table, and data fields; Randomly sampling the data in the target data set to obtain sample data, and obtaining a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set; Based on the data dictionary and the sample data, the target data set is matched one by one with all standard fields included in the data set classification and grading identification rule to establish a mapping relationship between the target data set and the standard fields; Using the mapping relationship and the data set classification and grading identification rules, respectively, the target data set is subjected to standardized matching evaluation to obtain a self-evaluation result of a grading type of core data, important data or general data, and based on the self-evaluation result, a data evaluation report with legal and judicial effects is generated and sent to the data owner; The step of matching the target data set with all the standard fields included in the data set classification and grading identification rules one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields comprises: matching the data fields in the target data set with all the standard fields included in the data set classification and grading identification rules one by one based on the data dictionary and the sample data to establish a mapping relationship between the target data set and the standard fields; The step of creating a data set based on all the data fields to be classified and graded to obtain a target data set includes: creating a data set based on all the data fields to be classified and graded to obtain an initial data set; randomly acquiring data fields from different data tables in the initial data set to obtain a plurality of randomly acquired fields, and arranging and combining all the randomly acquired fields to form a dynamic data set; The randomly acquiring data fields from different data tables in the initial data set to obtain multiple randomly acquired fields, and arranging and combining all the randomly acquired fields to form a dynamic data set, includes: randomly acquiring data fields from different data tables in the initial data set corresponding to the dynamic data to obtain multiple randomly acquired fields, and arranging and combining all the randomly acquired fields to form a dynamic data set, thereby obtaining a target data set including the dynamic data set and the static data set; the static data set is the initial data set corresponding to the static data.

2. The data classification and grading method based on a data set according to claim 1, It is characterized in that The determination conditions for the classification type being the important data and the core data are that all data fields in the specific field combination of the data set classification and grading identification rule exist in the target data set, and the data volume of the target data set reaches a preset quantity threshold.

3. The data classification and grading method based on a data set according to claim 1, It is characterized in that After sending the data evaluation report to the data owner, the method further includes: Using the mapping relationship, all data and sensitive data identification rules in the dynamic data set and the static data set are matched one by one to identify the sensitive data in the dynamic data set and the static data set; Marking the sensitive data to obtain marked data, and performing compliance processing on the marked data to obtain a desensitized dynamic data set and a desensitized static data set containing the desensitized data; The desensitized dynamic data set and the desensitized static data set are respectively exported as files of a target file type to obtain a first file, and the first file is sent to a data demander.

4. The data classification and grading method based on a data set according to claim 3, It is characterized in that After sending the first file to the data demander, the method further includes: Identify a data set that does not contain sensitive data in the target data set and export it as a file of the target file type to obtain a second file; The first file and the second file are encrypted and stored respectively to obtain stored data, and the stored data is sent to the data owner.

5. The data classification and grading method based on a data set according to claim 4, It is characterized in that The step of encrypting and storing the first file and the second file respectively to obtain stored evidence data includes: Encrypt the first file and the second file respectively using a national secret symmetric algorithm to obtain encrypted data; Correspondingly, after encrypting and storing the first file and the second file to obtain the stored evidence data, the method further includes: A digital fingerprint is generated for the encrypted data using a digest algorithm and a timestamp, and the digital fingerprint is saved in the blockchain.

6. The data classification and grading method based on a data set according to claim 2, It is characterized in that Also includes: Treat data fields from different data tables with the same data meaning as the same field to obtain multiple standard fields; The plurality of standard fields are combined in different combination modes to obtain a plurality of groups of the specific field combinations, and classification and grading identification rules are created based on the plurality of groups of the specific field combinations to obtain the classification and grading identification rules for the data set.

7. A data classification and grading device based on a data set, It is characterized in that include: A data determination module, used for determining the data to be classified and graded including dynamic data and static data; A field acquisition module, used to acquire all data fields in the data to be classified and graded, and obtain the data fields to be classified and graded; A data set creation module, used to create a data set based on all the data fields to be classified and graded, to obtain a target data set; The target data set includes a dynamic data set and a static data set; A structure recognition module, used to identify the data structure of the target data set and obtain the data set structure including a database, a data table and data fields; A random sampling module, used to randomly sample the data in the target data set to obtain sample data; A dictionary acquisition module, used to acquire a data dictionary corresponding to the static data set in the target data set; the data dictionary includes description information of all databases, data tables and data fields in the data set structure corresponding to the static data set; A matching module, used for matching the target data set with all standard fields included in the data set classification and grading identification rule one by one based on the data dictionary and the sample data, so as to establish a mapping relationship between the target data set and the standard fields; A matching evaluation module, used to perform standardized matching evaluation on the target data set by using the mapping relationship and the data set classification and grading identification rule, so as to obtain a self-evaluation result of the grading type being core data, important data or general data; A report generation and sending module, used to generate a data evaluation report with legal and judicial effects based on the self-evaluation results and send the data evaluation report to the data owner; The matching module is specifically used to use the NLP algorithm, the large language model and the weighted algorithm and based on the data dictionary and the sample data, match the data fields in the target data set with all the standard fields included in the data set classification and grading identification rules one by one to establish a mapping relationship between the target data set and the standard fields; The data set creation module is specifically used to create a data set based on all the data fields to be classified and graded to obtain an initial data set; randomly obtain data fields from different data tables in the initial data set to obtain multiple randomly obtained fields, and arrange and combine all the randomly obtained fields to form a dynamic data set; The data set creation module is also used to randomly acquire data fields from different data tables in the initial data set corresponding to the dynamic data, obtain multiple randomly acquired fields, and arrange and combine all the randomly acquired fields to form a dynamic data set, thereby obtaining a target data set including the dynamic data set and the static data set; the static data set is the initial data set corresponding to the static data.

8. An electronic device, It is characterized in that It comprises a processor and a memory; wherein, when the processor executes the computer program stored in the memory, the data classification and grading method based on the data set as described in any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium, It is characterized in that Used to store computer programs; wherein, when the computer program is executed by a processor, the data classification and grading method based on a data set as described in any one of claims 1 to 6 is implemented.