Data security management method and system based on big data mining technology
Through big data mining technology, acquiring server log data, building a data classification and grading model, and establishing a permission database, solving the problem that the data classification and grading level cannot be accurately obtained in the existing technology, realizing intelligent control of data security management, and ensuring that within the enterprise Data security.
Patent Information
- Application Number
- CN202411200892.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-12-03
AI Technical Summary
The data classification and hierarchy level cannot be accurately obtained in the prior art, resulting in poor data security management and the inability to intelligently control the security of data within the enterprise.
The data security management method based on big data mining technology is adopted. By obtaining server log data, building a data classification and grading model, and establishing a permission database, we judge the data classification and grading permission level corresponding to the user role, and ensure the security of the data within the enterprise.
Accurate data classification and hierarchical level judgment is realized, and data security is intelligently controlled, which solves the problem of the inability to obtain accurate data classification and hierarchical level in the existing technology, ensuring the effectiveness of data security management.
Smart Images

Figure CN119066680A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a data security management system, method, electronic device and storage medium based on big data mining technology. Background Art
[0002] Data classification and grading is to formulate classification and grading standards suitable for data based on the natural attributes of data assets in combination with national and industry standards, and to classify and grade customer data according to the classification and grading standards to determine the security level of data assets.
[0003] Currently, data classification and grading are basically carried out after data is gathered in the business middle platform. There are cases where data classification and grading are inaccurate and security control is not rigorous, and the security of data within the enterprise cannot be controlled intelligently;
[0004] Therefore, there is an urgent need for a method that can achieve data security management based on data classification and grading levels. Summary of the invention
[0005] The purpose of the embodiments of the present invention is to provide a data security management system, method, electronic device and storage medium based on big data mining technology, so as to solve the problem in the prior art that it is impossible to obtain accurate data classification and grading levels, and to implement data security management based on data classification and grading levels.
[0006] To achieve the above objectives, an embodiment of the present invention provides a data security management method based on big data mining technology, and the data security management method based on big data mining technology specifically includes:
[0007] Obtain component B1 in the front-end page A1 in the development environment, a back-end data interface or a data interaction call information request C1 for the component B1 operation docking, and obtain server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more;
[0008] Acquire the operation function items based on the server log data, and acquire the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions;
[0009] Obtain the data sets, data tables, data fields, and data processing rules called by the backend trigger tasks and trigger mechanisms;
[0010] Perform data preprocessing on all data tables and all data fields to obtain preprocessed data;
[0011] Constructing a data classification and grading model, inputting the preprocessed data into the data classification and grading model for training, and obtaining an optimal data classification and grading model;
[0012] Constructing a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field;
[0013] Determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, obtain the classification and grading level of the data to be classified and graded by matching;
[0014] When the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded;
[0015] In response to the permission establishment request, establishing a permission database, wherein the permission database includes user role information and data classification and grading permission level information corresponding to each user role;
[0016] In response to an operation request initiated by a user role, it is determined whether the data classification and grading authority level corresponding to the user role conforms to the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism. If so, the corresponding operation authority is opened to the user.
[0017] On the basis of the above technical solution, the present invention can also be improved as follows:
[0018] Furthermore, the data security management method based on big data mining technology also includes:
[0019] The highest classification and grading level corresponding to all data tables and all data fields corresponding to the operation function items, trigger tasks and trigger mechanisms is used as the classification and grading level corresponding to the operation function items, trigger tasks and trigger mechanisms.
[0020] Further, the operation function items are obtained based on the server log data, and the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions are obtained, and the data sets, data tables, data fields and data processing rules called by the back-end trigger tasks and trigger mechanisms are obtained, including:
[0021] Generate a unique A for the front-end page A1, and generate a unique D for each data entry element component D1 in A;
[0022] Generate a unique B for each component B1, generate a unique C for each data interaction call information request C1, generate a unique T based on different request conditions of C, and generate a unique TT based on T;
[0023] Associate the relationships between A, D, B, C, T, TT, and M;
[0024] Unique identification information is generated for A, D, B, C, T, TT and each association relationship between A, D, B, C, T, TT, and the identification information is stored.
[0025] Furthermore, the data security management method based on big data mining technology also includes:
[0026] Determine whether the association relationship between A, D, B, C, T, TT and A, D, B, C, T, TT, M has been stored. If so, do not store it.
[0027] Furthermore, the data preprocessing is performed on all data tables and all data fields to obtain preprocessed data, including:
[0028] When the data to be classified and graded is unstructured data, the data to be classified and graded are extracted to obtain field data corresponding to the data to be classified and graded, corresponding data tables and entity relationships, and attribute features corresponding to each data table.
[0029] Furthermore, the constructing of the data classification and grading model, inputting the preprocessed data into the data classification and grading model for training, and obtaining the optimal data classification and grading model, comprises:
[0030] The threshold range corresponding to the correlation index between data tables and the threshold range corresponding to the correlation index between data fields are preset.
[0031] Furthermore, the constructing of the data classification and grading model, inputting the preprocessed data into the data classification and grading model for training, and obtaining the optimal data classification and grading model, further includes:
[0032] Input the data to be classified and graded into the optimal data classification and grading model, extract the corresponding key indicator data, and match the corresponding data fields, data tables and entity relationships, and attribute features corresponding to each data table based on the key indicator data;
[0033] Obtaining correlation indicators between data tables and correlation indicators between data fields, and determining whether the correlation indicators exceed a threshold range. When the correlation indicators exceed the threshold range, the current model is not met. Repeating the above operations until the correlation indicators meet the threshold range.
[0034] When the correlation index meets the threshold range, the classification level corresponding to the to-be-classified data is generated.
[0035] A data security management system based on big data mining technology, comprising:
[0036] An acquisition module is used to acquire component B1 in the front-end page A1 in the development environment, a back-end data interface or a data interaction call information request C1 for the component B1 operation docking, and acquire server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more;
[0037] Acquire the operation function items based on the server log data, and acquire the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions;
[0038] Obtain the data sets, data tables, data fields, and data processing rules called by the backend trigger tasks and trigger mechanisms;
[0039] A preprocessing module is used to perform data preprocessing on all data tables and all data fields to obtain preprocessed data;
[0040] A construction module is used to construct a data classification and grading model, and input the preprocessed data into the data classification and grading model for training to obtain an optimal data classification and grading model;
[0041] Constructing a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field;
[0042] A classification and grading module, used to determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, match and obtain the classification and grading level of the data to be classified and graded;
[0043] When the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded;
[0044] A permission building module, used to establish a permission database in response to a permission building request, wherein the permission database includes user role information and a data classification and grading permission level corresponding to each user role;
[0045] The security management module is used to respond to the operation request initiated by the user role, determine whether the data classification and grading authority level corresponding to the user role meets the classification and grading level corresponding to the operation function item, and if so, open the corresponding operation authority to the user.
[0046] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the steps of the method are implemented when the processor executes the computer program.
[0047] A non-transitory computer-readable storage medium stores a computer program, which implements the steps of the method when executed by a processor.
[0048] The embodiments of the present invention have the following advantages:
[0049] The present invention provides a data security management method based on big data mining technology, which obtains operation function items based on the server log data, and obtains the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; obtains the data sets, data tables, data fields and data processing rules called by the back-end trigger tasks and trigger mechanisms; constructs a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data tables and the classification and grading levels of the data fields; determines whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, matches and obtains the classification and grading levels of the data to be classified and graded; when the data to be classified and graded does not exist in the data classification and grading keyword library, matches and obtains the classification and grading levels of the data to be classified and graded; When the keyword library is in the database, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; an authority database is established, wherein the authority database includes user role information and data classification and grading authority level information corresponding to each user role; in response to an operation request initiated by a user role, it is determined whether the data classification and grading authority level corresponding to the operation function item, trigger task and trigger mechanism is consistent with the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism, and if so, the corresponding operation authority is opened to the user; the data classification and grading authority level that can be operated by each employee based on each business system is determined, and the security of system data in the enterprise is intelligently controlled; the problem that the accurate data classification and grading level cannot be obtained in the prior art, and data security management is realized based on the data classification and grading level is solved. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.
[0051] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.
[0052] Figure 1 This is a flow chart of a data security management method based on big data mining technology of the present invention;
[0053] Figure 2 This is an architecture diagram of a data security management system based on big data mining technology of the present invention;
[0054] Figure 3 This is a schematic diagram of the physical structure of the electronic device provided by the present invention.
[0055] The accompanying drawings are denoted as follows:
[0056] Acquisition module 10, preprocessing module 20, construction module 30, classification and grading module 40, authority construction module 50, security management module 60, electronic device 70, processor 701, memory 702, bus 703. DETAILED DESCRIPTION
[0057] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0058] Figure 1 This is a flow chart of an embodiment of a data security management method based on big data mining technology of the present invention, such as Figure 1 As shown, a data security management method based on big data mining technology provided by an embodiment of the present invention includes the following steps:
[0059] S101, obtaining component B1 in the front-end page A1 in the development environment, a back-end data interface or a data interaction call information request C1 for the component B1 operation docking, and obtaining server log data based on the data interaction call information request C1;
[0060] Specifically: the number of components B1 is one or more, and the number of data interaction call information requests C1 is one or more.
[0061] S102, obtaining operation function items based on server log data, and obtaining data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions;
[0062] S103, obtaining the data set, data table, data field and data processing rules called by the backend trigger task and the trigger mechanism;
[0063] Specifically, collect which fields of which data tables are called by the operation functions of each system front end, and which components are used for display on the front end;
[0064] Collect the data of which front-end components are stored by the front-end operation functions of each system, and what rules are used to transform the stored data based on the front-end data, and in which field of the data table the data is stored;
[0065] How does the collection backend process the field data of the data table to obtain the field data of the new data table and data set?
[0066] Generate a unique A for the front-end page A1, and generate a unique D for each data entry element component D1 in A;
[0067] Generate a unique B for each component B1, generate a unique C for each data interaction call information request C1, generate a unique T based on different request conditions of C, and generate a unique TT based on T;
[0068] Associate the relationships between A, D, B, C, T, TT, and M;
[0069] Unique identification information is generated for A, D, B, C, T, TT and each association relationship between A, D, B, C, T, TT, and the identification information is stored.
[0070] Determine whether the association relationship between A, D, B, C, T, TT and A, D, B, C, T, TT, M has been stored. If so, do not store it.
[0071] For example:
[0072] a. Obtain server log data, analyze the current front-end business system module, page and operation function name, and mark the operation function name with a unique ID1. Based on the data set called by the operating system, obtain the data table and data processing rules called by the data set;
[0073] If it is a query operation, obtain the component of the data indicator displayed on the front-end page. For the above unique ID1, if the server log data has differences in data sets, data tables, data processing rules, data displays, etc. under different conditions, generate different conditions to generate ID2 and the corresponding business system, system module, page, operation function name, called data table or data set, data processing rules, data indicators on the front-end display page and components;
[0074] If it is an addition, deletion or modification operation, the current front-end operation business system module, page and operation function name are analyzed in the same way, and the operation function name is marked with a unique ID1, then the business system, system module, page and component corresponding to the data processed by the addition, deletion or modification, and the data processing rules are obtained. If the server log data has differences in the corresponding components of the data processed under different conditions, the different conditions generate ID2 and the corresponding business system, system module, page and component, as well as the data processing rules;
[0075] For example, if the data processing is generated by a mechanism such as a task trigger on the backend, a unique ID1 is generated corresponding to the task trigger or mechanism. Similarly, ID2 is generated based on different conditions, as well as the data table and data rules called under the corresponding conditions, as well as the data table stored after processing or the generated data set.
[0076] b. A device based on identification resolution technology generates corresponding identification data from the acquired information and registers a unique identification ID3 corresponding to the above-mentioned storage related information;
[0077] c. For each ID1 and ID2, only a unique ID3 is generated. Based on the monitoring of the log data of each server, the device identifies the above-mentioned new operation or task / mechanism information and condition information, and determines whether it has been stored. If it has been stored, the acquisition in a and the storage in b are not performed.
[0078] S104, performing data preprocessing on all data tables and all data fields to obtain preprocessed data;
[0079] Specifically, when the data to be classified and graded is unstructured data, the data to be classified and graded is extracted to obtain field data corresponding to the data to be classified and graded, corresponding data tables and entity relationships, and attribute features corresponding to each data table.
[0080] The stored unstructured data includes documents, tables, pictures, videos, audio, etc., and the corresponding text information is converted. Based on the BERT model, the field data, the corresponding data tables and entity relationships, and the attribute features corresponding to each data table are extracted.
[0081] When the data to be classified and graded is structured data, obtain the source data metadata, obtain the table name, table name annotation, field, field corresponding annotation, and field description in the metadata; obtain the classification field data of the reference data table (for example, obtain the business type data of the business type field in the data table); build a data classification and grading keyword library based on different industry businesses, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data fields, determine whether the data to be classified and graded exists in the data classification and grading keyword library, and if so, match the data table name annotation, field annotation, field description and other information to obtain the data classification and grading levels of the corresponding fields of the data table.
[0082] S105, constructing a data classification and grading model, inputting the preprocessed data into the data classification and grading model for training, and obtaining an optimal data classification and grading model;
[0083] Specifically, the threshold range corresponding to the correlation index between data tables and the threshold range corresponding to the correlation index between data fields are preset.
[0084] Input the data to be classified and graded into the optimal data classification and grading model, extract the corresponding key indicator data, and match the corresponding data fields, data tables and entity relationships, and attribute features corresponding to each data table based on the key indicator data;
[0085] Obtaining correlation indicators between data tables and correlation indicators between data fields, and determining whether the correlation indicators exceed a threshold range. When the correlation indicators exceed the threshold range, the current model is not met. Repeating the above operations until the correlation indicators meet the threshold range.
[0086] When the correlation index meets the threshold range, the classification level corresponding to the to-be-classified data is generated.
[0087] The preprocessed data is randomly divided into two parts according to a ratio of 7:3 (not limited to), model training is performed based on 70% of the preprocessed data, and model verification is performed based on 30% of the preprocessed data, and a model with the best accuracy is formed through automatic parameter adjustment; the threshold range corresponding to the correlation index between data tables and the correlation index between data fields is set;
[0088] Import the data to be classified and graded (production data) into the model running data, extract the corresponding key indicator data, match the corresponding data fields, data tables and entity relationships, and the corresponding attribute characteristics of each data table;
[0089] Based on key indicator data, matching corresponding data tables and entity relationships, and corresponding attribute characteristics of each data table, analyze the correlation indicators between data tables and the correlation indicators between data fields, and compare them with the pre-set threshold range. If the threshold range is exceeded, it means that the matching corresponding data fields, data tables and entity relationships, and corresponding attribute characteristics of each data table are inaccurate, and the data is labeled as "not in line with the current model". If it meets the threshold range, the data meets the current model and the extracted data can be applied normally.
[0090] For data that "does not conform to the current model", repeat the above steps until it conforms to the threshold range.
[0091] S106, constructing a keyword library for data classification and grading;
[0092] Specifically, the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field;
[0093] S107, determining whether the data to be classified and graded exists in the data classification and graded keyword library, and when the data to be classified and graded exists in the data classification and graded keyword library, matching and obtaining the classification and graded level of the data to be classified and graded;
[0094] S108, when the data to be classified and graded does not exist in the data classification and graded keyword library, the data to be classified and graded is input into the optimal data classification and graded model to obtain the classification and graded level corresponding to the data to be classified and graded;
[0095] S109, establishing a permission database in response to the permission establishment request;
[0096] Specifically, the permission database includes user role information and data classification and grading permission level information corresponding to each user role;
[0097] S110, in response to the operation request initiated by the user role, determining whether the data classification and grading authority level corresponding to the user role meets the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism, and if so, opening the corresponding operation authority to the user;
[0098] Specifically, query operations obtain the call to the data source table based on different conditions and data processing rules, add, delete and modify operations obtain the data displayed on the front-end page components based on different conditions, the call to the data source table and data processing rules, and task triggers or mechanisms call the data source table based on different conditions and data processing rules, to generate a production data resource map of business systems, system modules and system operations or task triggers (mechanisms) and data source tables, data processing rules and other elements;
[0099] For example, the generation steps are as follows: the query operation is to obtain the data source table and data processing rules, and the results are displayed in the component. Then the query operation is associated with the data source table and the data processing rules. The display of the results on the front end is associated with the component. The data on the page is added, deleted, and modified. The processing of adding, deleting, and modifying the component display based on the rules is stored in the original data source table or the new data source table. Then the addition, deletion, and modification operations are associated with the component, that is, the data source table obtained by the query operation is associated with the data processing rules, and then associated with the processing rules for the component display data, and associated with the stored data source table or the new data source table. In this way, each step of the operation is associated with data call, data processing rules, and data storage;
[0100] Similarly, based on the task trigger or mechanism, the task trigger or mechanism, the calling data source table and the data processing rules are also associated with the data source table or the new data source table; based on the above, a global production data resource map of the business is generated, and a data flow map is generated at the same time;
[0101] Get a list of system modules, pages and related operation functions for each system;
[0102] Obtain the classification and grading level of each data table and corresponding data field (including structured and unstructured data);
[0103] Obtain the association between each operation function item and each data table and data field in the operation function list through the production data resource map, proceed to obtain all data tables and data fields corresponding to each operation function item in the operation function list, proceed to obtain the classification and grading level of all data tables and data fields corresponding to each operation function item, and take the highest classification and highest grading as the current classification and grading level of each operation function item;
[0104] Determine the authority level of each employee based on the classification and grading of operable data in each business system, and intelligently control the security of system data within the enterprise.
[0105] The data security management method based on big data mining technology obtains component B1 in the front-end page A1 in the development environment, the back-end data interface or data interaction call information request C1 to which component B1 is connected, and obtains server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more; obtains operation function items based on the server log data, and obtains data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; obtains data sets, data tables, data fields and data processing rules called by back-end trigger tasks and trigger mechanisms; performs data preprocessing on all data tables and all data fields to obtain preprocessed data; constructs a data classification and grading model, and inputs the preprocessed data into the data classification and grading model for training to obtain the optimal data classification and grading model; constructs a data classification and grading keyword library, wherein the The data classification and grading keyword library includes the classification and grading level of the data table and the classification and grading level of the data field; it is judged whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, the classification and grading level of the data to be classified and graded is obtained by matching; when the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; in response to the permission construction request, a permission database is established, wherein the permission database includes user role information and data classification and grading permission level information corresponding to each user role; in response to the operation request initiated by the user role, it is judged whether the data classification and grading permission level corresponding to the user role meets the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism, and if so, the corresponding operation permission is opened to the user. The problem that the accurate data classification and grading level cannot be obtained in the prior art and data security management is realized based on the data classification and grading level is solved.
[0106] Figure 2 FIG. 1 is a flow chart of an embodiment of a data security management system based on big data mining technology of the present invention; Figure 2 As shown, an embodiment of the present invention provides a data security management system based on big data mining technology, comprising the following steps:
[0107] The acquisition module 10 is used to acquire the component B1 in the front-end page A1 in the development environment, the back-end data interface or the data interaction call information request C1 for the component B1 operation docking, and acquire the server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more;
[0108] Acquire the operation function items based on the server log data, and acquire the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions;
[0109] Obtain the data sets, data tables, data fields, and data processing rules called by the backend trigger tasks and trigger mechanisms;
[0110] Generate a unique A for the front-end page A1, and generate a unique D for each data entry element component D1 in A;
[0111] Generate a unique B for each component B1, generate a unique C for each data interaction call information request C1, generate a unique T based on different request conditions of C, and generate a unique TT based on T;
[0112] Associate the relationships between A, D, B, C, T, TT, and M;
[0113] Unique identification information is generated for A, D, B, C, T, TT and each association relationship between A, D, B, C, T, TT, and the identification information is stored.
[0114] The preprocessing module 20 is used to perform data preprocessing on all data tables and all data fields to obtain preprocessed data;
[0115] Determine whether A, D, B, C, T, TT and the association relationship between A, D, B, C, T, TT and M have been stored, and if so, do not store them. When the data to be classified and graded is unstructured data, extract the data to be classified and graded to obtain the field data corresponding to the data to be classified and graded, the corresponding data tables and entity relationships, and the attribute characteristics corresponding to each data table.
[0116] A construction module 30 is used to construct a data classification and grading model, and input the pre-processed data into the data classification and grading model for training to obtain an optimal data classification and grading model;
[0117] The threshold range corresponding to the correlation index between data tables and the threshold range corresponding to the correlation index between data fields are preset.
[0118] Input the data to be classified and graded into the optimal data classification and grading model, extract the corresponding key indicator data, and match the corresponding data fields, data tables and entity relationships, and attribute features corresponding to each data table based on the key indicator data;
[0119] Obtaining correlation indicators between data tables and correlation indicators between data fields, and determining whether the correlation indicators exceed a threshold range. When the correlation indicators exceed the threshold range, the current model is not met. Repeating the above operations until the correlation indicators meet the threshold range.
[0120] When the correlation index meets the threshold range, the classification level corresponding to the to-be-classified data is generated.
[0121] Constructing a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field;
[0122] A classification and grading module 40 is used to determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, match and obtain the classification and grading level of the data to be classified and graded;
[0123] When the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded;
[0124] The highest classification and grading level corresponding to all data tables and all data fields corresponding to the operation function items, trigger tasks and trigger mechanisms is used as the classification and grading level corresponding to the operation function items, trigger tasks and trigger mechanisms.
[0125] The permission building module 50 is used to establish a permission database in response to the permission building request, wherein the permission database includes user role information and data classification and grading permission levels corresponding to each user role;
[0126] The security management module 60 is used to respond to an operation request initiated by a user role, determine whether the data classification and grading authority level corresponding to the user role meets the classification and grading level corresponding to the operation function item, and if so, open the corresponding operation authority to the user.
[0127] The present invention provides a data security management system based on big data mining technology. The acquisition module 10 acquires the component B1 in the front-end page A1 in the development environment, the back-end data interface or the data interaction call information request C1 to which the component B1 is connected, and acquires the server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more; acquires the operation function items based on the server log data, and acquires the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; acquires the data sets, data tables, data fields and data processing rules called by the back-end trigger tasks and trigger mechanisms; performs data preprocessing on all data tables and all data fields through the preprocessing module 20 to obtain preprocessed data; constructs a data classification and grading model through the construction module 30, inputs the preprocessed data into the data classification and grading model for training, and obtains the optimal data classification and grading model; constructs a data classification and grading keyword library , wherein the data classification and grading keyword library includes the classification and grading level of the data table and the classification and grading level of the data field; through the classification and grading module 40, it is judged whether the data to be classified and graded exists in the data classification and grading keyword library, when the data to be classified and graded exists in the data classification and grading keyword library, the classification and grading level of the data to be classified and graded is obtained by matching; when the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; through the authority construction module 50, in response to the authority construction request, an authority database is established, wherein the authority database includes user role information and the data classification and grading authority level corresponding to each user role; through the security management module 60, in response to the operation request initiated by the user role, it is judged whether the data classification and grading authority level corresponding to the user role meets the classification and grading level corresponding to the operation function item, and if so, the corresponding operation authority is opened to the user. This data security management system based on big data mining technology solves the problem that the accurate data classification and grading level cannot be obtained in the prior art, and realizes data security management based on the data classification and grading level.
[0128] Figure 3 A schematic diagram of the physical structure of an electronic device provided by an embodiment of the present invention, such as Figure 3 As shown, the electronic device 70 includes: a processor 701 (processor), a memory 702 (memory) and a bus 703;
[0129] The processor 701 and the memory 702 communicate with each other via the bus 703;
[0130] The processor 701 is used to call the program instructions in the memory 702 to execute the methods provided by the above-mentioned method embodiments, for example, including: obtaining the component B1 in the front-end page A1 in the development environment, the back-end data interface or data interaction call information request C1 to which the component B1 operates, and obtaining the server log data based on the data interaction call information request C1, wherein the number of the components B1 is one or more, and the number of the data interaction call information request C1 is one or more; obtaining the operation function items based on the server log data, and obtaining the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; obtaining the data sets, data tables, data fields and data processing rules called by the back-end trigger tasks and trigger mechanisms; performing data preprocessing on all data tables and all data fields to obtain preprocessed data; constructing a data classification and grading model, and inputting the preprocessed data into the data classification and grading model for training to obtain the optimal data classification and grading model; constructing a data classification and grading model. A classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field; judging whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, matching and obtaining the classification and grading levels of the data to be classified and graded; when the data to be classified and graded does not exist in the data classification and grading keyword library, inputting the data to be classified and graded into the optimal data classification and grading model to obtain the classification and grading levels corresponding to the data to be classified and graded; in response to a permission construction request, establishing a permission database, wherein the permission database includes user role information and data classification and grading permission level information corresponding to each user role; in response to an operation request initiated by a user role, judging whether the data classification and grading permission level corresponding to the user role meets the classification and grading levels corresponding to the operation function item, trigger task and trigger mechanism, and if so, opening the corresponding operation permission to the user.
[0131] The present embodiment provides a non-transitory computer-readable storage medium, which stores computer instructions. The computer instructions enable a computer to execute the methods provided by the above-mentioned method embodiments, for example, including: obtaining component B1 in a front-end page A1 in a development environment, a back-end data interface or a data interaction call information request C1 to which component B1 is connected, and obtaining server log data based on the data interaction call information request C1, wherein the number of the components B1 is one or more, and the number of the data interaction call information request C1 is one or more; obtaining operation function items based on the server log data, and obtaining data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; obtaining data sets, data tables, data fields and data processing rules called by back-end trigger tasks and trigger mechanisms; performing data preprocessing on all data tables and all data fields to obtain preprocessed data; constructing a data classification and grading model, and inputting the preprocessed data into the data classification and grading model for training to obtain optimal data. According to the classification and grading model; construct a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field; determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, obtain the classification and grading level of the data to be classified and graded by matching; when the data to be classified and graded does not exist in the data classification and grading keyword library, input the data to be classified and graded into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; in response to the permission construction request, establish a permission database, wherein the permission database includes user role information and data classification and grading permission level information corresponding to each user role; in response to the operation request initiated by the user role, determine whether the data classification and grading permission level corresponding to the user role meets the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism, and if so, open the corresponding operation permission to the user.
[0132] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk, etc., various storage media that can store program codes.
[0133] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative effort.
[0134] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment or some parts of the embodiment.
[0135] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.
Claims
1. A data security management method based on big data mining technology, characterized in that: The data security management method based on big data mining technology specifically includes: Obtain component B1 in the front-end page A1 in the development environment, a back-end data interface or a data interaction call information request C1 for the component B1 operation docking, and obtain server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more; Acquire the operation function items based on the server log data, and acquire the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; Obtain the data sets, data tables, data fields, and data processing rules called by the backend trigger tasks and trigger mechanisms; Perform data preprocessing on all data tables and all data fields to obtain preprocessed data; Constructing a data classification and grading model, inputting the preprocessed data into the data classification and grading model for training, and obtaining an optimal data classification and grading model; Constructing a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field; Determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, obtain the classification and grading level of the data to be classified and graded by matching; When the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; In response to the permission establishment request, establishing a permission database, wherein the permission database includes user role information and data classification and grading permission level information corresponding to each user role; In response to an operation request initiated by a user role, it is determined whether the data classification and grading authority level corresponding to the user role conforms to the classification and grading level corresponding to the operation function item, trigger task and trigger mechanism. If so, the corresponding operation authority is opened to the user.
2. According to claim 1, a data security management method based on big data mining technology is characterized in that: The data security management method based on big data mining technology also includes: The highest classification and grading level corresponding to all data tables and all data fields corresponding to the operation function items, trigger tasks and trigger mechanisms is used as the classification and grading level corresponding to the operation function items, trigger tasks and trigger mechanisms.
3. According to claim 1, a data security management method based on big data mining technology is characterized in that: The obtaining of the operation function items based on the server log data, and obtaining the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions, and obtaining the data sets, data tables, data fields and data processing rules called by the back-end trigger tasks and trigger mechanisms include: Generate a unique A for the front-end page A1, and generate a unique D for each data entry element component D1 in A; Generate a unique B for each component B1, generate a unique C for each data interaction call information request C1, generate a unique T based on different request conditions of C, and generate a unique TT based on T; Associate the relationships between A, D, B, C, T, TT, and M; Unique identification information is generated for A, D, B, C, T, TT and each association relationship between A, D, B, C, T, TT, and the identification information is stored.
4. According to claim 3, a data security management method based on big data mining technology is characterized in that: The data security management method based on big data mining technology also includes: Determine whether the association relationship between A, D, B, C, T, TT and A, D, B, C, T, TT, M has been stored. If so, do not store it.
5. According to claim 1, a data security management method based on big data mining technology is characterized in that: The data preprocessing of all data tables and all data fields to obtain preprocessed data includes: When the data to be classified and graded is unstructured data, the data to be classified and graded are extracted to obtain field data corresponding to the data to be classified and graded, corresponding data tables and entity relationships, and attribute features corresponding to each data table.
6. According to claim 1, a data security management method based on big data mining technology is characterized in that: The constructing of the data classification and grading model, inputting the pre-processed data into the data classification and grading model for training, and obtaining the optimal data classification and grading model, comprises: The threshold range corresponding to the correlation index between data tables and the threshold range corresponding to the correlation index between data fields are preset.
7. The data security management method based on big data mining technology according to claim 6 is characterized in that: The constructing of the data classification and grading model, inputting the pre-processed data into the data classification and grading model for training, and obtaining the optimal data classification and grading model, further comprises: Input the data to be classified and graded into the optimal data classification and grading model, extract the corresponding key indicator data, and match the corresponding data fields, data tables and entity relationships, and attribute features corresponding to each data table based on the key indicator data; Obtaining correlation indicators between data tables and correlation indicators between data fields, and determining whether the correlation indicators exceed a threshold range. When the correlation indicators exceed the threshold range, the current model is not met. Repeating the above operations until the correlation indicators meet the threshold range. When the correlation index meets the threshold range, the classification level corresponding to the to-be-classified data is generated.
8. A data security management system based on big data mining technology, characterized in that: include: An acquisition module is used to acquire component B1 in the front-end page A1 in the development environment, a back-end data interface or a data interaction call information request C1 for the component B1 operation docking, and acquire server log data based on the data interaction call information request C1, wherein the number of the component B1 is one or more, and the number of the data interaction call information request C1 is one or more; Acquire the operation function items based on the server log data, and acquire the data sets, data tables, data fields and data processing rules corresponding to the operation function items under different request conditions; Obtain the data sets, data tables, data fields, and data processing rules called by the backend trigger tasks and trigger mechanisms; A preprocessing module is used to perform data preprocessing on all data tables and all data fields to obtain preprocessed data; A construction module is used to construct a data classification and grading model, and input the preprocessed data into the data classification and grading model for training to obtain an optimal data classification and grading model; Constructing a data classification and grading keyword library, wherein the data classification and grading keyword library includes the classification and grading levels of the data table and the classification and grading levels of the data field; A classification and grading module, used to determine whether the data to be classified and graded exists in the data classification and grading keyword library, and when the data to be classified and graded exists in the data classification and grading keyword library, match and obtain the classification and grading level of the data to be classified and graded; When the data to be classified and graded does not exist in the data classification and grading keyword library, the data to be classified and graded is input into the optimal data classification and grading model to obtain the classification and grading level corresponding to the data to be classified and graded; A permission building module, used to establish a permission database in response to a permission building request, wherein the permission database includes user role information and a data classification and grading permission level corresponding to each user role; The security management module is used to respond to the operation request initiated by the user role, determine whether the data classification and grading authority level corresponding to the user role meets the classification and grading level corresponding to the operation function item, and if so, open the corresponding operation authority to the user.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A non-transitory computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
