Dynamic data adaptive desensitization method and device based on artificial intelligence

Abstract

The embodiment of the invention provides a dynamic data self-adaptive desensitization method and device based on artificial intelligence, and relates to the technical field of dynamic data desensitization, and the method comprises the steps: marking sensitive information in dynamic data based on a deep learning model and a natural language processing technology; a reinforcement learning model is trained, and a dynamic desensitization strategy is generated for the dynamic data so as to perform data desensitization processing; identifying and classifying association relationships in the dynamic data through a graph neural network, and performing unified processing on the associated data; completing desensitization processing on the dynamic data, receiving desensitization feedback data, and adjusting a dynamic desensitization strategy based on the feedback desensitization data; the accuracy and comprehensiveness of desensitization treatment are ensured; a desensitization strategy is automatically generated and adjusted, the workload is saved, and omissions are avoided; identifying and processing associated data to ensure the integrity and consistency of the data; and the effectiveness of the desensitized data in subsequent data analysis and machine learning model training is ensured.

Description

Technical Field

[0001] The present application relates to the technical field of dynamic data desensitization, and in particular to an artificial intelligence-based dynamic data adaptive desensitization method and device. Background Art

[0002] Dynamic data desensitization is a technology that performs special processing on data when it is running, aiming to cover up the real part of sensitive data to protect data privacy. Unlike static data desensitization, dynamic data desensitization is not performed when the data is stored, but when the data is queried or used, ensuring that users do not need to use real data during actual operations, but use desensitized data, effectively avoiding direct exposure of data information.

[0003] Dynamic data desensitization is implemented through built-in security policies. Users can define desensitization policies according to actual needs, including desensitization methods and user filters. In actual applications, when users query tables containing sensitive data, the system will desensitize the target fields according to the defined desensitization policies, such as replacement, scrambling or generating random values, to protect the privacy of the data.

[0004] The advantage of dynamic data desensitization is that it can set different desensitization policies for different users in a multi-user environment, ensuring that each user can only access desensitized data within their authority. In addition, it can prevent data leakage and illegal access. Even if attackers gain access to database files, they can only see desensitized data. Dynamic data desensitization can also help companies meet compliance requirements and audit needs, and through desensitization policies, ensure that only desensitized data is displayed during the audit process.

[0005] Dynamic data desensitization can be applied to a variety of scenarios, but the current dynamic desensitization technology has the following shortcomings and deficiencies: Inaccurate identification of sensitive data: The current dynamic desensitization technology relies on manual labeling of sensitive data, and the accuracy and comprehensiveness of the desensitization process are difficult to guarantee; Difficulty in selecting desensitization algorithms: In order to implement a sophisticated desensitization strategy, it is necessary to configure the corresponding algorithm in detail for each application, each interface, and each field. This not only has a large configuration workload, but is also prone to omissions; Invalidation of data association relationships: After dynamic desensitization processing, the original association relationship between data is destroyed, affecting the integrity and consistency of the data; The quality of desensitized data is not high: The statistical characteristics and distribution patterns of the data cannot be effectively retained, and the data cannot be effectively used in subsequent data analysis and machine learning model training. Summary of the invention

[0006] The purpose of the embodiments of the present application is to provide a dynamic data adaptive desensitization method and device based on artificial intelligence to solve the problems existing in the existing dynamic data desensitization methods.

[0007] In a first aspect, an embodiment of the present application provides a dynamic data adaptive desensitization method based on artificial intelligence, comprising: Based on deep learning models and natural language processing technology, sensitive information in dynamic data is annotated; Train the reinforcement learning model to generate dynamic desensitization strategies for dynamic data to perform data desensitization; Identify and classify the associations in dynamic data through graph neural networks, and process the associated data in a unified manner; Complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data.

[0008] In the above implementation process, the embodiment of the present application marks sensitive information in dynamic data based on deep learning models and natural language processing technology; trains reinforcement learning models to generate dynamic desensitization strategies for dynamic data to perform data desensitization processing; identifies and classifies the association relationships in dynamic data through graph neural networks, and uniformly processes the associated data; completes the desensitization processing of dynamic data, and receives desensitization feedback data, and adjusts the dynamic desensitization strategy based on the feedback desensitized data; automatically identifies sensitive information in the data to ensure the accuracy and comprehensiveness of the desensitization processing; uses an adaptive desensitization algorithm to automatically generate and adjust the desensitization strategy to save workload and avoid omissions; identifies and processes associated data to ensure data integrity and consistency; adjusts the desensitization strategy through feedback desensitized data to ensure the effectiveness of desensitized data in subsequent data analysis and machine learning model training.

[0009] Furthermore, the labeling of sensitive information in dynamic data based on deep learning models and natural language processing technology includes: Determine the labeling target and the type of sensitive data to be identified; According to the annotation rules, select the annotation tool and input the training data to train the deep learning model; Based on the deep learning model combined with natural language processing technology, the data type of dynamic data is identified, and the corresponding annotation method is called to annotate sensitive information.

[0010] In the above implementation process, deep learning models are used in combination with natural language processing technology to identify and standardize sensitive information in dynamic data. It can accurately identify sensitive data such as personal information and commercial secrets, and at the same time support customized sensitive vocabulary to improve the flexibility and accuracy of recognition.

[0011] Furthermore, the training reinforcement learning model and generating a dynamic desensitization strategy according to dynamic data to perform desensitization processing include: Acquire training data and perform preprocessing and context analysis on the data to obtain context information of the data; Define the reinforcement learning environment, select the reinforcement learning algorithm to train the reinforcement learning model, and optimize and adjust the model; When a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model to generate a desensitization strategy through the reinforcement learning model; According to the generated desensitization strategy, call the corresponding desensitization tool or function to desensitize the data.

[0012] In the above implementation process, the intensity and method of desensitization are dynamically adjusted through reinforcement learning models and dynamic desensitization strategies to achieve a balance between protecting privacy and maintaining data availability.

[0013] Furthermore, the identifying and classifying the association relationships in the dynamic data through the graph neural network and uniformly processing the associated data include: Preprocess and format the training data; Select and build a graph neural network model; Train and optimize the graph neural network model through training data; The dynamic data is input into the trained graph neural network model to identify and classify the associations in the dynamic data and process the associated data in a unified manner.

[0014] In the above implementation process, the graph neural network analyzes the dependencies and structures of the data, processes the related data in a unified manner, and maintains the integrity and consistency of the data set.

[0015] Furthermore, the acquiring of training data and preprocessing and context analysis of the data to obtain context information of the data includes: Collect training data from various data sources, where the data sources include: databases, file systems, and application programming interfaces, where the data types include: structured data, semi-structured data, and unstructured data; If the data type is structured data, obtain the table structure and data content through database connection; If the data type is semi-structured or unstructured data, use the corresponding parsing tools to parse and extract key information; Clean the collected training data to remove noise, duplicate values ​​and outliers; Extract features from training data based on data type and business requirements; Analyze the context information of the training data, wherein the context information includes: the source of the data, the purpose of the data, the access frequency of the data, and the correlation relationship of the data; Construct a data graph to express the relationship between training data in a set way; The step of defining a reinforcement learning environment, selecting a reinforcement learning algorithm to train a reinforcement learning model, and optimizing and adjusting the model includes: Define the environment of reinforcement learning, where the environment of reinforcement learning includes state space, action space and reward function; Define state space, action space, and reward function; Choose a reinforcement learning algorithm; Adjust the hyperparameters of the reinforcement learning algorithm, and obtain the hyperparameter combination for the current task through experiments and tuning; wherein the hyperparameters include learning rate, discount factor, experience replay buffer size, and batch size; Use an exploration and exploitation balance strategy to train reinforcement learning models; Regularly evaluate and validate the reinforcement learning model, and use an independent test set to test the reinforcement learning model to adjust and optimize the model; When a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model to generate a desensitization strategy through the reinforcement learning model, including: When a data desensitization request is received, the characteristics and contextual information of the dynamic data are input into the trained reinforcement learning model; Based on the reinforcement learning model, the optimal action is selected according to the current state, and the corresponding desensitization operation and parameters are determined to generate a desensitization strategy; The method of calling a corresponding desensitization tool or function to perform desensitization processing on the data according to the generated desensitization strategy includes: According to the generated desensitization strategy, for different types of data and desensitization operations, call the corresponding desensitization tool or function to desensitize the data; Protect the integrity and availability of data when implementing desensitization strategies; Record the execution process and results of the desensitization strategy, where the execution results include original data, desensitized data, the time of the desensitization operation, and the person who executed it.

[0016] Furthermore, the preprocessing and format conversion of the training data includes: Obtain training data from different data sources and preprocess the training data, where the preprocessing includes removing duplicate data and processing missing values; Extracting corresponding features from node data of different data sources; wherein the features include numerical, categorical or textual feature data; Standardize or normalize the features so that different features have the same scale and distribution; Define the nodes and edges of the graph, where nodes correspond to data entities and edges represent the relationships between entities; Construct an adjacency matrix based on the relationship information in the data and create a feature matrix for each node; The step of selecting and constructing a graph neural network model includes: Select the type of graph neural network model based on the characteristics of the training data and task requirements; The training and optimization of the graph neural network model by training data includes: Receive the feature matrix and adjacency matrix of the graph as the input layer; According to the type of graph neural network model, select the corresponding hidden layer; Design the output layer according to the task type; Divide the input layer into training set, validation set and test set; Define the loss function and select the optimization algorithm; Initialize the model parameters, extract a set amount of data from the training set, input the set amount of data into the graph neural network model, perform forward propagation calculations, and obtain the prediction results of the graph neural network model; According to the prediction results and the true labels, the value of the loss function is calculated, and the gradient of the loss function to the model parameters is calculated using the back propagation algorithm; Update the model's parameters using the calculated gradients according to the chosen optimization algorithm; Monitor metrics during training, including loss and accuracy; The step of inputting the dynamic data into the trained graph neural network model to identify and classify the association relationships in the dynamic data and uniformly process the association data includes: Calculate the embedding representation of each node through the trained graph neural network model; Identify and classify related data based on node embeddings; The associated data after identification and classification are processed uniformly.

[0017] Further, the receiving of desensitization feedback data and adjusting the dynamic desensitization strategy based on the feedback desensitization data include: Establish an evaluation indicator system to measure the effectiveness of dynamic desensitization strategies; the evaluation indicators include: data security, data availability, business compliance and performance indicators; Establish user feedback channels to collect business users’ experience and opinions on desensitized data; Improve and optimize the reinforcement learning model based on evaluation indicators and user feedback; Retrain the reinforcement learning model regularly and incorporate new data and feedback information into the training process to continuously optimize the reinforcement learning model and dynamic desensitization strategy.

[0018] In the above implementation process, by monitoring the performance of the desensitized data in actual applications, collecting feedback, and adjusting the desensitization parameters, we ensure that the data meets the privacy protection requirements while enhancing the effectiveness of the desensitized data in subsequent data analysis and machine learning model training.

[0019] In a second aspect, the embodiment of the present application provides a dynamic data adaptive desensitization device based on artificial intelligence, comprising: Intelligent sensitive data identification module, which is used to annotate sensitive information in dynamic data based on deep learning models and natural language processing technology; Adaptive desensitization algorithm module, used to train reinforcement learning models and generate dynamic desensitization strategies for dynamic data to perform data desensitization processing; The data association relationship maintenance module is used to identify and classify the association relationships in dynamic data through graph neural networks, and to uniformly process the associated data; The desensitized data quality optimization module is used to complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data.

[0020] In a third aspect, an embodiment of the present application provides an electronic device, including: A processor, a memory and a bus, wherein the processor is connected to the memory via the bus, and the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, they are used to implement the dynamic data adaptive desensitization method based on artificial intelligence as described above.

[0021] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a server, the dynamic data adaptive desensitization method based on artificial intelligence as described above is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 A flowchart of a dynamic data adaptive desensitization method based on artificial intelligence provided in an embodiment of the present application; Figure 2 It is a structural schematic diagram of a dynamic data adaptive desensitization device based on artificial intelligence provided in an embodiment of the present application; Figure 3It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0025] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0026] Dynamic data desensitization is applicable to a variety of scenarios, including but not limited to: data sharing in a multi-user environment to ensure that different users can only access data within their authority; prevent data leakage and illegal access, and reduce the risk of unauthorized access to sensitive information; meet compliance requirements and protect personal privacy through desensitization; provide desensitized data in big data analysis and development and testing environments to protect the security of real sensitive data; the development and application of dynamic data desensitization technology is of great significance for modern enterprises to protect sensitive data during the digital transformation process.

[0027] The current dynamic desensitization technology has the following shortcomings and deficiencies: Inaccurate identification of sensitive data: The current dynamic desensitization technology relies on manual labeling of sensitive data, and the accuracy and comprehensiveness of the desensitization process are difficult to guarantee; Difficulty in selecting desensitization algorithms: In order to implement a sophisticated desensitization strategy, it is necessary to configure the corresponding algorithm in detail for each application, each interface, and each field. This not only has a large configuration workload, but is also prone to omissions; Invalidation of data association relationships: After dynamic desensitization processing, the original association relationships between data are destroyed, affecting the integrity and consistency of the data; The quality of desensitized data is not high: The statistical characteristics and distribution patterns of the data cannot be effectively retained, and the data cannot be effectively used in subsequent data analysis and machine learning model training.

[0028] Please see Figure 1 , Figure 1 A schematic diagram of a flow chart of a dynamic data adaptive desensitization method based on artificial intelligence provided in an embodiment of the present application. The dynamic data adaptive desensitization method based on artificial intelligence includes: 100. Label sensitive information in dynamic data based on deep learning models and natural language processing technology.

[0029] 110. Determine the labeling target and the type of sensitive data to be identified.

[0030] Optionally, clearly label the target and the types of sensitive data to be identified, such as personal identity information (name, ID number, phone number, etc.), financial information (bank account number, credit card number, etc.), medical information (medical records, diagnosis results, etc.), etc.

[0031] Optionally, determine the level of detail and standards for annotation based on specific application scenarios and requirements, such as forming an annotation team: select personnel with relevant field knowledge and annotation experience to form an annotation team, which may include experts in professional fields, data analysts, annotators, etc. Train the annotation team to make them familiar with the annotation goals, annotation standards, and how to use annotation tools.

[0032] Understandably, automatic labeling can also be performed through AI automatic labeling technology. Specifically, by training and learning a large amount of data, it can automatically identify and classify data, make it familiar with the labeling targets, labeling standards and how to use labeling tools, thereby realizing automatic labeling of data.

[0033] Specifically, according to the characteristics of the data type and the labeling task, select a suitable labeling tool, such as LabelImg, BRAT, etc.; optionally, the labeling tool can have convenient labeling operations, data management, multi-person collaboration and other functions.

[0034] 120. According to the annotation rules, select the annotation tool and input the training data to train the deep learning model.

[0035] Optionally, the data to be labeled is divided into a training set, a validation set, and a test set, wherein the training set is used for model training, the validation set is used for model tuning, and the test set is used to evaluate the performance of the model; for example, 70% of the data is used as the training set, 20% of the data is used as the validation set, and 10% of the data is used as the test set. The obtained training set is input into the model for training.

[0036] 130. Based on the deep learning model combined with natural language processing technology, the data type of dynamic data is identified, and the corresponding annotation method is called to annotate sensitive information.

[0037] It can be understood that different data types of dynamic data are identified, and corresponding annotation methods are called to annotate sensitive information.

[0038] For example, for text data: read the text content line by line or paragraph by paragraph. When sensitive data is found, use the annotation tool to select the sensitive data part in the text and add corresponding labels to it. For example, the name is marked as "PERSON", the ID number is marked as "ID_NUMBER", etc. Among them, for complex text, it may be necessary to judge and mark it in combination with the context.

[0039] For example, for image data: check the image content. If the image contains sensitive information, such as faces and license plate numbers in personal photos, you can use annotation tools to draw a box on the image and add corresponding labels. Different types of sensitive information may require different annotation methods, such as polygon annotation, key point annotation, etc.

[0040] For example, for other types of data, such as audio, video, etc., corresponding annotation methods can be adopted according to specific needs.

[0041] In addition, quality checks can be performed regularly during the annotation process. A portion of the annotated data can be randomly selected and reviewed by other annotators, experts, or AI to ensure the accuracy and consistency of the annotations. Discussions and negotiations can be conducted to unify the annotation standards for inconsistent or controversial annotations. An annotation specification document can be established to record problems and solutions during the annotation process for subsequent reference and improvement.

[0042] In addition, organize and archive the labeled data, store the labeled data separately according to the training set, validation set and test set, and ensure that the data format and naming conventions are unified; optionally, the labeled data can be converted into the format required by the deep learning model, such as CSV, JSON, TFRecord, etc.; optionally, conduct a final review of the organized labeled data to check whether the data is complete, the labels are accurate, the format is correct, etc. If any problems are found, they can be corrected and improved in a timely manner.

[0043] As described above, the embodiments of the present application utilize a deep learning model combined with natural language processing technology to identify and standardize sensitive information of dynamic data; it can accurately identify sensitive data such as personal information and commercial secrets, while supporting customized sensitive word libraries to improve the flexibility and accuracy of recognition.

[0044] 200. Train the reinforcement learning model to generate a dynamic desensitization strategy for dynamic data to perform data desensitization.

[0045] 210. Obtain training data and perform preprocessing and context analysis on the data to obtain context information of the data.

[0046] Specifically, the training data is collected from various data sources, including databases, file systems, and application programming interfaces (APIs). The data types include structured data (such as tables in relational databases), semi-structured data (such as JSON and XML files), and unstructured data (such as text files and images). If the data type is structured data, the table structure and data content are obtained through database connection; if the data type is semi-structured or unstructured data, the corresponding parsing tools are used to parse and extract key information.

[0047] Specifically, the training data is preprocessed: the collected training data is cleaned to remove noise, duplicate values ​​and outliers; for example, for text data, natural language processing technology is used to perform preprocessing operations such as lexical analysis and syntactic analysis to remove irrelevant information such as stop words and punctuation marks. In addition, feature extraction is performed on the training data according to the data type and business needs; for example, for image data, color features, texture features, shape features, etc. can be extracted; for structured data, features such as field name, data type, data length, primary key and foreign key relationship are extracted.

[0048] Specifically, context analysis is performed on the training data: the context information of the training data is analyzed, where the context information includes: the source of the data, the purpose of the data, the access frequency of the data, and the correlation relationship of the data; for example, the access mode of the data is analyzed through the database log to understand which users accessed which data at what time; the flow and use of data in different business links are analyzed through business processes. In addition, a data map is constructed to represent the correlation relationship between the training data in a set manner, which can be represented in a graphical manner. For example, for a relational database, a relationship diagram of the entity can be constructed to show the correlation relationship between tables.

[0049] 220. Define the reinforcement learning environment, select the reinforcement learning algorithm to train the reinforcement learning model, and optimize and adjust the model.

[0050] Optionally, define a reinforcement learning environment, where the reinforcement learning environment includes a state space, an action space, and a reward function.

[0051] Specifically, the state space is composed of data features and context information, for example, including data type, sensitivity level, access frequency, business scenario and other features. The dimension of the state space is determined according to actual conditions, and each dimension represents a feature.

[0052] Specifically, the action space is used to define possible desensitizing operations. For example, for numerical data, there may be operations such as truncation, rounding, and blurring; for text data, there may be operations such as replacement, encryption, and anonymization; for image data, there may be operations such as blurring and pixelation; wherein the size of the action space is determined according to the specific type of desensitizing operation.

[0053] Specifically, the reward function defines rewards based on the effectiveness of the desensitization strategy and business needs. The design goal of the reward function is to encourage the generation of desensitization strategies that both meet business needs and effectively protect data security. For example, if the desensitized data can minimize the risk of sensitive information leakage while meeting business needs, a higher reward will be given; conversely, if the desensitization strategy causes the business to not operate normally or seriously reduces data availability, a lower reward will be given.

[0054] Optionally, select and train the model; specifically, select reinforcement learning algorithms such as deep Q network (DQN), deep deterministic policy gradient (DDPG), etc. These algorithms can handle continuous state space and action space and are suitable for complex desensitization strategy generation tasks.

[0055] Exemplary, for the DQN algorithm: First, a neural network is constructed as an approximator of the Q-value function, usually using a multi-layer convolutional neural network (CNN) or a multi-layer perceptron (MLP). The input of the network is the state vector, and the output is the Q value corresponding to each action.

[0056] Secondly, through the experience replay mechanism, the experience (state, action, reward, next state) generated by the interaction between the agent and the environment is stored in the replay buffer. During training, small batches of experience data are randomly extracted from the replay buffer for training to break the correlation between the data and improve the stability of training.

[0057] In addition, the target network is used to stabilize the training process, and the parameters of the current Q network are regularly copied to the target network, which is used to calculate the target Q value, that is, the target Q value: ; in, is the current reward, is the discount factor, is the next state, It's the next move. are the parameters of the target network, It means that the current Q network is in state Next for action The predicted Q value of .

[0058] The parameters of the current Q network are updated by minimizing the loss function, which is: ; in, and is the current state and action, are the parameters of the current Q network.

[0059] For example, for the DQN algorithm: First, construct the actor network and the critic network respectively. The actor network is used to generate actions according to the current state, that is, to generate actions, that is, the actor network is: ; in, is the policy function of the actor network, are the parameters of the actor network, It's a status.

[0060] The critic network is used to evaluate the value of the current state and action, namely: ,in, are the parameters of the critic network.

[0061] Secondly, the experience replay mechanism and soft update strategy are used for training. The experience replay mechanism is similar to DQN, which is used to store and extract experience data; the soft update strategy refers to slowly updating the parameters of the target network, for example, the target parameters of the actor network and the target parameters of the critic network ,use and Update in the following way: is a small update factor.

[0062] In addition, the training goal of the actor network is to maximize the expected reward, that is, to update the parameters through the gradient ascent algorithm So that: ; in, is the objective function, and D is the experience replay buffer. The training objective of the critic network is to minimize the mean squared error loss function.

[0063] Optionally, the model is optimized and adjusted; first, the hyperparameters of the reinforcement learning algorithm are adjusted, and through experiments and tuning, a hyperparameter combination for the current task is obtained to improve the training efficiency and performance of the model; wherein the hyperparameters include learning rate, discount factor, experience replay buffer size, and batch size.

[0064] Secondly, a balanced exploration and exploitation strategy is used to train the reinforcement learning model, such as the greedy strategy (in DQN) or the noise-based exploration strategy (in DDPG). In the early stages of training, the agent conducts more exploration and tries different desensitization operations to fully understand the environment; as training progresses, it gradually increases the use of existing experience and selects the best actions to improve the quality of the generated strategy.

[0065] In addition, the reinforcement learning model is evaluated and verified regularly, and an independent test set is used to test the reinforcement learning model to adjust and optimize the model. If the model does not perform well on the test set, analyze the reasons and make corresponding adjustments, such as adding training data, improving the model structure, adjusting hyperparameters, etc.

[0066] 230. When a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model to generate a desensitization strategy through the reinforcement learning model.

[0067] Specifically, when a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model; based on the reinforcement learning model, the optimal action is selected according to the current state, and the corresponding desensitization operation and parameters are determined to generate a desensitization strategy.

[0068] For example, for a text data containing a personal ID number, the model selects the appropriate desensitization operation based on contextual information such as data type (text), sensitivity level (high, ID number is sensitive information), business scenario (maybe data analysis, but the exact ID number is not required), such as replacing the middle digits of the ID number with asterisks ("****").

[0069] The generated desensitization strategy is expressed in an executable form, such as a script, a configuration file, or an API call instruction, so that it can be applied in the actual data processing flow.

[0070] 240. According to the generated desensitization strategy, call the corresponding desensitization tool or function to desensitize the data.

[0071] Specifically, according to the generated desensitization strategy, for different types of data and desensitization operations, call the corresponding desensitization tool or function to desensitize the data; it needs to be implemented using appropriate technology. For example, for the replacement operation of text data, it can be implemented using string processing functions; for the truncation or fuzzification operation of numerical data, it can be implemented using mathematical functions and data processing libraries; for the fuzzification or pixelization operation of image data, it can be implemented using image processing libraries.

[0072] Specifically, when implementing the desensitization strategy, the integrity and availability of the data shall be protected; illustratively, when desensitizing text data, the semantic coherence and readability of the text shall be maintained; when desensitizing image data, it shall be ensured that the basic features and information of the image are not completely destroyed, so as to meet certain business requirements for data analysis and use.

[0073] Specifically, the execution process and results of the desensitization strategy are recorded, where the execution results include the original data, desensitized data, the time of the desensitization operation and the executor, so as to facilitate auditing and tracing.

[0074] As described above, the embodiments of the present application dynamically adjust the intensity and method of desensitization through reinforcement learning models and dynamic desensitization strategies to achieve a balance between protecting privacy and maintaining data availability.

[0075] 300. Use graph neural networks to identify and classify the association relationships in dynamic data, and uniformly process the associated data.

[0076] It is understandable that Graph Neural Network (GNN), as a powerful tool, can effectively process graph structured data and mine the associated information in the data.

[0077] 310. Preprocess and format the training data.

[0078] Specifically, training data is obtained from different data sources and preprocessed, where the preprocessing includes removing duplicate data and processing missing values. In addition, preprocessing also includes data cleaning, feature extraction, and graph construction, converting the original data into a graph structure suitable for GNN processing, where nodes represent data entities and edges represent the relationship between entities.

[0079] Specifically, for node data from different data sources, corresponding features are extracted; wherein the features include numerical, categorical or textual feature data; illustratively, for user nodes, features such as age, gender, and occupation are extracted; for protein nodes, amino acid sequence features, functional categories, etc. are extracted.

[0080] Specifically, the features are standardized or normalized so that different features have the same scale and distribution, which is beneficial to the training and convergence of the model; illustratively, common standardization methods such as Z-score standardization, Min-Max normalization, etc. can be used.

[0081] Specifically, the nodes and edges of the graph are defined, where nodes correspond to data entities and edges represent relationships between entities; relationships can be of various types, such as friend relationships in social networks, protein interaction relationships in biological networks, etc.

[0082] Specifically, an adjacency matrix is ​​constructed based on the relationship information in the data, and a feature matrix is ​​created for each node. For example, an adjacency matrix A is constructed based on the relationship information in the data, where Indicates whether there is an edge between node i and node j and the weight of the edge (if any); if there is an edge, The value of is the weight of the edge; if there is no edge, The value of is 0 (for an undirected graph, it is a symmetric matrix).

[0083] At the same time, a feature matrix X is created for each node, where each row of the feature matrix represents a feature vector of a node, the number of rows of the feature matrix is ​​the same as the number of nodes, and the number of columns is the same as the dimension of the extracted features.

[0084] 320. Select and build a graph neural network model.

[0085] Specifically, the type of graph neural network model is selected according to the characteristics of the training data and task requirements.

[0086] Optionally, select a suitable GNN model architecture according to data characteristics and task requirements, such as Graph Convolutional Network (GCN), Graph Attention Network (GAT), Gated Graph Neural Network (GGNN), etc., and define hyperparameters such as the number of model layers, node feature dimensions, hidden layer size, etc., build the input layer, hidden layer, and output layer of the model, and design a suitable neural network structure and activation function.

[0087] For example, GCN is suitable for processing data with regular graph structures. It propagates information on the graph through convolution operations, can effectively capture the local structural information of nodes, and performs well for tasks such as node classification and graph classification.

[0088] GAT introduces an attention mechanism that can adaptively assign different weights to different neighbor nodes and pay more attention to the information of important neighbor nodes. It works better for processing graph data with neighbors of different importance, such as analyzing the relationship between users and products in recommendation systems.

[0089] GGNN uses a gating mechanism to control the propagation and update of information in the graph. It is suitable for processing dynamic graphs or graph data with long-range dependencies. For example, it is widely used in processing graph data related to time series.

[0090] Understandably, the appropriate model is selected according to the characteristics of the specific data and the task requirements. For example, if the graph structure of the data is relatively regular and focuses on the local neighborhood information of the node, GCN may be a better choice; if the importance of neighboring nodes varies greatly, GAT may be more suitable; if the data is dynamic or has long-range dependencies, GGNN is worth considering.

[0091] 330. Train and optimize the graph neural network model through training data.

[0092] Specifically, the feature matrix and adjacency matrix of the graph are received as the input layer; for example, the feature matrix X can be directly input into the model, or it can be input after some simple linear transformation. The adjacency matrix A is used to define the structural information of the graph and is used to propagate node information in the model.

[0093] Specifically, according to the type of graph neural network model, select the corresponding hidden layer.

[0094] For example, for a GCN-type model, the hidden layer usually contains multiple graph convolution layers. In each graph convolution layer, the feature representation of the node is updated through the convolution operation. For example, using the formula: ; in, It is The node feature matrix of the layer, is the normalized adjacency matrix, yes The degree matrix of It is The learnable weight matrix of the layer, is the activation function (such as ReLU).

[0095] For GAT-type models, the hidden layer contains multiple graph attention layers. In each graph attention layer, the attention coefficient between nodes is calculated, and then the node features are updated by weighted summing of the features of neighboring nodes according to the attention coefficient. For example, the attention coefficient is calculated using the formula: ; in, is the attention function, is a learnable weight matrix, and are the feature vectors of node i and node j respectively.

[0096] Then the attention coefficient is normalized: ; in, is the set of neighbor nodes of node i.

[0097] Finally update the characteristics of node i: .

[0098] For GGNN type models, the hidden layer usually contains a gating mechanism such as a gated recurrent unit (GRU) or a long short-term memory network (LSTM). At each time step (corresponding to the information propagation step in the figure), the hidden state of the node is updated according to the current node features, neighbor node features and the hidden state of the previous moment. For example, the formula is used: ; ; ; ; in, and They are the update gate and the reset gate, is a candidate hidden state, , , is a learnable weight matrix, is the current input feature, is the hidden state at the current moment, It is the hidden state at the previous moment.

[0099] Specifically, the output layer is designed according to the task type; for node classification tasks, the output layer is usually a fully connected layer with the number of nodes equal to the number of categories. The softmax function is used to map the node features to the probability distribution of each category. For example, using the formula: ; in, is the node feature matrix of the last hidden layer, b is the bias of the fully connected layer, is the probability vector of a node belonging to each category.

[0100] For graph classification tasks, we usually first perform pooling operations on node features (such as global average pooling, global maximum pooling, etc.) to obtain graph-level feature representations, which are then input into the fully connected layer for classification. For example, using the formula: ; in, is a graph-level feature, pooling is a pooling function, and then through the formula: ; Perform graph classification.

[0101] Specifically, the input layer is divided into a training set, a validation set, and a test set. For example, 70% of the data is used as a training set, 20% of the data is used as a validation set, and 10% of the data is used as a test set. When dividing, it is necessary to ensure that the distribution of the data in each subset is similar to ensure the generalization ability of the model.

[0102] Specifically, define the loss function and select the optimization algorithm.

[0103] For example, for node classification tasks, a commonly used loss function is the cross entropy loss function, which measures the difference between the probability distribution predicted by the model and the true label distribution. The formula is: ; Where N is the number of nodes, C is the number of categories, is the true label of node i belonging to category c (if node i belongs to category c, then ,otherwise ), is the probability that the model predicts that node i belongs to category c.

[0104] For graph classification tasks, the cross entropy loss function or other loss functions suitable for graph-level classification, such as the mean squared error loss function (if the graph label is a continuous value), can be used.

[0105] Exemplarily, the Adam optimization algorithm is selected. Adam: is a commonly used adaptive learning rate optimization algorithm that combines the advantages of the momentum method and RMSProp (root mean square propagation), can automatically adjust the learning rate, and adaptively use different learning rates to update the step size for different parameters. During the training process, the Adam algorithm calculates the first-order moment estimate (i.e., the exponential moving average of the gradient) and the second-order moment estimate (i.e., the exponential moving average of the square of the gradient) of each parameter, and then updates the parameters based on these estimates, where the formula is: ; in, is the parameter value at step t, is the learning rate, is the bias-corrected value of the first-order moment estimate, is the bias-corrected value of the second-order moment estimate, is a small constant (usually , used to prevent the denominator from being 0).

[0106] Exemplarily, the SGD optimization algorithm is selected. The SGD stochastic gradient descent algorithm is a simple and commonly used optimization algorithm. In each iteration, it calculates the gradient according to the current small batch data and updates the parameters in the opposite direction of the gradient. The formula is: ; in, It is in the parameter The gradient of the loss function at is the learning rate; in practical applications, the appropriate optimization algorithm can be selected according to the characteristics of the data tank and the model performance.

[0107] Specifically, initialize the parameters of the model. Optionally, a random initialization method can usually be used. In each training round, extract a set amount (small batch) of data from the training set, which can be a set of nodes or a set of graphs, depending on the data and task), input the set amount of data into the graph neural network model, perform forward propagation calculations, and obtain the prediction results of the graph neural network model; calculate the value of the loss function based on the prediction results and the true labels, and use the backpropagation algorithm to calculate the gradient of the loss function to the model parameters; according to the selected optimization algorithm, use the calculated gradients to update the model parameters; Specifically, indicators during the training process are monitored, including loss values ​​and accuracy. For example, the performance of the model can be regularly evaluated on the validation set so as to timely adjust the learning rate, stop training, and other operations. For example, if the performance on the validation set does not improve in several consecutive rounds, you can consider reducing the learning rate or stopping training early to prevent overfitting.

[0108] 340. Input the dynamic data into the trained graph neural network model to identify and classify the association relationships in the dynamic data and process the associated data in a unified manner.

[0109] Specifically, the embedded representation of each node is calculated through the trained graph neural network model.

[0110] For example, the trained GNN model is used to perform forward propagation on the graph data to calculate the embedding representation of each node. The embedding of the node contains a comprehensive representation of its own characteristics and neighboring node information, reflecting the dependency and structural characteristics of the data in the graph.

[0111] For the GCN model, the embedding of the node is obtained by calculating multiple graph convolutional layers. After the output of the last graph convolutional layer, each node has a corresponding feature vector, which is the embedding representation of the node.

[0112] For the GAT model, the embedding of the node is obtained by weighted summing of the neighbor node features through the graph attention layer, and the node feature vector output by the last graph attention layer is used as the embedding of the node.

[0113] For the GGNN model, the hidden state of the node at the last time step is output as the embedding representation of the node.

[0114] Specifically, the associated data is identified and classified according to the node embedding.

[0115] For example, a clustering algorithm can be used to cluster nodes with similar embeddings into one category, thereby discovering associated data groups. For example, using the K-Means clustering algorithm, the number of clusters is first determined, and then the node embedding is used as input to calculate the distance from each node to the cluster center, and the node is assigned to the cluster with the closest distance. The cluster center and node assignment are continuously updated iteratively until the clustering results converge.

[0116] Exemplarily, a distance-based method may also be used, such as calculating the cosine similarity or Euclidean distance between node embeddings, to regard nodes with high similarity or close distance as associated data. For example, if the cosine similarity of two node embeddings is greater than a certain threshold, they are considered to be associated.

[0117] For example, a classifier can be trained to classify nodes using node embedding as input to identify different types of associated data. For example, a classification algorithm such as a support vector machine (SVM) or a decision tree is used to learn the mapping relationship between node embedding and category labels on a training set, and then the nodes on a test set are classified.

[0118] Specifically, the associated data after identification and classification are processed uniformly.

[0119] Exemplarily, the identified and classified related data are processed uniformly. According to specific business needs, the same processing rules can be applied to the data of the same category.

[0120] For example, in a data cleaning task, if a set of related data is found to have the same type of noise or outliers, the same method can be used to clean these data, such as deleting outliers, filling missing values, etc.

[0121] In data analysis tasks, related data can be jointly analyzed or modeled. For example, for a set of user behavior data with related relationships, a comprehensive user behavior model can be established to better understand the user's behavior patterns and preferences.

[0122] In terms of data storage and management, related data can be stored together for easy query and retrieval. For example, related data belonging to the same business process or project can be stored in a database table or file, and corresponding indexes and associations can be established to facilitate subsequent data processing and analysis.

[0123] As described above, the neural network in the embodiment of the present application analyzes the dependencies and structures of the data, processes the related data in a unified manner, and maintains the integrity and consistency of the data set.

[0124] 400. Complete desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitization data.

[0125] 410. Establish an evaluation indicator system to measure the effectiveness of dynamic desensitization strategies; the evaluation indicators include: data security, data availability, business compliance and performance indicators.

[0126] Among them, data security is measured by evaluating the risk of sensitive information leakage in the desensitized data. Methods such as information entropy and differential privacy measurement can be used to quantify data security. For example, the entropy value of sensitive information in the desensitized data is calculated. If the entropy value is large, it means that the uncertainty of sensitive information increases and security improves.

[0127] Data availability is used to evaluate the availability of desensitized data for business applications. It can be measured by calculating indicators such as data integrity, accuracy, and consistency. For example, for data analysis tasks, the difference in statistical analysis results between the data before and after desensitization is compared. If the difference is small, it means that the data availability is high.

[0128] Business compliance is to check whether the desensitization strategy complies with relevant laws, regulations and business specifications. For example, for the desensitization of medical data, it is necessary to ensure compliance with medical privacy regulations; for the desensitization of financial data, it is necessary to comply with financial regulatory requirements.

[0129] Performance indicators are used to evaluate the execution efficiency and resource consumption of the desensitization strategy, including desensitization processing time, memory usage, CPU usage, etc.

[0130] 420. Establish a user feedback channel to collect business users’ experience and opinions on the use of anonymized data.

[0131] Specifically, establish a user feedback channel to collect business users' experience and opinions on the desensitized data. Users can provide feedback through interface feedback, questionnaires, online comments, etc. For example, when business users use desensitized data for data analysis, if they find that the data has usability problems or does not meet business requirements, they can provide feedback to the system in a timely manner.

[0132] 430. Improve and optimize the reinforcement learning model based on the evaluation indicators and user feedback results.

[0133] Among them, if it is found that the data security of the desensitization strategy is insufficient in some cases, the reward function can be adjusted to increase the reward weight for security performance, so as to encourage the model to generate safer strategies; if data availability is greatly affected, the training data and feature selection of the model can be adjusted to better consider business needs; if users feedback that certain types of data desensitization methods are unreasonable, the model's action space or strategy generation logic can be improved in a targeted manner.

[0134] 440. Regularly retrain the reinforcement learning model and incorporate new data and feedback information into the training process to continuously optimize the reinforcement learning model and dynamic desensitization strategy.

[0135] As a result, the reinforcement learning model can generate the best desensitization strategy that better meets actual business needs.

[0136] As described above, the embodiments of the present application monitor the performance of the desensitized data in actual applications, collect feedback, and adjust the desensitization parameters to ensure that the data meets the privacy protection requirements while enhancing the effectiveness of the desensitized data in subsequent data analysis and machine learning model training.

[0137] The embodiments of the present application are based on deep learning models and natural language processing technology to mark sensitive information in dynamic data; train reinforcement learning models to generate dynamic desensitization strategies for dynamic data to perform data desensitization processing; identify and classify the association relationships in dynamic data through graph neural networks, and uniformly process the associated data; complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data; automatically identify sensitive information in the data to ensure the accuracy and comprehensiveness of the desensitization processing; use an adaptive desensitization algorithm to automatically generate and adjust the desensitization strategy to save workload and avoid omissions; identify and process associated data to ensure data integrity and consistency; adjust the desensitization strategy through feedback desensitized data to ensure the effectiveness of the desensitized data in subsequent data analysis and machine learning model training.

[0138] The above steps are not to be performed in a strict order as described in the numbers, but should be understood as an overall solution.

[0139] In the second aspect, based on the above embodiments, Figure 2 A schematic diagram of the structure of a dynamic data adaptive desensitization device based on artificial intelligence provided in an embodiment of the present application. Figure 2 The artificial intelligence-based dynamic data adaptive desensitization device provided in this embodiment specifically includes: an intelligent sensitive data identification module 201, an adaptive desensitization algorithm module 202, a data association relationship maintenance module 203 and a desensitized data quality optimization module 204.

[0140] Among them, the intelligent sensitive data identification module 201 is used to mark sensitive information in dynamic data based on deep learning models and natural language processing technology; the adaptive desensitization algorithm module 202 is used to train the reinforcement learning model and generate a dynamic desensitization strategy for dynamic data to perform data desensitization processing; the data association relationship maintenance module 203 is used to identify and classify the association relationships in dynamic data through graph neural networks, and to uniformly process the associated data; the desensitized data quality optimization module 204 is used to complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data.

[0141] As described above, the embodiments of the present application are based on deep learning models and natural language processing technology to mark sensitive information in dynamic data; train reinforcement learning models to generate dynamic desensitization strategies for dynamic data to perform data desensitization processing; identify and classify the association relationships in dynamic data through graph neural networks, and uniformly process the associated data; complete the desensitization processing of dynamic data, and receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data; automatically identify sensitive information in the data to ensure the accuracy and comprehensiveness of the desensitization processing; adaptive desensitization algorithm, automatically generate and adjust the desensitization strategy, save workload, and avoid omissions; identify and process associated data to ensure data integrity and consistency; adjust the desensitization strategy through feedback desensitized data to ensure the effectiveness of desensitized data in subsequent data analysis and machine learning model training.

[0142] The artificial intelligence-based dynamic data adaptive desensitization device provided in the embodiment of the present application can be used to execute the artificial intelligence-based dynamic data adaptive desensitization method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0143] On the third aspect, the embodiments of the present application also provide an electronic device, which can integrate the artificial intelligence-based dynamic data adaptive desensitization device provided in the embodiments of the present application. Figure 3 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Figure 3 The electronic device includes: an input device 33, an output device 34, a memory 32 and one or more processors 31; the memory 32 is used to store one or more programs; when the one or more programs are executed by the one or more processors 31, the one or more processors 31 implement the dynamic data adaptive desensitization method based on artificial intelligence as provided in the above embodiment. The input device 33, the output device 34, the memory 32 and the processor 31 can be connected by a bus or other means. Figure 3 The example of connecting through bus is taken in the following.

[0144] The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 32, thereby realizing the above-mentioned dynamic data adaptive desensitization method based on artificial intelligence.

[0145] The electronic device provided above can be used to execute the dynamic data adaptive desensitization method based on artificial intelligence provided in the above embodiment, and has corresponding functions and beneficial effects.

[0146] In a fourth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a stored computer program; wherein, when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the dynamic data adaptive desensitization method based on artificial intelligence as described above, and can achieve the same beneficial effects.

[0147] Of course, the storage medium containing computer executable instructions provided in the embodiments of the present application is not limited to the dynamic data adaptive desensitization method based on artificial intelligence as described above, and can also execute related operations in the dynamic data adaptive desensitization method based on artificial intelligence provided in any embodiment of the present application.

[0148] In a fifth aspect, the embodiments of the present application also provide a computer program product, and the methods described in the various embodiments of the present application can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the processes or functions described in the various embodiments of the present application are executed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM (Open Application Model) or other programmable device.

[0149] The computer program or instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0150] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0151] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0152] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for enabling an electronic device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.

[0153] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0154] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0155] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A dynamic data adaptive desensitization method based on artificial intelligence, It is characterized in that The method comprises: Based on deep learning models and natural language processing technology, sensitive information in dynamic data is annotated; Train the reinforcement learning model to generate dynamic desensitization strategies for dynamic data to perform data desensitization; Identify and classify the associations in dynamic data through graph neural networks, and process the associated data in a unified manner; Complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data.

2. According to the artificial intelligence-based dynamic data adaptive desensitization method of claim 1, It is characterized in that The method of labeling sensitive information in dynamic data based on deep learning models and natural language processing technology includes: Determine the labeling target and the type of sensitive data to be identified; According to the annotation rules, select the annotation tool and input the training data to train the deep learning model; Based on the deep learning model combined with natural language processing technology, the data type of dynamic data is identified, and the corresponding annotation method is called to annotate sensitive information.

3. The dynamic data adaptive desensitization method based on artificial intelligence according to claim 1, It is characterized in that The training reinforcement learning model and generating a dynamic desensitization strategy based on dynamic data to perform desensitization processing include: Acquire training data and perform preprocessing and context analysis on the data to obtain context information of the data; Define the reinforcement learning environment, select the reinforcement learning algorithm to train the reinforcement learning model, and optimize and adjust the model; When a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model to generate a desensitization strategy through the reinforcement learning model; According to the generated desensitization strategy, call the corresponding desensitization tool or function to desensitize the data.

4. The dynamic data adaptive desensitization method based on artificial intelligence according to claim 1, It is characterized in that The method of identifying and classifying the association relationships in dynamic data through a graph neural network and uniformly processing the association data includes: Preprocess and format the training data; Select and build a graph neural network model; Train and optimize the graph neural network model through training data; The dynamic data is input into the trained graph neural network model to identify and classify the associations in the dynamic data and process the associated data in a unified manner.

5. According to the artificial intelligence-based dynamic data adaptive desensitization method of claim 3, It is characterized in that The obtaining of training data and preprocessing and context analysis of the data to obtain context information of the data includes: Collecting training data from various data sources, wherein the data sources include: databases, file systems, and application programming interfaces, wherein the data types of the training data include: structured data, semi-structured data, and unstructured data; If the data type is structured data, obtain the table structure and data content through database connection; If the data type is semi-structured or unstructured data, use the corresponding parsing tools to parse and extract key information; Clean the collected training data to remove noise, duplicate values ​​and outliers; Extract features from training data based on data type and business requirements; Analyze the context information of the training data, wherein the context information includes: the source of the data, the purpose of the data, the access frequency of the data, and the correlation relationship of the data; Construct a data graph to express the relationship between training data in a set way; The step of defining a reinforcement learning environment, selecting a reinforcement learning algorithm to train a reinforcement learning model, and optimizing and adjusting the model includes: Define the environment of reinforcement learning, where the environment of reinforcement learning includes state space, action space and reward function; Define state space, action space, and reward function; Choose a reinforcement learning algorithm; Adjust the hyperparameters of the reinforcement learning algorithm, and obtain the hyperparameter combination of the current task through experiments and tuning; wherein the hyperparameters include learning rate, discount factor, experience replay buffer size and batch size; Use an exploration and exploitation balance strategy to train reinforcement learning models; Regularly evaluate and validate the reinforcement learning model, and use an independent test set to test the reinforcement learning model to adjust and optimize the model; When a data desensitization request is received, the characteristics and context information of the dynamic data are input into the trained reinforcement learning model to generate a desensitization strategy through the reinforcement learning model, including: When a data desensitization request is received, the characteristics and contextual information of the dynamic data are input into the trained reinforcement learning model; Based on the reinforcement learning model, the optimal action is selected according to the current state, and the corresponding desensitization operation and parameters are determined to generate a desensitization strategy; The method of calling a corresponding desensitization tool or function to perform desensitization processing on the data according to the generated desensitization strategy includes: According to the generated desensitization strategy, for different types of data and desensitization operations, call the corresponding desensitization tool or function to desensitize the data; Protect the integrity and availability of data when implementing desensitization strategies; Record the execution process and results of the desensitization strategy, where the execution results include original data, desensitized data, the time of the desensitization operation, and the person who executed it.

6. The method for adaptive desensitization of dynamic data based on artificial intelligence according to claim 4, It is characterized in that The preprocessing and format conversion of the training data includes: Obtain training data from different data sources and preprocess the training data, where the preprocessing includes removing duplicate data and processing missing values; Extracting corresponding features from node data of different data sources; wherein the features include numerical, categorical or textual feature data; Standardize or normalize the features so that different features have the same scale and distribution; Define the nodes and edges of the graph, where nodes correspond to data entities and edges represent the relationships between entities; Construct an adjacency matrix based on the relationship information in the data and create a feature matrix for each node; The step of selecting and constructing a graph neural network model includes: Select the type of graph neural network model based on the characteristics of the training data and task requirements; The training and optimization of the graph neural network model by training data includes: Receive the feature matrix and adjacency matrix of the graph as the input layer; According to the type of graph neural network model, select the corresponding hidden layer; Design the output layer according to the task type; Divide the input layer into training set, validation set and test set; Define the loss function and select the optimization algorithm; Initialize the model parameters, extract a set amount of data from the training set, input the set amount of data into the graph neural network model, perform forward propagation calculations, and obtain the prediction results of the graph neural network model; According to the prediction results and the true labels, the value of the loss function is calculated, and the gradient of the loss function to the model parameters is calculated using the back propagation algorithm; Update the model's parameters using the calculated gradients according to the chosen optimization algorithm; Monitor metrics during training, including loss and accuracy; The step of inputting the dynamic data into the trained graph neural network model to identify and classify the association relationships in the dynamic data and uniformly process the association data includes: Calculate the embedding representation of each node through the trained graph neural network model; Identify and classify related data based on node embeddings; The associated data after identification and classification are processed uniformly.

7. The dynamic data adaptive desensitization method based on artificial intelligence according to claim 1, It is characterized in that The receiving of desensitization feedback data and adjusting the dynamic desensitization strategy based on the feedback desensitization data includes: Establish an evaluation indicator system to measure the effectiveness of dynamic desensitization strategies; the evaluation indicators include: data security, data availability, business compliance and performance indicators; Establish user feedback channels to collect business users’ experience and opinions on desensitized data; Improve and optimize the reinforcement learning model based on evaluation indicators and user feedback; Retrain the reinforcement learning model regularly and incorporate new data and feedback information into the training process to continuously optimize the reinforcement learning model and dynamic desensitization strategy.

8. A dynamic data adaptive desensitization device based on artificial intelligence, It is characterized in that include: Intelligent sensitive data identification module, which is used to annotate sensitive information in dynamic data based on deep learning models and natural language processing technology; Adaptive desensitization algorithm module, used to train reinforcement learning models and generate dynamic desensitization strategies for dynamic data to perform data desensitization processing; The data association relationship maintenance module is used to identify and classify the association relationships in dynamic data through graph neural networks, and to uniformly process the associated data; The desensitized data quality optimization module is used to complete the desensitization processing of dynamic data, receive desensitization feedback data, and adjust the dynamic desensitization strategy based on the feedback desensitized data.

9. An electronic device, It is characterized in that include: A processor, a memory and a bus, wherein the processor is connected to the memory via the bus, and the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, they are used to implement the dynamic data adaptive desensitization method based on artificial intelligence as described in any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, which, when executed by a server, implements the artificial intelligence-based dynamic data adaptive desensitization method as described in any one of claims 1-7.

Images