Metadata database processing and application method, device and equipment based on static desensitization, storage medium and program product
By segmenting the metadata database using a static data masking method, the problems of poor masking effect and data correlation destruction in traditional data masking methods are solved. This achieves data consistency and availability across different backup nodes, reduces the risk of data leakage, and generates verifiable mapping relationships.
Patent Information
- Application Number
- CN202510467107.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-15
- Publication Date
- 2025-11-04
- Estimated Expiration
- 2045-04-15
AI Technical Summary
Traditional data masking methods have poor masking effects in backup data, destroy data correlation and pose a risk of data leakage due to data piecing together, and cannot maintain consistency across different backup nodes or full/incremental backups.
A static desensitization-based metadata database processing method is adopted. By generating a new metadata database, the target data is subjected to segmented static desensitization processing, including encryption desensitization and full field value replacement, generating a set of mapping records, and displaying the mapping relationship when a user accesses the database.
It preserves data availability and relevance, avoids the risk of data leakage due to data patching, improves data anonymization, ensures the consistency of the same sensitive data across different backup nodes, and generates verifiable mapping relationships to support subsequent use by users.
Smart Images

Figure CN120509051B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of information security technology, and in particular to a method, apparatus, computer equipment, computer-readable storage medium, and computer program product for processing and applying a metadata database based on static desensitization. Background Technology
[0002] As enterprises accelerate their digital transformation, backup data has expanded from traditional disaster recovery to scenarios such as development testing and data analysis. However, directly using un-anonymized disaster recovery data poses a risk of sensitive information leakage. Consequently, methods for anonymizing data have emerged to prevent the leakage of sensitive information.
[0003] Traditional data anonymization methods typically employ multiple distributed anonymization strategies. This results in the same data appearing differently on different backup nodes or in full / incremental backup sets. This not only disrupts the correlation between backup data but also poses a risk of data leakage due to residual reversible characteristics, leading to poor anonymization effectiveness. Summary of the Invention
[0004] Therefore, it is necessary to provide a method, apparatus, computer equipment, computer-readable storage medium, and computer program product for processing and applying metadata databases based on static desensitization, in order to address the aforementioned technical problems.
[0005] Firstly, this application provides a method for processing and applying metadata databases based on static data anonymization, including:
[0006] Determine the data to be transferred from the current metadata database in the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database.
[0007] If the new metadata database passes the verification, the target data in the new metadata database is subjected to segmented static desensitization processing to obtain a target metadata database containing desensitized data.
[0008] In response to a user's access request, the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data are obtained from the target metadata database.
[0009] Based on the mapping record set, the mapping relationship between the de-identified data and the original data is obtained, and the mapping relationship is displayed in response to the user's mapping viewing request.
[0010] In one embodiment, the segmented static desensitization processing of the target data in the new metadata database includes:
[0011] The target data is segmented to obtain a first target field and a second target field; the first target field is encrypted and desensitized, and a first mapping record is generated and stored in the target metadata database; the second target field is fully replaced according to a preset mapping rule table to obtain a desensitized second target field, and a second mapping record is generated and stored in the target metadata database.
[0012] In one embodiment, the encryption and desensitization of the first target field includes:
[0013] According to the preset encryption and desensitization strategy, the first target field is encrypted and desensitized and a corresponding key is generated. The encrypted and desensitized first target field is then encrypted and stored based on the key. According to the encryption and desensitization strategy, the log entries corresponding to the first target field in the log system are synchronously encrypted and desensitized.
[0014] In one embodiment, obtaining the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database includes:
[0015] Based on the access request, the user undergoes a first permission verification. If the first permission verification passes, the key and the mapping rule table are invoked. Using the key and the mapping rule table, the original data and the mapping record set are extracted from the target metadata database.
[0016] In one embodiment, determining the data to be transferred in the current metadata database of the backup system includes:
[0017] If the user's data transfer instruction indicates a full transfer, then all data contained in the front-end database is determined as the data to be transferred; if the data transfer instruction indicates a partial transfer, then the filtering conditions contained in the data transfer instruction are identified, and the data in the front-end database is filtered according to the filtering conditions to obtain the data to be transferred.
[0018] In one embodiment, obtaining the mapping relationship between the de-identified data and the original data based on the mapping record set includes:
[0019] Based on the mapping record set, the storage method of the original data is determined, and based on the storage method, a de-identification identifier corresponding to the original data is generated; based on the mapping record set and the de-identification identifier, the mapping relationship between the de-identified data and the original data is generated;
[0020] The step of responding to the user's mapping viewing request and displaying the mapping relationship includes:
[0021] Based on the mapping viewing request, the user undergoes a second permission verification. If the second permission verification is successful, the mapping relationship is displayed.
[0022] Secondly, this application also provides a metadata database processing and application apparatus based on static data anonymization, comprising:
[0023] The data transfer module is used to determine the data to be transferred in the current metadata database of the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database.
[0024] The data desensitization module is used to perform segmented static desensitization processing on the target data in the new metadata database when the new metadata database passes the verification, so as to obtain a target metadata database containing desensitized data.
[0025] The information acquisition module is used to, in response to a user's access request, acquire the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database.
[0026] The mapping display module is used to obtain the mapping relationship between the de-identified data and the original data based on the mapping record set, and to display the mapping relationship in response to the user's mapping viewing request.
[0027] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:
[0028] The system identifies the data to be transferred from the current metadata database in the backup system. Based on this data, a new metadata database is generated and validated. If the new metadata database passes validation, the target data in the new metadata database undergoes segmented static anonymization processing to obtain a target metadata database containing the anonymized data. In response to a user's access request, the system retrieves the original data corresponding to the target data and a set of mapping records between the original data and the anonymized data from the target metadata database. Based on the mapping record set, the system obtains the mapping relationship between the anonymized data and the original data. In response to a user's mapping viewing request, the system displays the mapping relationship.
[0029] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:
[0030] The system identifies the data to be transferred from the current metadata database in the backup system. Based on this data, a new metadata database is generated and validated. If the new metadata database passes validation, the target data in the new metadata database undergoes segmented static anonymization processing to obtain a target metadata database containing the anonymized data. In response to a user's access request, the system retrieves the original data corresponding to the target data and a set of mapping records between the original data and the anonymized data from the target metadata database. Based on the mapping record set, the system obtains the mapping relationship between the anonymized data and the original data. In response to a user's mapping viewing request, the system displays the mapping relationship.
[0031] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, performs the following steps:
[0032] The system identifies the data to be transferred from the current metadata database in the backup system. Based on this data, a new metadata database is generated and validated. If the new metadata database passes validation, the target data in the new metadata database undergoes segmented static anonymization processing to obtain a target metadata database containing the anonymized data. In response to a user's access request, the system retrieves the original data corresponding to the target data and a set of mapping records between the original data and the anonymized data from the target metadata database. Based on the mapping record set, the system obtains the mapping relationship between the anonymized data and the original data. In response to a user's mapping viewing request, the system displays the mapping relationship.
[0033] The aforementioned method, apparatus, computer equipment, computer-readable storage medium, and computer program product for processing and applying metadata databases based on static data anonymization, employs a segmented processing approach for sensitive fields to perform segmented static anonymization on target data in the new metadata database. This ensures the readability of backup data imported into a different machine environment, thereby preserving data availability. Furthermore, this application achieves unified anonymization of metadata and log fields, guaranteeing that the same data maintains the same form after anonymization on different backup nodes or full / incremental backup sets, preserving the correlation of backup data, ensuring consistency of the same sensitive data across different tables, and effectively avoiding the risk of data leakage due to residual reversible characteristics. In addition, during the application process after static data anonymization, this application generates a verifiable mapping relationship between the original data and the anonymized data based on the mapping record set between the original data and the anonymized data, thereby ensuring a controllable association between the anonymized data and the original data, greatly improving the data anonymization effect and facilitating subsequent use of the anonymized data by users. Attached Figure Description
[0034] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0035] Figure 1 This is an application environment diagram of a metadata database processing and application method based on static desensitization in one embodiment;
[0036] Figure 2 This is a flowchart illustrating a method for processing and applying a metadata database based on static desensitization in one embodiment.
[0037] Figure 3 This is a flowchart illustrating the segmented static desensitization steps in one embodiment;
[0038] Figure 4(a) is a flowchart of a metadata database processing method based on static desensitization in a specific embodiment;
[0039] Figure 4(b) is a flowchart of a metadata database application method based on static desensitization in a specific embodiment;
[0040] Figure 5 This is a structural block diagram of a metadata database processing and application device based on static desensitization in one embodiment;
[0041] Figure 6 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0042] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0043] The metadata database processing and application method based on static desensitization provided in this application can be applied to, for example... Figure 1 The application environment shown depicts a scenario where the terminal communicates with the server via a network. The data storage system stores the data the server needs to process. This data storage system can be integrated onto the server or hosted on the cloud or other network servers. In such an environment... Figure 1 In the application environment shown, the terminal can be, but is not limited to, various personal computers, laptops, smartphones, and tablets. The server can be implemented using a standalone server or a server cluster consisting of multiple servers.
[0044] In one embodiment, such as Figure 2 As shown, a method for metadata processing and application based on static data anonymization is provided, which is then applied to... Figure 1 Taking the terminal in the example, the explanation includes the following steps:
[0045] Step S201: Determine the data to be transferred from the current metadata database in the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database.
[0046] The metadata database can be a catalog, which may contain metadata information such as database structure, table structure, views, and permissions.
[0047] Specifically, the terminal determines the data to be transferred from the current metadata database in the backup system based on the user's data selection instructions, uses a database tool to export the Catalog structure, extracts the data to be transferred from the current metadata database through a script and writes it into the new metadata database, then converts the permission policy of the current metadata database into the security mechanism of the new metadata database, and finally performs a three-step verification protocol on the new metadata database to ensure data consistency.
[0048] Step S202: If the new metadata database passes the verification, the target data in the new metadata database is subjected to segmented static desensitization processing to obtain the target metadata database containing the desensitized data.
[0049] Specifically, after confirming that the new metadata database has passed verification, the terminal performs segmented static desensitization processing on the target data in the new metadata database. Some fields are encrypted and desensitized, and some fields are custom-replaced and desensitized, resulting in a target metadata database containing desensitized data while retaining the usability of the desensitized data.
[0050] Step S203: In response to the user's access request, retrieve the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database.
[0051] The mapping record set includes at least the first mapping record corresponding to the encryption and desensitization of the first target field and the second mapping record corresponding to the replacement and desensitization of the second target field.
[0052] Specifically, the terminal verifies the user's permissions based on the access request, and if the permission verification is successful, it calls the key and mapping rule table to extract the original data and mapping record set from the target metadata database.
[0053] Step S204: Based on the mapping record set, obtain the mapping relationship between the de-identified data and the original data, and display the mapping relationship in response to the user's mapping viewing request.
[0054] Specifically, the terminal determines the storage method of the original data based on the mapping record set and generates a de-identification identifier corresponding to the original data. Then, based on the mapping record set and the de-identification identifier, it generates a mapping relationship between the de-identified data and the original data, and displays the mapping relationship in response to the user's mapping viewing request.
[0055] In the aforementioned method for processing and applying metadata databases based on static data masking, the target data in the new metadata database is statically masked in segments by using a sensitive field segmentation approach. This ensures the readability of the backup data after importing it into a different machine environment, thereby preserving data availability. This application also achieves unified masking of metadata and log fields, ensuring that the same data has the same form after masking on different backup nodes or full / incremental backup sets, preserving the correlation of backup data, and ensuring the consistency of the same sensitive data in different tables. This effectively avoids the risk of data leakage due to residual reversible characteristics. Furthermore, in the application process after static data masking, this application also generates a verifiable mapping relationship between the original data and the masked data based on the mapping record set between the original data and the masked data. This ensures a controllable association between the masked data and the original data, greatly improving the data masking effect and facilitating the subsequent use of the masked data by users.
[0056] In one embodiment, such as Figure 3 As shown, in step S202 above, the target data in the new metadata database undergoes segmented static desensitization processing, which specifically includes the following steps:
[0057] Step S301: The target data is segmented to obtain the first target field and the second target field.
[0058] Step S302: Encrypt and desensitize the first target field, and generate and store the first mapping record in the target metadata database.
[0059] Step S303: Replace all field values of the second target field according to the preset mapping rule table to obtain the de-identified second target field, and generate and store the second mapping record in the target metadata database.
[0060] Specifically, the terminal segments the target data according to a preset ratio based on the required scenario to obtain the first target field and the second target field under the required scenario; it selects an encryption algorithm to encrypt and desensitize the first target field and generates a corresponding key; it then defines a mapping rule table and replaces all field values of the second target field according to the preset mapping rule table to obtain the desensitized second target field, thereby making the data readable after importing backup data into a different machine environment, while retaining the availability of the data.
[0061] In one embodiment, as described above, the encryption and desensitization of the first target field specifically includes the following steps:
[0062] According to the preset encryption and desensitization strategy, the first target field is encrypted and desensitized and a corresponding key is generated. The encrypted and desensitized first target field is then encrypted and stored based on the key. According to the encryption and desensitization strategy, the log entries corresponding to the first target field in the log system are synchronously encrypted and desensitized.
[0063] Specifically, the terminal encrypts and desensitizes the first target field according to the encryption algorithm in the encryption and desensitization strategy and generates a corresponding key. Then, based on the key, it performs field-level encryption storage on the encrypted and desensitized first target field. The terminal also synchronizes the encryption and desensitization strategy to the log system, parses the log format, applies the same log rules, stores the mapping record, and uses log tools to filter sensitive fields. This achieves unified desensitization of metadata and log fields, ensuring the consistency of the same sensitive data in different tables.
[0064] In one embodiment, step S203 above, obtaining the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database, specifically includes the following steps:
[0065] Based on the access request, the user's first permission is verified. If the first permission verification is successful, the key and mapping rule table are invoked. Using the key and mapping rule table, the original data and the set of mapping records are extracted from the target metadata database.
[0066] Specifically, in response to a user's access request, the terminal verifies the user's access rights. If the access rights verification is successful, the terminal calls the key and mapping rule table and uses the key and mapping rule table to extract the original data and the set of mapping records between the original data and the de-identified data from the target metadata database.
[0067] In this embodiment, the security of de-identified data applications can be improved by verifying user access permissions before obtaining the original data.
[0068] In one embodiment, step S201 above, determining the data to be transferred from the current metadata database in the backup system, specifically includes the following steps:
[0069] If the user's data transfer instruction indicates a full transfer, then all data contained in the previous metadata database is identified as the data to be transferred; if the data transfer instruction indicates a partial transfer, then the filtering conditions contained in the data transfer instruction are identified, and the data in the previous metadata database is filtered according to the filtering conditions to obtain the data to be transferred.
[0070] The filtering criteria can include resource type, tags, and time stamps, such as specifying to migrate only tables / views / functions (using database tools or script filtering).
[0071] Specifically, the terminal responds to the user's data transfer instruction and determines whether data filtering is required based on the instruction. If the user's data transfer instruction indicates a full transfer, all data contained in the previous metadata database is identified as the data to be transferred. If the data transfer instruction indicates a partial transfer, the filtering conditions contained in the instruction are identified, and the data in the previous metadata database is filtered according to the filtering conditions using a database filtering tool or script to obtain the filtered data to be transferred.
[0072] In one embodiment, step S204 above, based on the mapping record set, obtains the mapping relationship between the de-identified data and the original data, and displays the mapping relationship in response to the user's mapping viewing request, specifically including the following steps:
[0073] Based on the mapping record set, determine the storage method of the original data, and generate a de-identification identifier corresponding to the original data based on the storage method; based on the mapping record set and the de-identification identifier, generate a mapping relationship between the de-identified data and the original data; based on the mapping viewing request, perform a second permission verification on the user, and display the mapping relationship if the second permission verification is successful.
[0074] The storage methods for raw data include, but are not limited to, cold storage and hot storage.
[0075] Specifically, the terminal determines the storage method of the original data based on the mapping record set, and generates and returns the de-identification identifier corresponding to the original data based on the storage method; then, based on the mapping record set and the de-identification identifier, it generates and stores the mapping relationship between the de-identified data and the original data; in response to the user's mapping viewing request, it verifies the user's mapping viewing permission, and if the mapping viewing permission verification is successful, it displays the mapping relationship between the de-identified data and the original data.
[0076] In this embodiment, during the static desensitization process, a verifiable mapping relationship between the original data and the desensitized data is generated and stored, which is beneficial for the subsequent application of the desensitized data.
[0077] In one embodiment, as shown in Figures 4(a) and 4(b), a method for applying a metadata database based on static desensitization is provided, which specifically includes the following steps:
[0078] Step 1, Catalog Transfer: Transfer the current Catalog to a new database. The purpose is to back up metadata information (such as table structure, views, permissions, etc.) to the new database.
[0079] 1.1 Specify to migrate only tables / views / functions (using database tools for filtering or script filtering), or perform a full transfer;
[0080] 1.2. Use database tools to export the Catalog structure, extract metadata data using scripts, and write it to a new database;
[0081] 1.3. Convert the source library's permission policy to the target library's security mechanism;
[0082] 1.4. Generate a new library;
[0083] 1.5 Implement a three-step verification protocol to ensure data consistency.
[0084] Step 2, Static Desensitization:
[0085] 2.1 Encryption and Desensitization: Select an encryption algorithm to encrypt and desensitize the target data in the new database; generate the corresponding key; and perform field-level encrypted storage.
[0086] 2.2. Masking Strategy Synchronization: Synchronize the masking strategy to the log system; parse the log format; apply the same log rules; store the mapping records; use log tools to filter sensitive fields;
[0087] 2.3 Custom Replacement and Desensitization: Define a mapping rule table; perform full field value replacement on the desensitized data; store the mapping records; replace and display the desensitized data.
[0088] Step 3: Application of the new library after de-identification:
[0089] 3.1 Raw Data Acquisition: Decrypt access control; verify user permissions and retrieve key; acquire raw data;
[0090] 3.2 Obtain the mapping relationship between de-identified data and original data: Obtain the mapping record (cold storage / hot storage); generate and return the de-identification identifier; verify the user's permission to view the mapping; display the mapping relationship between the original data and the de-identified data.
[0091] Step 4: Application of de-identified data:
[0092] After obtaining the mapping relationship between the anonymized data and the original data, users can use the anonymized data for problem handling, optimization scheme formulation, or internal demonstration.
[0093] Static data masking involves irreversibly processing sensitive fields before data storage or migration to ensure data security in non-production environments.
[0094] Catalog can refer to a metadata database, which may contain information such as database structure, tables, and views.
[0095] The beneficial effects of the above embodiments are as follows:
[0096] 1) By segmenting sensitive fields, some fields are encrypted and stored, while others are replaced and desensitized, so that the data can be read after being imported into a different machine environment, thus preserving the availability of the data.
[0097] 2) Implement unified desensitization of metadata and log fields to ensure that the same data has the same form after desensitization on different backup nodes or full / incremental backup sets, retain the correlation of backup data, and ensure the consistency of the same sensitive data in different tables.
[0098] 3) During the static data masking process, a verifiable mapping relationship between the original data and the masked data is generated and stored to ensure a controllable association between the masked data and the original data, which is beneficial for users to use the masked backup data.
[0099] 4) A data anonymization method for backup system metadata database is proposed.
[0100] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0101] Based on the same inventive concept, this application also provides an apparatus for implementing the above-described method for processing and applying metadata databases based on static data masking. The solution provided by this apparatus is similar to the implementation described in the above method. Therefore, the specific limitations in one or more embodiments of the apparatus for processing and applying metadata databases based on static data masking provided below can be found in the limitations of the method for processing and applying metadata databases based on static data masking described above, and will not be repeated here.
[0102] In one exemplary embodiment, such as Figure 5 As shown, a metadata database processing and application device based on static data anonymization is provided, comprising:
[0103] The data transfer module 501 is used to determine the data to be transferred in the current metadata database of the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database.
[0104] The data desensitization module 502 is used to perform segmented static desensitization processing on the target data in the new metadata database after the new metadata database has passed the verification, so as to obtain a target metadata database containing desensitized data.
[0105] The information acquisition module 503 is used to respond to the user's access request and obtain the original data corresponding to the target data and the set of mapping records between the original data and the desensitized data from the target metadata database.
[0106] The mapping display module 504 is used to obtain the mapping relationship between the de-identified data and the original data based on the mapping record set, and to display the mapping relationship in response to the user's mapping viewing request.
[0107] In one embodiment, the data desensitization module 502 is further configured to segment the target data to obtain a first target field and a second target field; encrypt and desensitize the first target field to generate and store a first mapping record in the target metadata database; and perform full field value replacement on the second target field according to a preset mapping rule table to obtain the desensitized second target field, and generate and store a second mapping record in the target metadata database.
[0108] In one embodiment, the data desensitization module 502 is further configured to encrypt and desensitize the first target field according to a preset encryption and desensitization strategy and generate a corresponding key, and to encrypt and store the encrypted and desensitized first target field based on the key; and to synchronously encrypt and desensitize the log entries corresponding to the first target field in the log system according to the encryption and desensitization strategy.
[0109] In one embodiment, the information acquisition module 503 is further configured to perform a first permission verification on the user based on the access request, and if the first permission verification is successful, call the key and mapping rule table; and use the key and mapping rule table to extract the original data and the mapping record set from the target metadata database.
[0110] In one embodiment, the data transfer module 501 is further configured to: if the user's data transfer instruction indicates a full transfer, determine all data contained in the previous metadata database as the data to be transferred; if the data transfer instruction indicates a partial transfer, identify the filtering conditions contained in the data transfer instruction, and filter the data in the previous metadata database according to the filtering conditions to obtain the data to be transferred.
[0111] In one embodiment, the mapping display module 504 is used to determine the storage method of the original data based on the mapping record set, and generate a de-identification identifier corresponding to the original data based on the storage method; generate a mapping relationship between the de-identified data and the original data based on the mapping record set and the de-identification identifier; perform a second permission verification on the user according to the mapping viewing request, and display the mapping relationship if the second permission verification is successful.
[0112] Each module in the aforementioned metadata database processing and application device based on static data anonymization can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.
[0113] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 6 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a method for processing and applying a metadata database based on static desensitization. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.
[0114] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0115] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.
[0116] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.
[0117] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.
[0118] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0119] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.
[0120] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0121] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A method for processing and applying metadata databases based on static data anonymization, characterized in that, The method includes: Determine the data to be transferred from the current metadata database in the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database. If the new metadata database passes verification, the target data in the new metadata database is segmented to obtain a first target field and a second target field. According to a preset encryption and desensitization strategy, the first target field is encrypted and desensitized, and a corresponding key is generated. The encrypted and desensitized first target field is then encrypted and stored based on the key. According to the encryption and desensitization strategy, the log entries corresponding to the first target field in the log system are synchronously encrypted and desensitized, and a first mapping record is generated and stored in the target metadata database. According to a preset mapping rule table, the second target field undergoes full field value replacement to obtain a desensitized second target field. A second mapping record is generated and stored in the target metadata database, resulting in a target metadata database containing desensitized data. In response to a user's access request, the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data are obtained from the target metadata database. Based on the mapping record set, the mapping relationship between the de-identified data and the original data is obtained, and the mapping relationship is displayed in response to the user's mapping viewing request.
2. The method according to claim 1, characterized in that, The step of obtaining the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database includes: Based on the access request, the user is subjected to a first permission verification. If the first permission verification is successful, the key and the mapping rule table are invoked. Using the key and the mapping rule table, the original data and the mapping record set are extracted from the target metadata database.
3. The method according to claim 1, characterized in that, The process of determining the data to be transferred from the current metadata database in the backup system includes: If the user's data transfer instruction indicates a full transfer, then all data contained in the previous metadata database will be identified as the data to be transferred. If the data transfer instruction indicates partial transfer, the filtering conditions contained in the data transfer instruction are identified, and the data in the previous metadata database is filtered according to the filtering conditions to obtain the data to be transferred.
4. The method according to any one of claims 1 to 3, characterized in that, The step of obtaining the mapping relationship between the de-identified data and the original data based on the mapping record set includes: Based on the mapping record set, determine the storage method of the original data, and generate a de-identification identifier corresponding to the original data based on the storage method; Based on the mapping record set and the de-identification identifier, the mapping relationship between the de-identified data and the original data is generated; The step of responding to the user's mapping viewing request and displaying the mapping relationship includes: Based on the mapping viewing request, the user undergoes a second permission verification. If the second permission verification is successful, the mapping relationship is displayed.
5. A metadata database processing and application device based on static data anonymization, characterized in that, The device includes: The data transfer module is used to determine the data to be transferred in the current metadata database of the backup system, generate a new metadata database based on the data to be transferred, and verify the new metadata database. The data anonymization module is used to, upon successful verification of the new metadata database, segment the target data in the new metadata database to obtain a first target field and a second target field; according to a preset encryption anonymization strategy, encrypt and anonymize the first target field and generate a corresponding key, and encrypt and store the encrypted and anonymized first target field based on the key; according to the encryption anonymization strategy, synchronously encrypt and anonymize the log entries corresponding to the first target field in the log system, generate and store a first mapping record in the target metadata database; and perform full field value replacement on the second target field according to a preset mapping rule table to obtain the anonymized second target field, generate and store a second mapping record in the target metadata database, thus obtaining a target metadata database containing anonymized data. The information acquisition module is used to, in response to a user's access request, acquire the original data corresponding to the target data and the set of mapping records between the original data and the de-identified data from the target metadata database. The mapping display module is used to obtain the mapping relationship between the de-identified data and the original data based on the mapping record set, and to display the mapping relationship in response to the user's mapping viewing request.
6. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 4.
7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.
8. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Data access method, device and system
CN113535754A
Sensitive information desensitization processing method and device, computer equipment and storage medium
CN117094030A