Data desensitization method and device, electronic equipment and computer readable storage medium

By decoupling, modifying, and recoupling database components from the data to be anonymized, the problem of low data anonymization processing efficiency is solved, processing speed is improved, and the impact on the database is reduced.

CN114780998BActive Publication Date: 2026-01-30INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210501135.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-09
Publication Date
2026-01-30
Estimated Expiration
2042-05-09

AI Technical Summary

Technical Problem

Existing technologies cannot effectively guarantee the efficiency of data anonymization processing, resulting in a significant impact on the database.

Method used

By decoupling the data to be de-identified from the database and the associated database components, the thread scheduling module generates instructions to close triggers and delete index files, followed by modified de-identification processing, and then re-coupling the triggers and rebuilding the index files after the de-identification is completed.

Benefits of technology

It improves the efficiency of data anonymization, reduces the impact on the database, and speeds up the processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114780998B_ABST
    Figure CN114780998B_ABST
Patent Text Reader

Abstract

This disclosure provides a data anonymization method, apparatus, electronic device, and computer-readable storage medium, which can be applied to the fields of data processing technology and finance. The data anonymization method includes: identifying data to be anonymized in a database and database components associated with the data to be anonymized; decoupling the database components from the data to be anonymized to obtain decoupled data to be anonymized; performing modified anonymization on the decoupled data to obtain anonymized data; and coupling the anonymized data and the database components to complete the data anonymization.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing and the field of finance, and more particularly, to a data desensitization method and device, electronic equipment, computer readable storage medium and computer program product. BACKGROUND

[0002] With the development of computer technology, data processing technology has also developed. Various behaviors of people in daily life will produce massive data, and how to protect the safety of sensitive information in massive data is a problem to be solved.

[0003] Data desensitization refers to the technology of protecting sensitive information by using data desensitization strategies to deform data in some sensitive information in the data.

[0004] In the process of implementing the present disclosure, the inventors found that the related art at least has the following problems: the efficiency of data desensitization processing cannot be guaranteed. SUMMARY

[0005] Therefore, the present disclosure provides a data desensitization method and device, electronic equipment, computer readable storage medium and computer program product.

[0006] According to one aspect of the present disclosure, a data desensitization method is provided, comprising:

[0007] determining desensitization data in a database and a database component associated with the desensitization data;

[0008] decoupling the database component and the desensitization data to obtain decoupled desensitization data;

[0009] deforming and desensitizing the decoupled desensitization data to obtain desensitization data; and

[0010] coupling the desensitization data and the database component to complete data desensitization.

[0011] According to an embodiment of the present disclosure, the database component includes an index file;

[0012] The decoupling of the database component and the desensitization data includes:

[0013] sending a deletion instruction to the index deletion module using a thread scheduling module, wherein the deletion instruction includes deformation information, and the deletion instruction is generated by the thread scheduling module in response to receiving the deformation information; and

[0014] deleting, using the index deletion module, the index file related to the deformation information in the database to obtain the decoupled desensitization data.

[0015] According to an embodiment of the present disclosure, the database component further comprises a trigger;

[0016] Before obtaining the decoupled data to be desensitized, the decoupling of the database component from the data to be desensitized further comprises:

[0017] The thread scheduling module sends a closing instruction to the trigger closing module, wherein the closing instruction comprises the transformation information; and

[0018] The trigger closing module closes the trigger based on the transformation information in the closing instruction.

[0019] According to an embodiment of the present disclosure, the transformation desensitization of the decoupled data to obtain the desensitized data comprises:

[0020] The thread scheduling module sends a desensitization instruction to the transformation desensitization module, wherein the desensitization instruction comprises a secret key, the desensitization instruction is generated by the thread scheduling module in response to receiving an index deletion instruction and a trigger closing instruction, the index deletion instruction is sent by the index deletion module, and the trigger closing instruction is sent by the trigger closing module;

[0021] The transformation desensitization module performs a transformation operation on the secret key to determine a shift number; and

[0022] The transformation desensitization module performs a shift transformation desensitization on the decoupled data based on the shift number to obtain the desensitized data.

[0023] According to an embodiment of the present disclosure, the coupling of the desensitized data and the database component to complete data desensitization comprises:

[0024] The thread scheduling module sends a trigger opening instruction to the trigger opening module, wherein the trigger opening instruction is generated by the thread scheduling module in response to receiving a desensitization instruction, and the desensitization instruction is sent by the transformation desensitization module; and

[0025] The trigger opening module opens the closed trigger to obtain a re-opened trigger, and completes the coupling between the re-opened trigger in the database component and the desensitized data.

[0026] According to an embodiment of the present disclosure, before the data desensitization is completed, the coupling of the desensitized data and the database component further comprises:

[0027] The thread scheduling module sends a reconstruction instruction to the index reconstruction module, wherein the reconstruction instruction includes a record text, the reconstruction instruction is generated by the thread scheduling module in response to receiving a desensitization instruction, the desensitization instruction is sent by the deformation desensitization module, and the record text is generated based on the deleted index file;

[0028] The index reconstruction module reconstructs the index file based on the record text to obtain a reconstructed index file; and

[0029] The reconstructed index file is compiled to complete coupling between the reconstructed index file and the desensitized data in the database component.

[0030] According to an embodiment of the present disclosure, the closed trigger is opened by the trigger opening module to obtain a reopened trigger, and the reopened trigger further includes:

[0031] The reopened trigger is compiled.

[0032] According to another aspect of the present disclosure, a data desensitization apparatus is provided, comprising:

[0033] A determination module is configured to determine to-be-desensitized data in a database and a database component associated with the to-be-desensitized data;

[0034] A decoupling module is configured to decouple the database component and the to-be-desensitized data to obtain decoupled to-be-desensitized data;

[0035] A desensitization module is configured to deform and desensitize the decoupled to-be-desensitized data to obtain desensitized data;

[0036] A coupling module is configured to couple the desensitized data and the database component to complete data desensitization.

[0037] According to another aspect of the present disclosure, an electronic device is provided, comprising:

[0038] One or more processors;

[0039] A memory is configured to store one or more instructions,

[0040] When the one or more instructions are executed by the one or more processors, the one or more processors implement the method as described above.

[0041] According to another aspect of the present disclosure, a computer-readable storage medium is provided, which stores executable instructions, and the executable instructions are executed by a processor to make the processor implement the method as described above.

[0042] According to another aspect of the present disclosure, there is provided a computer program product comprising computer-executable instructions for implementing the method as described above when executed.

[0043] According to an embodiment of the present disclosure, by decoupling the data to be de- sensitized and the database component associated with the data to be de-sensitized, deforming the decoupled data to be de-sensitized, and coupling the obtained de-sensitized data and the database component, the data de-sensitization is completed. Since the data to be de-sensitized and the database component are decoupled before the data to be de-sensitized is de-sensitized, the constraint between the data to be de-sensitized and the database component is released; since the de-sensitized data and the database component are coupled after the data to be de-sensitized is de-sensitized, the constraint between the de-sensitized data and the database component is reconstructed. Through the above technical means, at least part of the technical problems that the efficiency of data de-sensitization processing cannot be guaranteed in the related art are overcome, and thus the impact of de-sensitization processing on the database is reduced, and the efficiency of de-sensitization processing is accelerated. BRIEF DESCRIPTION OF DRAWINGS

[0044] The above and other objects, features and advantages of the present disclosure will become more apparent from the following description when taken in conjunction with the accompanying drawings, in which:

[0045] Figure 1 A system architecture to which the data de-sensitization method according to an embodiment of the present disclosure can be applied is schematically shown;

[0046] Figure 2 A flowchart of the data de-sensitization method according to an embodiment of the present disclosure is schematically shown;

[0047] Figure 3 A schematic diagram of a data de-sensitization system according to an embodiment of the present disclosure is schematically shown;

[0048] Figure 4 A schematic diagram of a process of decoupling a database component and data to be de-sensitized according to an embodiment of the present disclosure is schematically shown;

[0049] Figure 5 A schematic diagram of a process of deforming the decoupled data to be de-sensitized to obtain de-sensitized data according to an embodiment of the present disclosure is schematically shown;

[0050] Figure 6 A schematic diagram of a process of coupling the de-sensitized data and the database component to complete the data de-sensitization process according to an embodiment of the present disclosure is schematically shown;

[0051] Figure 7 A block diagram of a data de-sensitization apparatus according to an embodiment of the present disclosure is schematically shown; and

[0052] Figure 8 A block diagram of an electronic device suitable for implementing a data de-identification method according to an embodiment of the disclosure is schematically shown. DETAILED DESCRIPTION

[0053] Hereinafter, embodiments of the disclosure will be described with reference to the accompanying drawings. It should be understood, however, that the description is merely exemplary and is not intended to limit the scope of the disclosure. In the following detailed description of the embodiments of the disclosure, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. However, it will be apparent to one skilled in the art that the embodiments can be practiced without these specific details. In other instances, well-known structures and techniques have been omitted in order to avoid obscuring the concepts of the disclosure.

[0054] The terms used herein are merely used to describe specific embodiments and are not intended to limit the disclosure. The terms "include", "comprise" and the like used herein indicate the presence of the described features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0055] All terms used herein, including technical and scientific terms, have meanings commonly understood by one of ordinary skill in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having meanings consistent with the context of the present specification, and should not be interpreted in an idealized or overly formal manner.

[0056] In the case of using expressions similar to "at least one of A, B, and C, etc.", it should generally be interpreted that the meaning of the expression is at least one of the items listed before the conjunction, and pluralities thereof (e.g., "a system having at least one of A, B, and C" should include but not be limited to a system having A alone, a system having B alone, a system having C alone, a system having both A and B, a system having both A and C, a system having both B and C, and / or a system having A, B, and C, etc.). In the case of using expressions similar to "at least one of A, B, or C, etc.", it should generally be interpreted that the meaning of the expression is at least one of the items listed before the conjunction, and pluralities thereof (e.g., "a system having at least one of A, B, or C" should include but not be limited to a system having A alone, a system having B alone, a system having C alone, a system having both A and B, a system having both A and C, a system having both B and C, and / or a system having A, B, and C, etc.).

[0057] In the technical solutions of the disclosure, the acquisition, storage, and application of user personal information comply with relevant laws and regulations, necessary security measures are taken, and the public order and good customs are not violated.

[0058] In the technical solutions of the disclosure, the authorization or consent of the user is obtained before the user's personal information is acquired or collected.

[0059] With the development of computer technology, data processing technology has also developed. Various behaviors of people in daily life will produce massive data, and how to protect the security of sensitive information in massive data is an urgent problem to be solved.

[0060] For example, in bank testing, production data needs to be restored regularly, and since production data cannot flow into the test environment, data desensitization needs to be performed. Data desensitization refers to a technology of protecting sensitive information by using a data desensitization strategy to deform data in certain sensitive information in the data.

[0061] In the process of implementing the present disclosure, the inventors have found that the related art has at least the following problem: the efficiency of data desensitization processing cannot be guaranteed.

[0062] To at least partially solve the technical problems in the related art, the present disclosure provides a data desensitization method and device, an electronic device, and a computer readable storage medium, which can be applied in the fields of data processing technology and finance. The data desensitization method comprises: determining desensitization data in a database and a database component associated with the desensitization data; decoupling the database component and the desensitization data to obtain decoupled desensitization data; deforming and desensitizing the decoupled desensitization data to obtain desensitization data; and coupling the desensitization data and the database component to complete data desensitization.

[0063] It should be noted that the data desensitization method and device provided by the embodiments of the present disclosure can be applied in the fields of data processing technology and finance, for example, in the bank testing for regularly restoring production data. The data desensitization method and device provided by the embodiments of the present disclosure can also be applied in any field other than the fields of data processing technology and finance, for example, in the operation and maintenance of operation and maintenance personnel. The application field of the data desensitization method and device provided by the embodiments of the present disclosure is not limited.

[0064] Figure 1 The system architecture to which the data desensitization method according to the embodiments of the present disclosure can be applied is schematically shown. It should be noted that, Figure 1 The system architecture shown is only an example of the system architecture to which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure cannot be applied to other devices, systems, environments or scenarios.

[0065] As Figure 1 shown, the system architecture 100 according to the embodiment can include terminal devices 101, 102, 103, a network 104, a server 105 and a database 106. The network 104 is used as a medium to provide a communication link between the terminal devices 101, 102, 103, the server 105 and the database 106. The network 104 can include various connection types, such as wired and / or wireless communication links, etc.

[0066] The user can use the terminal device 101, 102, 103 to interact with the server 105 and the database 106 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the terminal device 101, 102, 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, and / or social platform software, etc. (only as an example).

[0067] The terminal device 101, 102, 103 can be various electronic devices with a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, laptop computers, desktop computers, etc.

[0068] The server 105 can be a server providing various services, such as a background management server supporting the website browsed by the user using the terminal device 101, 102, 103 (only as an example). The background management server can analyze and process the received user request data, etc., and feed back the processing result (such as a webpage, information, or data, etc. obtained or generated according to the user request) to the terminal device.

[0069] The database 106 can be a relational database whose storage format can intuitively reflect the relationship between entities, such as Mysql, SqlServer, etc.

[0070] It should be noted that the data desensitization method provided by the embodiments of the present disclosure can be generally executed by the server 105. Correspondingly, the data desensitization apparatus provided by the embodiments of the present disclosure can be generally arranged in the server 105. The data desensitization method provided by the embodiments of the present disclosure can also be executed by a server or a server cluster different from the server 105 and capable of communicating with the terminal device 101, 102, 103 and / or the server 105. Correspondingly, the data desensitization apparatus provided by the embodiments of the present disclosure can also be arranged in a server or a server cluster different from the server 105 and capable of communicating with the terminal device 101, 102, 103 and / or the server 105. Alternatively, the data desensitization method provided by the embodiments of the present disclosure can also be executed by the terminal device 101, 102, or 103, or by other terminal devices different from the terminal device 101, 102, or 103. Correspondingly, the data desensitization apparatus provided by the embodiments of the present disclosure can also be arranged in the terminal device 101, 102, or 103, or in other terminal devices different from the terminal device 101, 102, or 103.

[0071] It should be understood that, Figure 1The number of terminal devices, networks, servers and databases in the figure is only illustrative. According to the implementation needs, there can be any number of terminal devices, networks, servers and databases.

[0072] Figure 2 A flowchart of a data desensitization method according to an embodiment of the present disclosure is schematically shown.

[0073] As shown in Figure 2 , the data desensitization method includes operations S210-S240.

[0074] In operation S210, the data to be desensitized in the database and the database component associated with the data to be desensitized are determined.

[0075] In operation S220, the database component is decoupled from the data to be desensitized, and the decoupled data to be desensitized is obtained.

[0076] In operation S230, the decoupled data to be desensitized is morphologically desensitized, and the desensitized data is obtained.

[0077] In operation S240, the desensitized data and the database component are coupled, and the data desensitization is completed.

[0078] According to an embodiment of the present disclosure, the database can include a database that can be accessed by a SQL (Structured Query Language) statement instruction, for example, Oracle, DB2, SQL Server, MySQL and data warehouse, etc. The data in the database can be stored in the form of a table, using a field name to represent the column of the table, and using a record number to represent the row of the table.

[0079] According to an embodiment of the present disclosure, the data to be desensitized can include sensitive information of some fields in the table stored by the database, and in the case of involving customer security data or business sensitive data, the data to be desensitized can be modified and provided for testing. For example, the data to be desensitized can include data corresponding to the fields of username, ID number, phone number, transaction amount, etc.

[0080] According to an embodiment of the present disclosure, the data to be desensitized and the database component associated with the data to be desensitized can be decoupled to obtain the decoupled data to be desensitized. The decoupled data to be desensitized can be morphologically desensitized to obtain the desensitized data. The morphological desensitization method can include at least one of the following: hash desensitization, masking desensitization, offset desensitization, replacement desensitization, transformation desensitization, encryption desensitization and randomization desensitization, etc.

[0081] According to an embodiment of the present disclosure, different data desensitization methods can be set for different tables, field names in the tables, and record numbers respectively. For example, taking the fields of "ID card number" and "phone number" in the table as examples, the data desensitization method of the field of "ID card number" in the table can be set as method A, and the data desensitization method of the field of "phone number" in the table can be set as method B. When the data of the fields of "ID card number" and "phone number" are read and transmitted to the user end, the data of the field of "ID card number" can be desensitized according to method A, and the data of the field of "phone number" can be desensitized according to method B.

[0082] According to an embodiment of the present disclosure, the database can include a production database, a transformation database, and a test database. The to-be-desensitized data and the database component associated with the to-be-desensitized data can be determined in the production database, the database component is decoupled from the to-be-desensitized data, and the decoupled to-be-desensitized data is obtained. The decoupled to-be-desensitized data is desensitized by transformation, and the desensitized data is obtained. The desensitized data and the database component are coupled to complete data desensitization in the production database.

[0083] According to an embodiment of the present disclosure, the to-be-desensitized data and the database component associated with the to-be-desensitized data can be determined in the production database, the database component is decoupled from the to-be-desensitized data, and the decoupled to-be-desensitized data is obtained and imported into the transformation database. The decoupled to-be-desensitized data is desensitized by transformation in the transformation database, and the desensitized data is obtained and imported into the test database. The desensitized data and the database component are coupled in the test database to complete data desensitization.

[0084] According to an embodiment of the present disclosure, the to-be-desensitized data and the database component associated with the to-be-desensitized data can be determined in the production database, the database component is decoupled from the to-be-desensitized data, and the decoupled to-be-desensitized data is obtained and imported into the transformation database. The decoupled to-be-desensitized data is desensitized by transformation in the transformation database, and the desensitized data is obtained and imported into the test database. The desensitized data and the database component are coupled in the test database to complete data desensitization. Based on the above processing process, the desensitized data in the test database after transformation desensitization is consistent with the to-be-desensitized data in the production database before transformation desensitization.

[0085] According to an embodiment of the present disclosure, by decoupling the to-be-de- sensitized data and the database component associated with the to-be-de-sensitized data, deforming and desensitizing the decoupled to-be-de-sensitized data, and coupling the obtained desensitized data and the database component, the data desensitization is completed. Since the to-be-de-sensitized data and the database component are decoupled before the to-be-de-sensitized data is desensitized, the constraint between the to-be-de-sensitized data and the database component is released. Since the desensitized data and the database component are coupled after the to-be-de-sensitized data is desensitized, the constraint between the desensitized data and the database component is reconstructed. Through the above technical means, at least part of the technical problems that the related art cannot guarantee the efficiency of data desensitization processing are overcome, thereby reducing the impact of desensitization processing on the database and accelerating the efficiency of desensitization processing.

[0086] The method shown in Figures 3-6 will be further described below with reference to specific embodiments. Figure 2

[0087] Figure 3 An illustrative diagram of a data desensitization system according to an embodiment of the present disclosure is shown.

[0088] As shown in Figure 3 , the data desensitization system 310 can include a thread scheduling part and a function part. The thread scheduling part can include a thread scheduling module 301. The function part can include an index obtaining module 302, a trigger closing module 303, an index deleting module 304, a deformation desensitization module 305, a trigger opening module 306, and an index reconstructing module 307. The thread scheduling module 301 can be used to call each module of the function part. Each module in the function part can communicate with the thread scheduling module 301 bidirectionally.

[0089] After the data desensitization system 310 is running, the index obtaining module 302 can be called by the thread scheduling module 301 to determine the to-be-de-sensitized data in the database and the database component associated with the to-be-de-sensitized data. The trigger closing module 303 and the index deleting module 304 can be called by the thread scheduling module 301 to decouple the database component and the to-be-de-sensitized data, and obtain the decoupled to-be-de-sensitized data. The deformation desensitization module 305 can be called by the thread scheduling module 301 to deform and desensitize the decoupled to-be-de-sensitized data, and obtain the desensitized data. The trigger opening module 306 and the index reconstructing module 307 can be called by the thread scheduling module 301 to couple the desensitized data and the database component, and complete the data desensitization.

[0090] ​The index obtaining module 2 can receive an index obtaining instruction from the thread scheduling module 301, read the first list name in the uploaded deformation table text, splice the index establishment statement according to the database view, and save it as an executable SQL file as an index file. For example, the index obtaining module 2 can use the select statement and the connection symbol to filter the information of the deformation table in the database index view with the where statement, splice the SQL statement of the alter syntax, and save the query result in the dual virtual table. The content of the virtual table is queried to generate the SQL text with the spool command. After the index obtaining module 2 determines the to-be-desensitized data in the database and the database components associated with the to-be-desensitized data, the index obtaining module 2 can send an index obtaining completion instruction to the thread scheduling module 301, so that the thread scheduling module 301 continues the subsequent calling operation.

[0091] Figure 4 A schematic diagram of a process of decoupling the database components from the to-be-desensitized data according to an embodiment of the present disclosure is shown.

[0092] According to an embodiment of the present disclosure, the database components include an index file and a trigger.

[0093] According to an embodiment of the present disclosure, the thread scheduling module sends a closing instruction to the trigger closing module, where the closing instruction includes deformation information. Based on the deformation information in the closing instruction, the trigger closing module closes the trigger.

[0094] According to an embodiment of the present disclosure, the thread scheduling module sends a deletion instruction to the index deleting module, where the deletion instruction includes deformation information, and the deletion instruction is generated by the thread scheduling module in response to receiving the deformation information. The index deleting module deletes the index file related to the deformation information in the database, and obtains the decoupled to-be-desensitized data.

[0095] As shown in Figure 4 Operation S401 to operation S410 schematically show a schematic diagram of a process of decoupling the database components from the to-be-desensitized data.

[0096] In operation S401, the thread scheduling module can receive deformation information.

[0097] In operation S402, the thread scheduling module can generate a closing instruction and a deletion instruction according to the received deformation information.

[0098] In operation S403, the thread scheduling module can send the closing instruction to the trigger closing module.

[0099] In operation S404, the trigger closing module can obtain the deformation information in the closing instruction.

[0100] At operation S405, the trigger closing module can close the trigger based on the deformation information in the closing instruction.

[0101] At operation S406, the trigger closing module can send a trigger closing completion instruction to the thread scheduling module.

[0102] At operation S407, the thread scheduling module can send a deletion instruction to the index deletion module.

[0103] At operation S408, the index deletion module can obtain the deformation information in the deletion instruction.

[0104] At operation S409, the index deletion module can delete the index file related to the deformation information in the database, to obtain the decoupled data to be desensitized.

[0105] At operation S410, the index deletion module can send an index deletion completion instruction to the thread scheduling module. According to an embodiment of the present disclosure, the trigger closing module can receive the closing instruction from the thread scheduling module, obtain the deformation information in the closing instruction, and close the trigger based on the obtained deformation information. For example, the trigger closing module can read the first list name in the uploaded deformation table text, splice a DDL (Data Definition Language) statement, so as to execute the operation of closing the trigger in the database.

[0106] According to an embodiment of the present disclosure, the index deletion module can receive the deletion instruction from the thread scheduling module, obtain the deformation information in the deletion instruction, and delete the index file related to the deformation information based on the obtained deformation information. For example, the index deletion module can delete the index on the deformation table.

[0107] According to an embodiment of the present disclosure, the trigger closing module closes the trigger in the database component based on the deformation information in the closing instruction, and the index deletion module deletes the index file related to the deformation information in the database component based on the deformation information in the deletion instruction. Since the decoupling of the data to be desensitized and the database component is completed by closing the trigger and deleting the index file before desensitizing the data to be desensitized, the constraint between the data to be desensitized and the database component is deleted, and the speed of desensitization processing is accelerated.

[0108] Figure 5 An illustrative diagram of a process of performing deformation desensitization on decoupled data to obtain desensitized data is shown according to an embodiment of the present disclosure.

[0109] According to an embodiment of the present disclosure, the thread scheduling module sends a desensitization instruction to the deformation desensitization module, wherein the desensitization instruction includes a secret key, the desensitization instruction is generated by the thread scheduling module in response to receiving an index deletion instruction and a trigger closing instruction, the index deletion instruction is sent by the index deletion module, and the trigger closing instruction is sent by the trigger closing module. The deformation desensitization module performs a deformation operation on the secret key to determine a number of shift positions. The deformation desensitization module performs a deformation desensitization process of shifting the decoupled data based on the number of shift positions to obtain desensitized data.

[0110] As shown in Figure 5 Operations S501-S506 schematically show a schematic diagram of a process of performing deformation desensitization on decoupled data to obtain desensitized data.

[0111] In operation S501, the thread scheduling module can receive an index deletion completion instruction and a trigger closing completion instruction.

[0112] In operation S502, the thread scheduling module can generate a desensitization instruction.

[0113] In operation S503, the thread scheduling module can send the desensitization instruction to the deformation desensitization module.

[0114] In operation S504, the deformation desensitization module can perform a deformation operation on the secret key in the desensitization instruction to determine a number of shift positions.

[0115] In operation S505, the deformation desensitization module can perform a deformation desensitization process of shifting the decoupled data based on the number of shift positions to obtain desensitized data.

[0116] In operation S506, the deformation desensitization module can send a deformation desensitization completion instruction to the thread scheduling module.

[0117] According to an embodiment of the present disclosure, the transformation desensitization module can receive the desensitization instruction from the thread scheduling module, obtain the secret key in the desensitization instruction, and perform a transformation operation on the secret key to determine a shift number, so as to perform a transformation desensitization process on the decoupled data based on the shift number to obtain desensitized data. For example, the transformation desensitization module can read the first column name and the second column field name in the uploaded secret key text and the transformation table text. The secret key text may, for example, be 19 digits. The characters can be shifted in the ASCII (American Standard Code for Information Interchange) domain, and the shift number is obtained by performing an operation on the secret key. The secret key can be first loaded, then the outer layer is cycled according to the table, and the inner layer is cycled according to the field of the table. The field is subjected to a transformation operation, and the changed field is rewritten by row lock.

[0118] According to an embodiment of the present disclosure, the transformation desensitization module performs a transformation operation on the secret key in the desensitization instruction, and shifts the decoupled data based on the obtained shift number to obtain desensitized data. Through the above technical means, the data can be desensitized without constraints, thereby improving the efficiency of data desensitization processing.

[0119] Figure 6 An illustrative diagram of coupling desensitized data and database components to complete a data desensitization process according to an embodiment of the present disclosure is shown.

[0120] According to an embodiment of the present disclosure, the thread scheduling module sends a trigger opening instruction to the trigger opening module, wherein the trigger opening instruction is generated by the thread scheduling module in response to receiving the desensitization instruction, and the desensitization instruction is sent by the transformation desensitization module. The trigger opening module opens the closed trigger to obtain a re-opened trigger, and completes the coupling between the re-opened trigger in the database component and the desensitized data.

[0121] According to an embodiment of the present disclosure, the trigger opening module opens the closed trigger to obtain a re-opened trigger can further include the following operations.

[0122] The re-opened trigger is compiled. According to an embodiment of the present disclosure, the thread scheduling module sends a reconstruction instruction to the index reconstruction module, wherein the reconstruction instruction comprises a record text, the reconstruction instruction is generated by the thread scheduling module in response to receiving the desensitization instruction, the desensitization instruction is sent by the deformation desensitization module, and the record text is generated based on the deleted index file. Based on the record text, the index reconstruction module reconstructs the index file to obtain a reconstructed index file. The reconstructed index file is compiled to complete the coupling between the reconstructed index file and the desensitized data in the database component.

[0123] As shown in FIG. 6, operations S601-S611 schematically show a diagram of coupling the desensitized data and the database component to complete the data desensitization process. Figure 6

[0124] In operation S601, the thread scheduling module can receive a deformation desensitization completion instruction.

[0125] In operation S602, the thread scheduling module can generate a trigger opening instruction.

[0126] In operation S603, the thread scheduling module can send the trigger opening instruction to the trigger opening module.

[0127] In operation S604, the trigger opening module can open the closed trigger to obtain a re-opened trigger, and complete the coupling between the re-opened trigger and the desensitized data in the database component.

[0128] In operation S605, the trigger opening module can send a trigger opening completion instruction to the thread scheduling module.

[0129] In operation S606, the thread scheduling module can generate a reconstruction instruction.

[0130] In operation S607, the thread scheduling module can send the reconstruction instruction to the index reconstruction module.

[0131] In operation S608, the index reconstruction module can obtain the record text in the reconstruction instruction.

[0132] In operation S609, the index reconstruction module can reconstruct the index file based on the record text to obtain a reconstructed index file.

[0133] In operation S610, the index reconstruction module can compile the reconstructed index file to complete the coupling between the reconstructed index file and the desensitized data in the database component.

[0134] In operation S611, the index reconstruction module can send an index reconstruction completion instruction to the thread scheduling module. ​

[0135] According to an embodiment of the present disclosure, the trigger opening module can receive a trigger opening instruction from the thread scheduling module, and open a closed trigger based on the trigger opening instruction to obtain a re-opened trigger. The trigger opening module can also compile the re-opened trigger to complete coupling between the re-opened trigger and the de-identified data in the database component.

[0136] According to an embodiment of the present disclosure, the index rebuilding module can execute the SQL index file of the index obtaining module to create a new index on a table without constraints. The index rebuilding module can receive a rebuilding instruction from the thread scheduling module, obtain a record text in the rebuilding instruction, rebuild the index file based on the record text, and compile the index file to update information in the database, thereby avoiding invalidation of database object calls due to changes in triggers and indexes.

[0137] According to an embodiment of the present disclosure, the trigger opening module opens a trigger based on an opening instruction, and the index rebuilding module rebuilds an index file based on a rebuilding instruction. After de-identifying the data to be de-identified, the opening of the closed trigger and the rebuilding of the index file, and the compilation of the index file, complete the coupling between the data to be de-identified and the trigger and the rebuilt index file in the database component, thereby ensuring the availability of other objects that reference constraints and improving the efficiency of de-identification processing.

[0138] It should be noted that the serial numbers of the operations in the above method are only used to represent the operations for description, and should not be regarded as representing the execution sequence of the operations. Unless explicitly stated, the method does not need to be executed in the order shown.

[0139] Figure 7 A block diagram of a data de-identification apparatus according to an embodiment of the present disclosure is schematically shown.

[0140] As shown in Figure 7 , the data de-identification apparatus 700 can include a determination module 701, a decoupling module 702, a de-identification module 703, and a coupling module 704.

[0141] The determination module 701 is configured to determine data to be de-identified in a database and a database component associated with the data to be de-identified.

[0142] The decoupling module 702 is configured to decouple the database component from the data to be de-identified to obtain de-coupled data to be de-identified.

[0143] The de-identification module 703 is configured to perform morphological de-identification on the de-coupled data to be de-identified to obtain de-identified data.

[0144] The coupling module 704 is configured to couple the de-identified data and the database component to complete data de-identification.

[0145] According to an embodiment of the present disclosure, the database component comprises an index file.

[0146] According to an embodiment of the present disclosure, the decoupling module 702 can comprise a first sending unit and a deleting unit.

[0147] The first sending unit is configured to send a deleting instruction to the index deleting module by using the thread scheduling module, wherein the deleting instruction comprises the deformation information, and the deleting instruction is generated by the thread scheduling module in response to receiving the deformation information.

[0148] The deleting unit is configured to delete, by using the index deleting module, the index file related to the deformation information in the database, to obtain the decoupled data to be desensitized.

[0149] According to an embodiment of the present disclosure, the database component further comprises a trigger.

[0150] According to an embodiment of the present disclosure, the decoupling module 702 can further comprise a second sending unit and a closing unit.

[0151] The second sending unit is configured to send a closing instruction to the trigger closing module by using the thread scheduling module, wherein the closing instruction comprises the deformation information.

[0152] The closing unit is configured to close the trigger by using the trigger closing module based on the deformation information in the closing instruction.

[0153] According to an embodiment of the present disclosure, the desensitizing module 703 can comprise a third sending unit, an operation unit and a first processing unit.

[0154] The third sending unit is configured to send a desensitizing instruction to the deformation desensitizing module by using the thread scheduling module, wherein the desensitizing instruction comprises a secret key, and the desensitizing instruction is generated by the thread scheduling module in response to receiving an index deleting instruction and a trigger closing instruction, the index deleting instruction is sent by the index deleting module, and the trigger closing instruction is sent by the trigger closing module.

[0155] The operation unit is configured to perform deformation operation on the secret key by using the deformation desensitizing module, to determine a shift number.

[0156] The first processing unit is configured to perform shift deformation desensitizing processing on the decoupled data based on the shift number by using the deformation desensitizing module, to obtain the desensitized data.

[0157] According to an embodiment of the present disclosure, the coupling module 704 can comprise a fourth sending unit and an opening unit.

[0158] The fourth sending unit is configured to send a trigger opening instruction to the trigger opening module by using the thread scheduling module, wherein the trigger opening instruction is generated by the thread scheduling module in response to receiving the desensitization instruction, and the desensitization instruction is sent by the deformation desensitization module.

[0159] The opening unit is configured to open the closed trigger by using the trigger opening module to obtain a re-opened trigger, and complete coupling between the re-opened trigger and the desensitized data in the database component.

[0160] According to an embodiment of the present disclosure, the coupling module 704 can further include a fifth sending unit, a reconstruction unit and a second processing unit.

[0161] The fifth sending unit is configured to send a reconstruction instruction to the index reconstruction module by using the thread scheduling module, wherein the reconstruction instruction includes a record text, the reconstruction instruction is generated by the thread scheduling module in response to receiving the desensitization instruction, the desensitization instruction is sent by the deformation desensitization module, and the record text is generated based on the deleted index file.

[0162] The reconstruction unit is configured to reconstruct the index file by using the index reconstruction module based on the record text to obtain a reconstructed index file.

[0163] The second processing unit is configured to perform compilation processing on the reconstructed index file to complete coupling between the reconstructed index file and the desensitized data in the database component.

[0164] According to an embodiment of the present disclosure, the opening unit further includes a compilation subunit.

[0165] The compilation subunit is configured to perform compilation processing on the re-opened trigger.

[0166] Any of the modules, sub-modules, units, sub-units, or at least part of any of them according to the embodiments of the present disclosure can be implemented in one module. Any of the modules, sub-modules, units, sub-units according to the embodiments of the present disclosure can be split into multiple modules for implementation. Any of the modules, sub-modules, units, sub-units according to the embodiments of the present disclosure can be implemented at least in part as a hardware circuit, for example, a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on board, a system on package, an application specific integrated circuit (ASIC), or any other reasonable way of hardware or firmware by integrating or packaging circuits, or in any one of software, hardware, and firmware, or in a proper combination of any of them. Alternatively, any of the modules, sub-modules, units, sub-units according to the embodiments of the present disclosure can be implemented at least in part as computer program modules, which can perform corresponding functions when running.

[0167] For example, any of the determining module 701, the decoupling module 702, the desensitizing module 703, and the coupling module 704 can be combined in one module / unit / sub-unit for implementation, or any of them can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of the modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to the embodiments of the present disclosure, at least one of the determining module 701, the decoupling module 702, the desensitizing module 703, and the coupling module 704 can be implemented at least in part as a hardware circuit, for example, a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on board, a system on package, an application specific integrated circuit (ASIC), or any other reasonable way of hardware or firmware by integrating or packaging circuits, or in any one of software, hardware, and firmware, or in a proper combination of any of them. Alternatively, at least one of the determining module 701, the decoupling module 702, the desensitizing module 703, and the coupling module 704 can be implemented at least in part as computer program modules, which can perform corresponding functions when running.

[0168] It should be noted that the data desensitization device part in the embodiments of the present disclosure corresponds to the data desensitization method part in the embodiments of the present disclosure, and the description of the data desensitization device part is specifically referred to the data desensitization method part, which will not be repeated here.

[0169] Figure 8A block diagram of an electronic device suitable for implementing a data de-sensitization method according to an embodiment of the present disclosure is shown schematically. Figure 8 The electronic device shown is merely an example and should not bring any limitation to the functions and usage range of embodiments of the present disclosure.

[0170] As Figure 8 shown, the computer electronic device 800 according to an embodiment of the present disclosure includes a processor 801 which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage section 809 into a random access memory (RAM) 803. The processor 801 can include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor, and / or a related chipset, and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 801 can also include an on-board memory for cache use. The processor 801 can include a single processing unit or multiple processing units for performing different actions of a method flow according to an embodiment of the present disclosure.

[0171] In the RAM 803, various programs and data required for the operation of the electronic device 800 are stored. The processor 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. The processor 801 performs various operations of a method flow according to an embodiment of the present disclosure by executing a program in the ROM 802 and / or the RAM 803. Note that the program can also be stored in one or more memories other than the ROM 802 and the RAM 803. The processor 801 can also perform various operations of a method flow according to an embodiment of the present disclosure by executing a program stored in the one or more memories.

[0172] According to an embodiment of the present disclosure, the electronic device 800 can also include an input / output (I / O) interface 805 which is also connected to the bus 804. The electronic device 800 can also include one or more of the following components connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as necessary. A removable recording medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is attached to the drive 810 as necessary, so that a computer program read therefrom is installed into the storage section 808 as necessary.

[0173] According to an embodiment of the present disclosure, the method flow according to the embodiments of the present disclosure can be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product comprising a computer program carrying out the program codes for executing the method shown in the flow chart. In such embodiments, the computer program can be downloaded and installed from a network through the communication part 809, and / or installed from the detachable medium 811. When the computer program is executed by the processor 801, the above-mentioned functions defined in the system, device, apparatus, module, unit, etc. of the embodiments of the present disclosure are executed. According to an embodiment of the present disclosure, the system, device, apparatus, module, unit, etc. described above can be implemented by computer program modules.

[0174] The present disclosure also provides a computer readable storage medium, which can be included in the device / apparatus / system described in the above embodiments, or exist separately without being assembled into the device / apparatus / system. The above computer readable storage medium carries one or more programs, which when executed, implement the method according to the embodiments of the present disclosure.

[0175] According to an embodiment of the present disclosure, the computer readable storage medium can be a non-volatile computer readable storage medium. For example, it can include but not limited to portable computer diskette, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any appropriate combination thereof. In the present disclosure, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus or device.

[0176] For example, according to an embodiment of the present disclosure, the computer readable storage medium can include the ROM 802 and / or the RAM 803 described above and / or one or more memories other than the ROM 802 and the RAM 803.

[0177] The embodiments of the present disclosure also include a computer program product comprising a computer program containing program codes for executing the method provided by the embodiments of the present disclosure, which are used to make the electronic device implement the data de-sensitization method provided by the embodiments of the present disclosure when the computer program product is running on the electronic device.

[0178] When the computer program is executed by the processor 801, the above-mentioned functions defined in the system / apparatus of the embodiments of the present disclosure are executed. According to an embodiment of the present disclosure, the system, device, apparatus, module, unit, etc. described above can be implemented by computer program modules.

[0179] In one embodiment, the computer program can be tangibly embodied in a non-transitory computer readable medium, such as a tangible memory device, magnetic storage device, optical storage device, and / or the like. In another embodiment, the computer program can be tangibly embodied in a signal, such as a downloadable software code, encoded using a variety of transmission mediums, including, but not limited to, wireless, wireline, optical, and / or the like, or any suitable combination of the foregoing. In one embodiment, the computer program can be transmitted in a signal, using a transmission medium, including, but not limited to, wireless, wireline, optical, and / or the like, or any suitable combination of the foregoing. The computer program embodied in the signal can be downloaded and installed by the communication portion 809 and / or installed from the removable media 811. The program code embodied in the computer program can be transmitted in any suitable format, including, but not limited to, radio frequency (RF), frequency modulation (FM), and / or the like, or any suitable combination of the foregoing.

[0180] According to an embodiment of the present disclosure, program code of a computer program for performing the methods provided by the embodiments of the present disclosure can be written in any combination of one or more programming languages, including a high-level procedural and / or object-oriented programming language, and / or an assembly / machine language. Program code can execute entirely on the user's computing device, partly on the user's computing device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server. In the latter scenario, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing device, such as through the Internet using an Internet Service Provider (ISP). In some embodiments, the electronic device includes a computer system.

[0181] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions. Those skilled in the art will understand that the features recited in the various embodiments and / or claims of this disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not expressly described in this disclosure. In particular, the features described in the various embodiments and / or claims of this disclosure may be combined and / or combined in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0182] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. The scope of this disclosure is defined by the appended claims and their equivalents. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.

Claims

1. A data de-sensitization method, comprising: determining to-be-de-sensitized data in a database and a database component associated with the to-be-de-sensitized data; decoupling the database component from the to-be-de-sensitized data to obtain decoupled to-be-de-sensitized data; deforming and de-sensitizing the decoupled to-be-de-sensitized data to obtain de-sensitized data; and coupling the de-sensitized data and the database component to complete data de-sensitization; wherein the database component comprises an index file and a trigger; the decoupling the database component from the to-be-de-sensitized data to obtain decoupled to-be-de-sensitized data comprises: sending a closing instruction to a trigger closing module by using a thread scheduling module, wherein the closing instruction comprises deformation information, and the closing instruction is generated by the thread scheduling module based on the deformation information; closing the trigger by the trigger closing module based on the deformation information in the closing instruction; sending a deletion instruction to an index deletion module by using the thread scheduling module, wherein the deletion instruction comprises the deformation information, and the deletion instruction is generated by the thread scheduling module in response to receiving the deformation information; and deleting, by the index deletion module, the index file in the database related to the deformation information to obtain the decoupled to-be-de-sensitized data. the deforming and de-sensitizing the decoupled data to obtain de-sensitized data comprises:

2. The method of claim 1, wherein, sending a de-sensitization instruction to a de-sensitization module by using the thread scheduling module, wherein the de-sensitization instruction comprises a secret key, and the de-sensitization instruction is generated by the thread scheduling module in response to receiving an index deletion instruction and a trigger closing instruction, the index deletion instruction is sent by the index deletion module, and the trigger closing instruction is sent by the trigger closing module; determining a shift number by performing a deformation operation on the secret key by the de-sensitization module; and performing a shift deformation de-sensitization processing on the decoupled data based on the shift number by the de-sensitization module to obtain the de-sensitized data. the coupling the de-sensitized data and the database component to complete data de-sensitization comprises:

3. The method of claim 2, wherein, sending a trigger opening instruction to a trigger opening module by using the thread scheduling module, wherein the trigger opening instruction is generated by the thread scheduling module in response to receiving a de-sensitization instruction, and the de-sensitization instruction is sent by the de-sensitization module; and opening the closed trigger by the trigger opening module to obtain a re-opened trigger and completing the coupling between the re-opened trigger in the database component and the de-sensitized data. before the completing data de-sensitization, the coupling the de-sensitized data and the database component further comprises:

4. The method of claim 2, wherein, sending a reconstruction instruction to a index reconstruction module by using the thread scheduling module, wherein the reconstruction instruction comprises a record text, the reconstruction instruction is generated by the thread scheduling module in response to receiving a de-sensitization instruction, the de-sensitization instruction is sent by the de-sensitization module, and the record text is generated based on the deleted index file; ​ reconstructing, based on the recorded text, an index file by using the index reconstruction module to obtain a reconstructed index file; and performing compilation processing on the reconstructed index file to complete coupling between the reconstructed index file and the desensitized data in the database component.

5. The method of claim 3, wherein, The opening, by the trigger opening module, of the closed trigger to obtain a re-opened trigger further includes: performing compilation processing on the re-opened trigger.

6. A data desensitization apparatus, comprising: a determination module configured to determine to-be-desensitized data in a database and a database component associated with the to-be-desensitized data; a decoupling module configured to decouple the database component from the to-be-desensitized data to obtain decoupled to-be-desensitized data; a desensitization module configured to perform morphological desensitization on the decoupled to-be-desensitized data to obtain desensitized data; a coupling module configured to couple the desensitized data and the database component to complete data desensitization; wherein the database component comprises an index file and a trigger; the decoupling module comprises: a second sending unit configured to send a closing instruction to a trigger closing module by using a thread scheduling module, wherein the closing instruction comprises morphological information, and the closing instruction is generated by the thread scheduling module based on the morphological information; a closing unit configured to close the trigger by using the trigger closing module based on the morphological information in the closing instruction; a first sending unit configured to send a deletion instruction to an index deletion module by using the thread scheduling module, wherein the deletion instruction comprises the morphological information, and the deletion instruction is generated by the thread scheduling module in response to receiving the morphological information; and a deletion unit configured to delete, by using the index deletion module, an index file related to the morphological information in the database to obtain the decoupled to-be-desensitized data.

7. An electronic device, comprising: one or more processors; a memory configured to store one or more instructions, wherein when the one or more instructions are executed by the one or more processors, the one or more processors implement the method of any one of claims 1 to 5.

8. A computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to implement the method of any one of claims 1 to 5.

Citation Information

Patent Citations

  • Data desensitization method and device

    CN113569289A

  • Index reconstruction method and device, equipment and medium

    CN114253980A