Self-adaptive dynamic desensitization method based on proxy mode

Abstract

The invention discloses a self-adaptive dynamic desensitization method based on a proxy mode. The method comprises the following steps: inputting a structured data set into a sensitive attribute identification module, and dividing the structured data set into a sensitive attribute set and a non-sensitive attribute set; inputting the data in the sensitive attribute set into a matching desensitization module, and matching a corresponding desensitization algorithm for the data; through a data request, the request is forwarded to the database agent, and the database agent performs dynamic desensitization on the data to realize dynamic desensitization of the data. In order to solve the problem of low static desensitization efficiency, the invention provides a dynamic desensitization technology. According to the technology, desensitization processing can be immediately carried out when the data is generated or changed, especially when a large-scale data set is processed, the processing time can be remarkably shortened, occupation of computing resources is reduced, and meanwhile it is ensured that the data is always kept in the latest state.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an adaptive dynamic desensitization method based on a proxy mode. Background Art

[0002] Traditional desensitization technologies are mostly based on static desensitization mode, that is, a one-time desensitization process is performed after data collection is completed, and the processed data is stored. Although this approach is easy to implement, it is not only inefficient when faced with massive data, but also difficult to achieve continuous and effective privacy protection as data is constantly updated and grown. In particular, for dynamic data sets that need to be accessed frequently, static desensitization often cannot reflect the latest data status in a timely manner, thereby reducing the freshness and accuracy of the data.

[0003] In modern power grid systems, data liquidity and timeliness are very important, but existing desensitization technologies often have difficulty in achieving real-time or near-real-time data processing. When data needs to be transmitted quickly between different nodes, if the desensitization process takes too long, it will significantly increase system latency and may even cause data to expire and fail to support the normal operation of key business processes. Summary of the invention

[0004] In view of the above existing problems, the present invention is proposed.

[0005] Therefore, the present invention provides an adaptive dynamic desensitization method based on the proxy mode. Aiming at the problem of low efficiency of static desensitization, the present invention proposes a dynamic desensitization technology. This technology can implement desensitization processing immediately when data is generated or changed, especially when processing large-scale data sets, which can significantly shorten the processing time and reduce the occupation of computing resources, while ensuring that the data is always kept up to date.

[0006] In order to solve the above technical problems, the present invention provides the following technical solution, an adaptive dynamic desensitization method based on proxy mode, comprising:

[0007] Input the structured data set into the sensitive attribute identification module to divide it into a sensitive attribute set and a non-sensitive attribute set;

[0008] Input the data in the sensitive attribute set into the matching desensitization module to match the corresponding desensitization algorithm;

[0009] Through the data request, the request is forwarded to the database proxy, and the database proxy dynamically desensitizes the data to achieve dynamic desensitization of the data.

[0010] As a preferred solution of the adaptive dynamic desensitization method based on the proxy mode described in the present invention, the division into sensitive attribute sets and non-sensitive attribute sets includes calculating the sensitivity of each attribute through the hierarchical analysis method, and further identifying and analyzing the sensitive attributes through the K-means clustering algorithm, so as to obtain the sensitive attribute set and the non-sensitive attribute set.

[0011] As a preferred solution of the adaptive dynamic desensitization method based on the proxy mode described in the present invention, wherein: the division of the sensitive attribute set and the non-sensitive attribute set includes: inputting a structured data set S, the number of clusters k=2, outputting a sensitive attribute set SA, a non-sensitive attribute set NSA, for each attribute x in S i Calculate the judgment matrix A and weight w i , the sensitivity of the attribute SV = w i For SV={SV1,SV2,…,SV m For each data point in Where i = 1, 2, two particles are randomly selected {SV b ,SV p}, calculate the distance d between the data point and the mass point ij , determine the cluster label ω according to the nearest distance j =argmin i∈{1,...m} d ij , divide them into corresponding clusters For each cluster C i :

[0012] Recalculate the new mean vector

[0013] Update point {SV b ,SV p}, and repeat the calculation until the mass point no longer changes;

[0014] Mark the sensitive attribute set C1 = {SA1, SA2, ...}, the non-sensitive attribute set C2 = {NSA1, NSA2, ...}, and output C1 and C2.

[0015] As a preferred solution of the adaptive dynamic desensitization method based on proxy mode described in the present invention, wherein: the desensitization algorithm includes that the database proxy needs to complete the analysis of the database protocol, including the analysis of the data packet header and the payload, and complete the real-time data desensitization according to the configuration table. The database proxy is completely transparent to the user. When applied, the server is connected to the listening port of the database proxy.

[0016] As a preferred solution of the adaptive dynamic desensitization method based on the proxy mode described in the present invention, wherein: the matching desensitization module includes establishing a connection with the database end, for receiving a MySQL response message sent from the database end, and sending a MySQL request message to the database end;

[0017] Establish a connection with the browser server to receive MySQL request messages from the server and send MySQL response messages to the server;

[0018] Determine whether the current SQL statement involves tables and fields that need to be desensitized. If the query involves tables and fields that need to be desensitized, record the current interception time for use;

[0019] According to the interception time, the time record with the closest difference to this time is searched, and the corresponding session ID is searched from the session-timetable through the time. The corresponding user name is searched from the user-session table through the session ID, and the desensitization scheme required by the current user is obtained according to the desensitization configuration table formulated by the proxy through the user name, and the data in the result set is desensitized and returned to the browser server.

[0020] As a preferred solution of the adaptive dynamic desensitization method based on the proxy mode described in the present invention, wherein: the matching desensitization module includes desensitizing the result set Result Set responded by the database server, and analyzing the data query result set message Result Set, wherein Row Data is the row data of the data table, and the Result Set message contains multiple RowData row data structures, wherein each row data Row Data contains multiple field values, and a row of data is composed of the field values.

[0021] As a preferred solution of the adaptive dynamic desensitization method based on the proxy mode described in the present invention, wherein: the matching desensitization module includes, when implementing dynamic data desensitization, it is necessary to parse the row data of the result set, and determine the length of the column data by the value of the first byte. If its value is 0x00, it represents empty data, if its value is 0xfb, it represents NULL, otherwise read data of corresponding length, use the corresponding desensitization algorithm to process the data, and replace the original data with the desensitized data and put it into Row Data.

[0022] As a preferred solution of the adaptive dynamic desensitization method based on proxy mode described in the present invention, the dynamic desensitization includes: when the database agent obtains the identity authority of the current query user, according to the above-mentioned desensitization strategy, obtaining the desensitization plan for the query data of the user, and implementing the data desensitization in the module, and assembling the desensitized data into a new result set message, which is forwarded to the browser server by the database agent.

[0023] A computer device includes a memory and a processor, wherein the memory stores a computer program, and is characterized in that when the processor executes the computer program, it implements the steps of an adaptive dynamic desensitization method based on a proxy mode.

[0024] A computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, the steps of an adaptive dynamic desensitization method based on a proxy mode are implemented.

[0025] Beneficial effects of the present invention:

[0026] The dynamic perception module of the present invention realizes dynamic desensitization of data sensitive information by introducing a database proxy mechanism. This invention patent can continuously improve the recognition accuracy over time and with the accumulation of data, so as to better adapt to the ever-changing data environment. In contrast, existing technologies often rely on fixed rules or pattern matching, lack sufficient flexibility and adaptability, and are difficult to cope with increasingly complex data flows and emerging new types of sensitive information.

[0027] The executor of the present invention strictly follows the principle of least privilege when performing desensitization operations, and only operates on data within a specified range, which not only ensures the security of the data, but also avoids unnecessary impact on non-sensitive data. In contrast, existing technologies may have the problem of over-processing, that is, non-sensitive data may be affected during the desensitization process, resulting in impaired data integrity or additional workload. A dynamic data desensitization solution is implemented. On the original single-agent architecture of dynamic desensitization, an HTTP proxy is innovatively designed to intercept and store the sessionID for determining the user identity. The database proxy is responsible for implementing desensitization, and the proposed desensitization algorithm and desensitization solution are applied in the desensitization strategy module.

[0028] In summary, the present invention proposes an adaptive desensitization scheme for structured data sets by solving the problem that the sensitivity of attributes in structured data sets cannot be measured and identified during the desensitization process. The dynamic desensitization system based on roles and permissions is extended to application layer users to perform fine-grained desensitization. Finally, the implemented dynamic desensitization system is functionally tested and desensitized to prove that it can realize dynamic desensitization in real time, and display different desensitized data for users with different permissions without changing the original data, realizing the three-layer association of user-application-data and solving the problem of personal privacy leakage. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0030] Figure 1 A schematic flow chart of an adaptive dynamic desensitization method based on a proxy mode is provided for one embodiment of the present invention.

[0031] Figure 2 A schematic diagram of automatic identification of data sensitive attributes of an adaptive dynamic desensitization method based on a proxy mode is provided as an embodiment of the present invention.

[0032] Figure 3 A schematic diagram of a database desensitization proxy structure of an adaptive dynamic desensitization method based on a proxy mode is provided as an embodiment of the present invention.

[0033] Figure 4 A schematic diagram of the row data parsing process of an adaptive dynamic desensitization method based on a proxy mode is provided for one embodiment of the present invention.

[0034] Figure 5 A schematic diagram of a flow chart of dynamic data desensitization of an adaptive dynamic desensitization method based on a proxy mode is provided as an embodiment of the present invention.

[0035] Figure 6 A schematic diagram of automatic identification of data sensitive attributes of an adaptive dynamic desensitization method based on a proxy mode is provided as an embodiment of the present invention. DETAILED DESCRIPTION

[0036] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0037] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0038] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.

[0039] The present invention is described in detail with reference to schematic diagrams. When describing the embodiments of the present invention, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of the present invention. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.

[0040] At the same time, in the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper, lower, inner and outer" are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first, second or third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0041] In the present invention, unless otherwise clearly specified and limited, the terms "install, connect, connect" should be understood in a broad sense, for example: it can be a fixed connection, a detachable connection or an integral connection; it can also be a mechanical connection, an electrical connection or a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0042] Example 1, reference Figure 1-Figure 6 , which is the first embodiment of the present invention, and provides an adaptive dynamic desensitization method based on a proxy mode, comprising:

[0043] Input the structured data set into the sensitive attribute identification module to divide it into a sensitive attribute set and a non-sensitive attribute set;

[0044] Input the data in the sensitive attribute set into the matching desensitization module to match the corresponding desensitization algorithm;

[0045] Through the data request, the request is forwarded to the database proxy, and the database proxy dynamically desensitizes the data to achieve dynamic desensitization of the data.

[0046] The division into the sensitive attribute set and the non-sensitive attribute set includes calculating the sensitivity of each attribute by using a hierarchical analysis method, and further identifying and analyzing the sensitive attributes by using a K-means clustering algorithm, thereby obtaining the sensitive attribute set and the non-sensitive attribute set.

[0047] The method of dividing the sensitive attribute set and the non-sensitive attribute set includes: inputting a structured data set S, clustering the number of clusters k=2, outputting a sensitive attribute set SA and a non-sensitive attribute set NSA, and for each attribute x in S i Calculate the judgment matrix A and weight w i , the sensitivity of the attribute SV = w i For SV={SV1,SV2,…,SV m For each data point in Where i = 1, 2, two particles are randomly selected {SV b ,SV p}, calculate the distance d between the data point and the mass point ij , determine the cluster label ω according to the nearest distance j =argmin i∈{1,...m} d ij , divide them into corresponding clusters For each cluster C i :

[0048] Recalculate the new mean vector

[0049] Update point {SV b ,SV p}, and repeat the calculation until the mass point no longer changes;

[0050] Mark the sensitive attribute set C1 = {SA1, SA2, ...}, the non-sensitive attribute set C2 = {NSA1, NSA2, ...}, and output C1 and C2.

[0051] The desensitization algorithm includes that the database agent needs to complete the analysis of the database protocol, including the analysis of the data packet header and the payload, and complete the real-time data desensitization according to the configuration table. The database agent is completely transparent to the user. When applied, the server connects to the listening port of the database agent.

[0052] The matching desensitization module includes establishing a connection with the database end, receiving a MySQL response message sent from the database end, and sending a MySQL request message to the database end;

[0053] Establish a connection with the browser server to receive MySQL request messages from the server and send MySQL response messages to the server;

[0054] Determine whether the current SQL statement involves tables and fields that need to be desensitized. If the query involves tables and fields that need to be desensitized, record the current interception time for use;

[0055] According to the interception time, the time record with the closest difference to the time is searched, and the corresponding session ID is searched from the session-time table through the time. The corresponding user name is searched from the user-session table through the session ID, and the desensitization scheme required by the current user is obtained according to the desensitization configuration table formulated by the proxy through the user name, and the data in the result set is desensitized and returned to the browser server. For details, refer to Table 1:

[0056] Table 1 Database proxy implementation functions

[0057]

[0058] The matching desensitization module includes desensitizing the result set Result Set responded by the database server, and analyzing the data query result set message Result Set, wherein RowData is the row data of the data table, and the ResultSet message contains multiple Row Data row data structures, wherein each row data Row Data contains multiple field values, and a row of data is composed of the field values.

[0059] The matching desensitization module includes: when implementing dynamic data desensitization, it is necessary to parse the row data of the result set, determine the length of the column data by the value of the first byte, if its value is 0x00, it represents empty data, if its value is 0xfb, it represents NULL, otherwise read the data of the corresponding length, use the corresponding desensitization algorithm to process the data, and replace the original data with the desensitized data and put it into Row Data.

[0060] The dynamic desensitization includes, when the database agent obtains the identity authority of the current query user, according to the above-mentioned desensitization strategy, obtaining the desensitization plan for the query data of the user, and implementing the data desensitization in the module, and assembling the desensitized data into a new result set message, which is forwarded to the browser server by the database agent.

[0061] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0062] Embodiment 2, the second embodiment of the present invention, is different from the previous embodiment in that:

[0063] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0064] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0065] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0066] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0067] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0068] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An adaptive dynamic desensitization method based on proxy mode, characterized by: include, Input the structured data set into the sensitive attribute identification module to divide it into a sensitive attribute set and a non-sensitive attribute set; Input the data in the sensitive attribute set into the matching desensitization module to match the corresponding desensitization algorithm; Through the data request, the request is forwarded to the database proxy, and the database proxy dynamically desensitizes the data to achieve dynamic desensitization of the data.

2. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 1, characterized in that: The division into the sensitive attribute set and the non-sensitive attribute set includes calculating the sensitivity of each attribute by using a hierarchical analysis method, and further identifying and analyzing the sensitive attributes by using a K-means clustering algorithm, thereby obtaining the sensitive attribute set and the non-sensitive attribute set.

3. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 2, characterized in that: The method of dividing the sensitive attribute set and the non-sensitive attribute set includes: inputting a structured data set S, clustering the number of clusters k=2, outputting a sensitive attribute set SA and a non-sensitive attribute set NSA, and for each attribute x in S i Calculate the judgment matrix A and weight w i , the sensitivity of the attribute SV = w i For SV={SV1,SV2,…,SV m For each data point in Where i = 1, 2, two particles are randomly selected {SV b ,SV p }, calculate the distance d between the data point and the mass point ij , determine the cluster label ω according to the nearest distance j =argmin i∈{1,...m} d ij , divide them into corresponding clusters For each cluster C i : Recalculate the new mean vector Update point {SV b ,SV p }, and repeat the calculation until the mass point no longer changes; Mark sensitive attribute set C1 = {SA1, SA2, ...}, non-sensitive attribute set C2 = {NSA1, NSA2, ...}, output C1 and C 2。 4. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 3, characterized in that: The desensitization algorithm includes that the database agent needs to complete the analysis of the database protocol, including the analysis of the data packet header and the payload, and complete the real-time data desensitization according to the configuration table. The database agent is completely transparent to the user. When applied, the server connects to the listening port of the database agent.

5. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 4, characterized in that: The matching desensitization module includes establishing a connection with the database end, receiving a MySQL response message sent from the database end, and sending a MySQL request message to the database end; Establish a connection with the browser server to receive MySQL request messages from the server and send MySQL response messages to the server; Determine whether the current SQL statement involves tables and fields that need to be desensitized. If the query involves tables and fields that need to be desensitized, record the current interception time for use; According to the interception time, the time record with the closest difference to this time is searched, and the corresponding session ID is searched from the session-timetable through the time. The corresponding user name is searched from the user-session table through the session ID, and the desensitization scheme required by the current user is obtained according to the desensitization configuration table formulated by the proxy through the user name, and the data in the result set is desensitized and returned to the browser server.

6. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 5, characterized in that: The matching desensitization module includes desensitizing the result set Result Set responded by the database server, and analyzing the data query result set message Result Set, wherein RowData is the row data of the data table, and the Result Set message contains multiple RowData row data structures, wherein each row data Row Data contains multiple field values, and a row of data is composed of the field values.

7. The adaptive dynamic desensitization method based on proxy mode according to claim 6, characterized in that: The matching desensitization module includes: when implementing dynamic data desensitization, it is necessary to parse the row data of the result set, determine the length of the column data by the value of the first byte, if its value is 0x00, it represents empty data, if its value is 0xfb, it represents NULL, otherwise read the data of the corresponding length, use the corresponding desensitization algorithm to process the data, and replace the original data with the desensitized data and put it into Row Data.

8. The adaptive dynamic desensitization method based on proxy mode as claimed in claim 7, characterized in that: The dynamic desensitization includes, when the database agent obtains the identity authority of the current query user, according to the above-mentioned desensitization strategy, obtaining the desensitization plan for the query data of the user, and implementing the data desensitization in the module, and assembling the desensitized data into a new result set message, which is forwarded to the browser server by the database agent.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Images